I feel you on this! I’ve been using WebHarvy for scraping Apartments.com, and it’s been pretty reliable. It’s not free, but it’s affordable and super easy to use.
To avoid getting blocked, I’d suggest using rotating proxies and setting a delay of at least 5 seconds between requests. Apartments.com is no joke when it comes to blocking scrapers.
Hope this helps!
To avoid getting blocked, I’d suggest using rotating proxies and setting a delay of at least 5 seconds between requests. Apartments.com is no joke when it comes to blocking scrapers.
Hope this helps!