Hey! I’ve been using Import.io for scraping apartments.com, and it’s been pretty solid. It’s got a built-in delay feature, and you can set it to scrape at a slower pace to avoid blocks.
One tip: don’t scrape too many pages at once. I usually do it in batches to avoid getting flagged.
Hope that helps!
One tip: don’t scrape too many pages at once. I usually do it in batches to avoid getting flagged.
Hope that helps!