Yo, I’ve been in the same boat. Scraping craiglist with phone numbers is no joke. I’ve had some success using Apify—it’s a cloud-based scraper that’s super easy to set up.
Proxies are def not overkill. I use Luminati, and they’ve been solid for avoiding blocks.
As for rules, just don’t be a jerk about it. Keep your requests spaced out, and don’t scrape anything that’s not publicly available.
Proxies are def not overkill. I use Luminati, and they’ve been solid for avoiding blocks.
As for rules, just don’t be a jerk about it. Keep your requests spaced out, and don’t scrape anything that’s not publicly available.