Hey! I’ve been scraping craiglist with phone numbers for a while, and I’ve found that using a combo of Scrapy and Splash works really well. Splash handles the JS rendering, and Scrapy does the heavy lifting.
Proxies are a must if you’re scraping at scale. I use GeoSurf, and they’ve been great.
Just make sure you’re not violating craiglist’s TOS. It’s always better to be safe than sorry.
Proxies are a must if you’re scraping at scale. I use GeoSurf, and they’ve been great.
Just make sure you’re not violating craiglist’s TOS. It’s always better to be safe than sorry.