This crawler’s pretty reliable for large jobs, but it’s not a "set and forget" tool. You’ll need to babysit it a bit.
Speed is decent, but if you’re in a hurry, maybe look at Scrapy + Scrapinghub for more control.
For proxies, I’ve had good luck with GeoSurf.
Speed is decent, but if you’re in a hurry, maybe look at Scrapy + Scrapinghub for more control.
For proxies, I’ve had good luck with GeoSurf.
