Wow, thanks for all the suggestions, everyone! I’ve been trying out Scrapy with rotating proxies, and it’s been working a bit better. Still getting blocked occasionally, but it’s progress.
I’m definitely going to check out some of the CAPTCHA services you guys mentioned—those things are driving me nuts.
Quick question though: anyone have experience with using headless browsers like Puppeteer for scraping adresses? I’m curious if it’s worth the extra setup time.
Thanks again for all the help—you guys are awesome!
I’m definitely going to check out some of the CAPTCHA services you guys mentioned—those things are driving me nuts.
Quick question though: anyone have experience with using headless browsers like Puppeteer for scraping adresses? I’m curious if it’s worth the extra setup time.
Thanks again for all the help—you guys are awesome!
