Wow, thanks so much for all the replies, everyone! This is super helpful. I think I’m gonna go with Python and Scrapy based on what y’all said. I’ll definitely grab some proxies—probably gonna try Bright Data or ProxyMesh.
Quick follow-up: anyone have tips on handling CAPTCHAs? I’ve heard about 2Captcha, but is it worth it? Also, how often do you guys rotate your proxies?
Thanks again for all the advice—this thread has been a lifesaver!
Quick follow-up: anyone have tips on handling CAPTCHAs? I’ve heard about 2Captcha, but is it worth it? Also, how often do you guys rotate your proxies?
Thanks again for all the advice—this thread has been a lifesaver!