What’s the best tool for scraping site data without getting blocked? or How do you handle CAPTCHAs wh

14 Replies, 1233 Views

Thanks for all the tips, y’all! Gonna try ScraperAPI and Puppeteer-extra first—sounds like they might solve my scraping site woes.

Quick Q: anyone know if rotating user-agents mid-session is overkill? Or should I just stick to one per IP?

Also, update: tried Bright Data’s proxies like someone suggested, and it’s way better than my old setup. Still getting some blocks though, so tweaking delays next. Appreciate the help!

Messages In This Thread



Users browsing this thread: 1 Guest(s)