Thanks for all the tips, y’all! Gonna try ScraperAPI and Puppeteer-extra first—sounds like they might solve my scraping site woes.
Quick Q: anyone know if rotating user-agents mid-session is overkill? Or should I just stick to one per IP?
Also, update: tried Bright Data’s proxies like someone suggested, and it’s way better than my old setup. Still getting some blocks though, so tweaking delays next. Appreciate the help!
Quick Q: anyone know if rotating user-agents mid-session is overkill? Or should I just stick to one per IP?
Also, update: tried Bright Data’s proxies like someone suggested, and it’s way better than my old setup. Still getting some blocks though, so tweaking delays next. Appreciate the help!
