Wow, thanks for all the tips, everyone! Definitely gonna try rotating IPs and slowing down my requests.
Quick question though—anyone know if cloudflare-protected sites are a lost cause for screen scrape? Or is there a way around that too?
Also, gonna check out Puppeteer-extra and Luminati based on your suggestions. Appreciate the help!
Quick question though—anyone know if cloudflare-protected sites are a lost cause for screen scrape? Or is there a way around that too?
Also, gonna check out Puppeteer-extra and Luminati based on your suggestions. Appreciate the help!
