What’s the best way to screen scrape a web page without getting blocked? or How can I screen scrape a

Wow, thanks for all the tips! Didn’t expect so many replies.

I tried Puppeteer with some delays, and it’s working way better. Still getting blocked occasionally though—might need to invest in those residential proxies.

Quick Q: Anyone know a good free proxy list that’s not totally garbage? Or am I doomed to pay up?

Also, shoutout to the person who mentioned cloudflare-scrape. Gonna test that next.

Cheers!