What’s the best way to screen scrape a web page without getting blocked? or How can I screen scrape a

20 Replies, 2226 Views

If you’re scraping at scale, you gotta think about fingerprints. Sites track stuff like canvas rendering, WebGL, and fonts.

Tools like Puppeteer-stealth or Playwright’s stealth mode help, but it’s an arms race.

Also, consider using a VPN + proxy combo if you’re really paranoid.

---

Hey everyone, thx for all the tips!

Tried Puppeteer with stealth mode and it’s way better—still got a few blocks but way fewer than before.

Anyone got a good free/cheap proxy provider? The ones I’ve found either suck or cost a fortune.

Also, how do you handle rate limits? Just hardcode delays or something smarter?

Messages In This Thread



Users browsing this thread: 1 Guest(s)