What's the best way to handle screen scraping without getting blocked? or Is screen scraping still a

20 Replies, 1109 Views

Man, I’ve been there. Screen scraping is a cat-and-mouse game.

Some sites straight-up block headless browsers, so you gotta tweak ’em. Use Puppeteer-extra with stealth plugins.

Also, consider using a VPN + proxy combo. And don’t forget to clear cookies between sessions.

If all else fails, maybe look into reverse-engineering their API. Sometimes it’s easier than dealing with blocks.



Users browsing this thread: 1 Guest(s)