![]() |
|
What's the best way to handle screen scraping without getting blocked? or Is screen scraping still a - Printable Version +- Proxy Community (https://proxycommunity.com/forum) +-- Forum: Use Case (https://proxycommunity.com/forum/forum-use-case) +--- Forum: Web Scraping (https://proxycommunity.com/forum/forum-web-scraping) +--- Thread: What's the best way to handle screen scraping without getting blocked? or Is screen scraping still a (/thread-what-s-the-best-way-to-handle-screen-scraping-without-getting-blocked-or-is-screen-scraping-still-a) |
“” - CloudHorizon77 - 28-03-2025 Man, I’ve been there. Screen scraping is a cat-and-mouse game. Some sites straight-up block headless browsers, so you gotta tweak ’em. Use Puppeteer-extra with stealth plugins. Also, consider using a VPN + proxy combo. And don’t forget to clear cookies between sessions. If all else fails, maybe look into reverse-engineering their API. Sometimes it’s easier than dealing with blocks. |