What's the best way to handle screen scraping without getting blocked? or Is screen scraping still a

20 Replies, 1472 Views

"What's the best way to handle screen scraping without getting blocked?"

Yo, so I’ve been screen scraping for a while now, and man, getting blocked is the WORST. Anyone got tips to fly under the radar?

I’ve tried rotating proxies, slowing down requests, and even mimicking human clicks (lol). But some sites still sniff me out like a bloodhound.

Also, anyone use headless browsers? Do they help or just make it more obvious you’re screen scraping?

And yeah, I know some folks say "just use an API," but c’mon—half the time they’re either paywalled or don’t exist.

Spill your secrets, pls. 🙏

---

*(Or if you wanna pick another topic, lmk!)*

Messages In This Thread
What's the best way to handle screen scraping without getting blocked? or Is screen scraping still a - by - 12-12-2024, 03:08 AM



Users browsing this thread: 1 Guest(s)