What’s the best way to screen scrape a web page without getting blocked? or How can I screen scrape a

19 Replies, 1814 Views

Dynamic content is a pain, but you can often avoid headless browsers if you’re clever.

Check the network tab in DevTools—sometimes the data’s loaded via XHR or fetch calls. You can just hit those endpoints directly.

If you *must* use a browser, Playwright’s been way more reliable for me than Selenium. Less resource-heavy too.

Messages In This Thread



Users browsing this thread: 1 Guest(s)