What’s the best way to screen scrape a web page without getting blocked? or How can I screen scrape a

20 Replies, 2227 Views

Yo, dealing with dynamic content? Selenium’s my go-to. Yeah, it’s slow af, but it works when you need to screen scrape web page stuff that loads after the fact.

Alternatively, check out Playwright—kinda like Puppeteer but with better docs imo.

If you’re lazy (like me), sometimes you can just reverse-engineer the API calls the page makes. DevTools is your friend here.

Messages In This Thread



Users browsing this thread: 1 Guest(s)