What's the best way to handle screen scraping in Node.js for dynamic websites? or How reliable is scr

18 Replies, 1985 Views

Cheerio is my jam for quick & dirty scraping. If the site’s static, why bother with a full browser? Puppeteer’s overkill sometimes.

But yeah, CAPTCHAs are the worst. I’ve had some luck with puppeteer-extra-plugin-stealth to avoid detection.

For rotating proxies, I use Bright Data (formerly Luminati). Pricey but worth it if you’re scraping at scale.

Messages In This Thread



Users browsing this thread: 1 Guest(s)