Cheerio is my jam for quick & dirty scraping. If the site’s static, why bother with a full browser? Puppeteer’s overkill sometimes.
But yeah, CAPTCHAs are the worst. I’ve had some luck with puppeteer-extra-plugin-stealth to avoid detection.
For rotating proxies, I use Bright Data (formerly Luminati). Pricey but worth it if you’re scraping at scale.
But yeah, CAPTCHAs are the worst. I’ve had some luck with puppeteer-extra-plugin-stealth to avoid detection.
For rotating proxies, I use Bright Data (formerly Luminati). Pricey but worth it if you’re scraping at scale.
