Need help building a Node JS website scraper – any tips or libraries you recommend? or What’s the bes

20 Replies, 1391 Views

Puppeteer’s awesome, but it’s heavy. If you’re scraping at scale, check out Apify—it’s built on Puppeteer but handles proxies, queues, etc., for you.

For rate-limiting, `bottleneck` is a lifesaver. CAPTCHAs? Yeah, no easy fix… maybe try `puppeteer-extra` with stealth mode?

Tutorial: [Scraping with Apify](https://example.com/apify).

Messages In This Thread



Users browsing this thread: 1 Guest(s)