Looking for a reliable Node.js website scraper – any recommendations? or How to build an efficient No

14 Replies, 1087 Views

Honestly, Cheerio + Puppeteer is still the best combo for a Node.js website scraper imo. Yeah, it’s heavy, but it just *works*.

For rate limits, I add user-agent rotation and 2-5s delays. Proxies are overkill unless you’re scraping at scale.

Btw, if you’re building your own, lazy-load elements to avoid unnecessary requests. Saves bandwidth!

Messages In This Thread



Users browsing this thread: 1 Guest(s)