Looking for a reliable Node.js website scraper – any recommendations? or How to build an efficient No

14 Replies, 1072 Views

"Looking for a reliable Node.js website scraper – any recommendations?"

Hey folks!

I’ve been messing around with a few Node.js website scraper tools lately, but none seem to handle dynamic content well *and* stay reliable.

Tried Cheerio + Puppeteer, which works okay, but feels a bit heavy for simple tasks. Anyone got a lighter combo or a solid library they swear by?

Also, how do y’all deal with rate limits? Proxies? Random delays? Would love some real-world tips.

Thanks in advance!

---

*PS: If you’ve built your own Node.js website scraper from scratch, I’d love to hear how you optimized it!*

Messages In This Thread
Looking for a reliable Node.js website scraper – any recommendations? or How to build an efficient No - by - 17-07-2024, 06:34 PM



Users browsing this thread: 1 Guest(s)