Need help building a Node JS website scraper – any tips or libraries you recommend? or What’s the bes

20 Replies, 1656 Views

Hey everyone! Wow, didn’t expect so many awesome replies—thanks a ton! 🙌

I think I’ll start with Puppeteer since most of you recommended it for JS-heavy sites. Gonna check out that `puppeteer-cluster` lib too for parallel scraping.

Quick follow-up: Anyone got tips on handling sessions/cookies? Some sites log me out mid-scrape, and it’s annoying.

Also, big thanks for the CAPTCHA sympathy lol. I’ll try `puppeteer-extra-stealth` and see if it helps.

Cheers! 🚀

Messages In This Thread



Users browsing this thread: 1 Guest(s)