Need help building a Node JS website scraper – any tips or libraries you recommend? or What’s the bes

20 Replies, 1651 Views

Cheerio + axios is my combo for simple scraping—super fast if the site’s static. But yeah, for JS-heavy stuff, you’ll need Puppeteer or Playwright.

Pro tip: Use `user-agent` rotation and delay requests to avoid bans. For CAPTCHAs, honestly, sometimes it’s easier to just find another data source lol.

Here’s a GitHub repo with examples: [Node Scraper Boilerplate](https://github.com/example).

Messages In This Thread



Users browsing this thread: 1 Guest(s)