Need help building a Node.js website scraper – any tips or best libraries? or What’s the most efficie

16 Replies, 1452 Views

Pro tip: Don’t just rely on Puppeteer or Cheerio. Sometimes you gotta mix tools.

For example:
- Use Playwright if Puppeteer’s too slow.
- For CAPTCHAs, try 2Captcha API.
- For proxies, Luminati’s good but pricey.

Also, cache responses so you don’t hammer the server. Redis works great for this.

Messages In This Thread



Users browsing this thread: 1 Guest(s)