What’s the best way to build a reliable node.js website scraper? or Need help optimizing my node.js w

18 Replies, 1477 Views

Wow, thanks for all the tips! Tried `puppeteer-cluster` and it’s way faster already.

Still hitting rate limits though—gonna test `scrapeops.io` next.

Quick Q: Anyone know if Cloudflare bans are avoidable with these tricks? My scraper keeps getting blocked after a while.

Also, `playwright` looks interesting—might switch if Puppeteer keeps being a pain.

Thanks again, y’all are lifesavers!

Messages In This Thread



Users browsing this thread: 1 Guest(s)