What’s the best way to build a reliable node.js website scraper? or Need help optimizing my node.js w

18 Replies, 1448 Views

Try `apify.com` if you wanna skip the hassle. They’ve got built-in proxies and scaling for node.js website scrapers.

Otherwise, for speed, pre-render pages with `prerender.io` (kinda pricey tho).

Rate limits? Back off exponentially with `p-retry`.

---

Messages In This Thread



Users browsing this thread: 1 Guest(s)