If you’re building a node js website scraper, Playwright is worth a look too! It’s like Puppeteer but with multi-browser support (Chromium, Firefox, WebKit).
I’ve found it more stable for heavy JS sites. For errors, wrap your calls in try-catch and add retries with exponential backoff—`p-retry` lib is great for this.
CAPTCHAs are the worst… I’ve had some luck with stealth plugins to avoid them, but YMMV.
I’ve found it more stable for heavy JS sites. For errors, wrap your calls in try-catch and add retries with exponential backoff—`p-retry` lib is great for this.
CAPTCHAs are the worst… I’ve had some luck with stealth plugins to avoid them, but YMMV.