Playwright’s my go-to for screen scraping node js now. Puppeteer’s good, but Playwright’s just… smoother.
For rate limits, yeah, proxies are key. I use a mix of datacenter and residential (depending on the site’s sensitivity). Also, cache responses if you can—no point re-scraping the same data.
Oh, and if the site has Cloudflare, good luck. You’ll need more than just proxies.
For rate limits, yeah, proxies are key. I use a mix of datacenter and residential (depending on the site’s sensitivity). Also, cache responses if you can—no point re-scraping the same data.
Oh, and if the site has Cloudflare, good luck. You’ll need more than just proxies.
