Honestly, screen scraping node js is a headache with dynamic sites. I’ve been there!
Try Playwright—it’s faster than Puppeteer and less resource-heavy. For rate limits, use residential proxies (Luminati’s good but pricey). Also, mimic human behavior: randomize click patterns, scroll delays, etc.
If you’re feeling adventurous, check out Apify—it’s a scraping framework that handles a lot of the dirty work for you.
Try Playwright—it’s faster than Puppeteer and less resource-heavy. For rate limits, use residential proxies (Luminati’s good but pricey). Also, mimic human behavior: randomize click patterns, scroll delays, etc.
If you’re feeling adventurous, check out Apify—it’s a scraping framework that handles a lot of the dirty work for you.