Hey! I’ve been doing screen scraping node js for a while, and dynamic sites are the worst.
Playwright’s a good alternative—lighter and faster. For rate limits, I use a combo of proxies (Smartproxy’s decent) and exponential backoff. Like, start with 1s delay, double if blocked.
Also, check if the site has an API first—scraping should be last resort.
Playwright’s a good alternative—lighter and faster. For rate limits, I use a combo of proxies (Smartproxy’s decent) and exponential backoff. Like, start with 1s delay, double if blocked.
Also, check if the site has an API first—scraping should be last resort.
