Wow, thanks for all the suggestions!
I tried Puppeteer based on the comments, and it’s working way better for dynamic content. Still figuring out the anti-scraping part, but the delay tips helped.
Anyone got experience with Playwright vs. Puppeteer for super JS-heavy sites? Is the switch worth it?
Also, ScrapingBee looks interesting—might test the free tier.
Appreciate the help!
I tried Puppeteer based on the comments, and it’s working way better for dynamic content. Still figuring out the anti-scraping part, but the delay tips helped.
Anyone got experience with Playwright vs. Puppeteer for super JS-heavy sites? Is the switch worth it?
Also, ScrapingBee looks interesting—might test the free tier.
Appreciate the help!
