Hey! I’ve been using rvest for most of my scrape website R needs, but yeah, dynamic content is a pain.
For JS-heavy sites, I’ve been using Playwright—it’s faster than Selenium and handles modern JS frameworks really well.
Also, polite is a lifesaver for rate-limiting and respecting robots.txt. Definitely worth checking out!
For JS-heavy sites, I’ve been using Playwright—it’s faster than Selenium and handles modern JS frameworks really well.
Also, polite is a lifesaver for rate-limiting and respecting robots.txt. Definitely worth checking out!