Dynamic content is the worst, man. I’ve been using RSelenium for the heavy stuff, but it’s a bit much for smaller projects.
For lighter JS, I’ve been using V8—it’s super lightweight and gets the job done. Also, polite is a must for ethical scraping—it’s saved me from getting blocked more times than I can count.
If you’re looking for something simpler, check out htmlunit—it’s a nice middle ground between rvest and Selenium.
For lighter JS, I’ve been using V8—it’s super lightweight and gets the job done. Also, polite is a must for ethical scraping—it’s saved me from getting blocked more times than I can count.
If you’re looking for something simpler, check out htmlunit—it’s a nice middle ground between rvest and Selenium.