Yo! Scraping dynamic content is the worst, right? I’ve been using rvest + V8 combo for lighter JS stuff, and it’s been a lifesaver.
For heavier sites, RSelenium is the way to go, but yeah, it’s a bit of a beast. If you’re looking for something simpler, htmlunit (via the htmlunit package) is a decent middle ground—it handles JS but isn’t as heavy as Selenium.
Also, don’t sleep on xml2—it’s not as flashy as rvest, but it’s super reliable for parsing.
For heavier sites, RSelenium is the way to go, but yeah, it’s a bit of a beast. If you’re looking for something simpler, htmlunit (via the htmlunit package) is a decent middle ground—it handles JS but isn’t as heavy as Selenium.
Also, don’t sleep on xml2—it’s not as flashy as rvest, but it’s super reliable for parsing.