Hey! R scraping is tricky, but you’re on the right track with `rvest` and `RSelenium`. For dynamic content, I’d recommend checking out `V8` package—it lets you run JavaScript directly in R, which can help with scraping dynamic elements.
For pagination, I usually use a `while` loop with a condition to stop when there’s no “next” button. Also, make sure to log your progress so you can pick up where you left off if the script breaks.
Good luck!
For pagination, I usually use a `while` loop with a condition to stop when there’s no “next” button. Also, make sure to log your progress so you can pick up where you left off if the script breaks.
Good luck!