Dynamic content is a nightmare, right? I’ve found that sometimes the data is hidden in JSON or API calls. Use your browser’s dev tools to inspect the network traffic—you might find the data you need without scraping the HTML at all.
For pagination, I’d suggest using `purrr` to map over pages. It’s cleaner than a loop and handles errors better. Also, check out `seleniumPipes`—it’s a wrapper around RSelenium that makes things a bit easier.
Keep at it!
For pagination, I’d suggest using `purrr` to map over pages. It’s cleaner than a loop and handles errors better. Also, check out `seleniumPipes`—it’s a wrapper around RSelenium that makes things a bit easier.
Keep at it!