Hey! I’ve been doing web scraping in R for a while, and yeah, dynamic content is the worst. RSelenium is great, but if you want something simpler, try `puppeteer` via the `chromote` package.
For getting blocked, I use a mix of proxies and Tor. Also, make sure to respect the site’s rate limits. The `ratelimitr` package can help with that.
Good luck, and don’t give up!
For getting blocked, I use a mix of proxies and Tor. Also, make sure to respect the site’s rate limits. The `ratelimitr` package can help with that.
Good luck, and don’t give up!