Scraping website R is a pain, but it’s doable with the right tools. I’ve been using `rvest` and `httr` for basic stuff, but for dynamic content, RSelenium is the way to go.
Another tool I’ve found useful is `V8` for running JavaScript directly in R. It’s not perfect, but it helps with some of the dynamic elements.
For IP blocking, I’d recommend using a proxy service or a VPN. Also, make sure to set random delays between requests to avoid getting flagged.
Another tool I’ve found useful is `V8` for running JavaScript directly in R. It’s not perfect, but it helps with some of the dynamic elements.
For IP blocking, I’d recommend using a proxy service or a VPN. Also, make sure to set random delays between requests to avoid getting flagged.