Hey! I feel your pain with scraping website R. It can be such a headache, especially with dynamic content. I’ve been using RSelenium for a while now, and yeah, the setup is a bit of a hassle, but it’s worth it for handling JavaScript-heavy sites.
Another tool I’ve found super helpful is `rvest` combined with `httr` for basic scraping, but when things get tricky, I switch to `polite` package. It helps manage rate limits and avoids getting blocked.
Also, have you tried using proxies? They’re a lifesaver when dealing with IP blocks. I use a rotating proxy service like ScraperAPI or Bright Data. Makes scraping website R way smoother.
Good luck!
Another tool I’ve found super helpful is `rvest` combined with `httr` for basic scraping, but when things get tricky, I switch to `polite` package. It helps manage rate limits and avoids getting blocked.
Also, have you tried using proxies? They’re a lifesaver when dealing with IP blocks. I use a rotating proxy service like ScraperAPI or Bright Data. Makes scraping website R way smoother.
Good luck!