Best Tools and Techniques to Scrape Website R: What Works in 2023?

15 Replies, 1765 Views

Scraping website R is no joke, especially with all the anti-scraping measures these days. I’ve been using `rvest` and `httr` too, but when things get messy, I switch to `RSelenium`. It’s a bit of a pain to set up, but it handles dynamic content like a champ.

Another tip: use `polite` package to manage your scraping etiquette. It helps avoid getting blocked by respecting the site’s robots.txt.

Also, consider using a proxy service like ScraperAPI. It’s been a lifesaver for me.

Messages In This Thread



Users browsing this thread: 1 Guest(s)