Best Tools and Techniques to Scrape Website R: What Works in 2023?

12 Replies, 1248 Views

Hey! I’ve been scraping website R for a while now, and I totally get the struggle. For dynamic content, RSelenium is your best bet in R, but yeah, the setup can be annoying.

If you’re open to other tools, I’d recommend trying out Scrapy in Python. It’s super powerful and handles dynamic content and IP blocking really well.

For R-specific solutions, `rvest` and `httr` are great, but you might need to tweak your approach. Try adding random delays and rotating user agents to avoid detection.

Messages In This Thread



Users browsing this thread: 1 Guest(s)