Best Tools and Techniques to Scrape Website R: What Works in 2023?

16 Replies, 1828 Views

Thanks for all the suggestions, everyone! I’ve been experimenting with RSelenium, and while the setup was a bit of a pain, it’s definitely helping with the dynamic content on website R.

I also tried the `polite` package, and it’s been great for managing rate limits. Still figuring out the proxy thing, but I’ll give ScraperAPI a shot.

Quick question though—anyone have tips on handling CAPTCHAs? That’s the next hurdle I’m hitting.

Cheers!

Messages In This Thread



Users browsing this thread: 1 Guest(s)