Best Tools and Techniques to Scrape Website R: What Works in 2023?

15 Replies, 1774 Views

Yo, scraping website R is a beast sometimes. I’ve been using Puppeteer lately, and it’s been a game-changer for dynamic content. It’s not R-specific, but you can run it with Node.js and pipe the data back into R.

For IP blocking, I’d recommend using a VPN or rotating proxies. Also, make sure to set random delays between requests to avoid detection.

If you’re sticking to R, RSelenium is solid, but yeah, it’s a bit clunky. Maybe give `rvest` another shot with some tweaks?

Messages In This Thread



Users browsing this thread: 1 Guest(s)