Struggling with web scraping in R? Any tips or tools to make it easier?

11 Replies, 2127 Views

Hey! Web scraping in R can be a headache, but it’s worth it. For dynamic content, RSelenium is the go-to, but it’s heavy. If you want something lighter, try `V8` for running JS directly in R.

For IP bans, I use a VPN and rotate user agents. Also, try to mimic human behavior as much as possible.

Hope this helps!
Web scraping in R is tough, but you’ll get there! For dynamic content, RSelenium is the best, but it’s slow. If you want something faster, try `puppeteer` via `chromote`.

For IP bans, I use a proxy service and random delays. Also, make sure to respect the site’s rate limits.

Good luck, and don’t give up!



Users browsing this thread: 1 Guest(s)