What’s the best way to handle web scraping in R for beginners? or How can I improve my web scraping i

22 Replies, 1272 Views

Wow, thanks everyone! Didn’t expect so many tips. Tried SelectorGadget and it’s a game-changer—way better than guessing selectors.

Still hitting 403s on one site tho, even with `user_agent()`. Might check out `polite` or just slow down requests like y’all said.

And yeah, sticking with rvest for now. RSelenium sounds scary, but maybe later.

Quick Q: Anyone know a good free proxy service, or is that a pipe dream?

Thanks again!

Messages In This Thread



Users browsing this thread: 1 Guest(s)