Struggling with R scraping? Any tips for handling dynamic content and pagination?

7 Replies, 1703 Views

R scraping is a beast, but you’ll get the hang of it! For dynamic content, I’d recommend using `chromote`—it’s a headless Chrome browser that’s faster than RSelenium.

For pagination, I usually write a recursive function that calls itself until there’s no more data. It’s a bit advanced, but it works like a charm. Also, don’t forget to handle HTTP errors with `tryCatch`.

You got this!

Messages In This Thread



Users browsing this thread: 1 Guest(s)