Hey everyone,
So, I’ve been diving into R scraping lately, and man, it’s been a rollercoaster. I’m trying to scrape this site with *super* dynamic content, and it’s driving me nuts. Like, the data keeps changing, and my script just can’t keep up.
Also, pagination? Ugh. I’m using `rvest` and `RSelenium`, but I feel like I’m missing something. Anyone got tips on handling these two beasts?
Like, how do you deal with pages that load content dynamically? And what’s the best way to loop through paginated results without the script breaking halfway?
Would love to hear your hacks or even some libraries/packages I might’ve overlooked.
Thanks in advance, y’all!
(Also, sorry if this has been asked a million times—I’m still kinda new to R scraping and forums in general lol.)
So, I’ve been diving into R scraping lately, and man, it’s been a rollercoaster. I’m trying to scrape this site with *super* dynamic content, and it’s driving me nuts. Like, the data keeps changing, and my script just can’t keep up.
Also, pagination? Ugh. I’m using `rvest` and `RSelenium`, but I feel like I’m missing something. Anyone got tips on handling these two beasts?
Like, how do you deal with pages that load content dynamically? And what’s the best way to loop through paginated results without the script breaking halfway?
Would love to hear your hacks or even some libraries/packages I might’ve overlooked.
Thanks in advance, y’all!
(Also, sorry if this has been asked a million times—I’m still kinda new to R scraping and forums in general lol.)