Hey everyone!
Sooo, I’ve been trying to get into web scraping in R, and honestly, it’s been a bit of a struggle. 😅 I’ve been messing around with rvest and httr, but sometimes the websites just don’t wanna cooperate (looking at you, dynamic content!).
Anyone got tips or tools to make web scraping in R less of a headache? Like, are there any packages I’m missing out on? Or maybe some tricks to handle those pesky JavaScript-heavy sites?
Also, how do y’all deal with getting blocked? I feel like I’m walking on eggshells trying not to get my IP banned lol.
Any advice would be super appreciated! 🙏
Cheers!
Sooo, I’ve been trying to get into web scraping in R, and honestly, it’s been a bit of a struggle. 😅 I’ve been messing around with rvest and httr, but sometimes the websites just don’t wanna cooperate (looking at you, dynamic content!).
Anyone got tips or tools to make web scraping in R less of a headache? Like, are there any packages I’m missing out on? Or maybe some tricks to handle those pesky JavaScript-heavy sites?
Also, how do y’all deal with getting blocked? I feel like I’m walking on eggshells trying not to get my IP banned lol.
Any advice would be super appreciated! 🙏
Cheers!