Web scraping in R is a beast, but it’s so rewarding once you get it right! For dynamic content, I second the RSelenium suggestion. It’s a bit of a learning curve, but worth it.
Also, check out `xml2` alongside rvest. Sometimes it handles weird HTML better.
For IP bans, I use a combo of rotating proxies and random delays. And don’t forget to mimic human behavior—like scrolling or clicking.
Also, check out `xml2` alongside rvest. Sometimes it handles weird HTML better.
For IP bans, I use a combo of rotating proxies and random delays. And don’t forget to mimic human behavior—like scrolling or clicking.