Hey! I’ve been using a tool called Diffbot to scrape reddit page, and it’s been pretty smooth sailing. It’s not free, but it’s worth it if you’re doing a lot of scraping.
Also, if you’re hitting rate limits, try using a VPN to switch up your IP every now and then. It’s not perfect, but it helps. Good luck with your project!
Also, if you’re hitting rate limits, try using a VPN to switch up your IP every now and then. It’s not perfect, but it helps. Good luck with your project!