Scraping reddit page can be tricky, especially with the API changes. I’ve been using a combo of Selenium and BeautifulSoup for more dynamic content. It’s slower but gets the job done.
For proxies, I’d suggest sticking with residential ones like Luminati. They’re more expensive but less likely to get flagged.
Also, check out Scrapy Cloud if you want a managed solution. It’s great for handling large-scale scraping reddit page projects.
For proxies, I’d suggest sticking with residential ones like Luminati. They’re more expensive but less likely to get flagged.
Also, check out Scrapy Cloud if you want a managed solution. It’s great for handling large-scale scraping reddit page projects.