Scraping TikTok is a headache, but I’ve found that using a combination of Puppeteer and residential proxies works best. AWS is great for scaling, but don’t forget to use spot instances to save on costs.
For Instagram, I’ve been using Instagram-scraper with AWS S3 for storage. It’s super easy to set up and works like a charm.
Also, check out Scrapy Cloud if you’re looking for a managed solution. It’s not free, but it’s worth it if you’re scraping at scale.
For Instagram, I’ve been using Instagram-scraper with AWS S3 for storage. It’s super easy to set up and works like a charm.
Also, check out Scrapy Cloud if you’re looking for a managed solution. It’s not free, but it’s worth it if you’re scraping at scale.