Yo, AWS is def a game-changer for scraping. I’ve been using Scrapy with AWS Lambda for smaller tasks, and it’s super cost-effective.
For TikTok, their API is a pain, but you can try using TikTok’s own endpoints with a custom wrapper. Just make sure to randomize your request headers and use residential proxies—datacenter ones get flagged too fast.
Instagram’s a bit easier. I’ve been using InstagramAPI-Python with rotating proxies, and it’s been working fine. Just keep your request rate low, like 1 request every 5-10 seconds.
For TikTok, their API is a pain, but you can try using TikTok’s own endpoints with a custom wrapper. Just make sure to randomize your request headers and use residential proxies—datacenter ones get flagged too fast.
Instagram’s a bit easier. I’ve been using InstagramAPI-Python with rotating proxies, and it’s been working fine. Just keep your request rate low, like 1 request every 5-10 seconds.