Hey! Scraping insta and tiktok can def be tricky, esp with rate limits. I’ve used Puppeteer for this kinda stuff before and it works pretty well for how to scrape user accounts on instagram and tiktok aws.
For rate limits, try rotating proxies (like from Bright Data or Oxylabs) and adding random delays between requests. AWS Lambda is great for scaling, but make sure you’re not hitting API limits too fast.
For storage, S3 is solid for raw data, and DynamoDB is good if you need to query it later. Just watch out for costs tho, Dynamo can get pricey if you’re not careful.
Good luck! ✌️
For rate limits, try rotating proxies (like from Bright Data or Oxylabs) and adding random delays between requests. AWS Lambda is great for scaling, but make sure you’re not hitting API limits too fast.
For storage, S3 is solid for raw data, and DynamoDB is good if you need to query it later. Just watch out for costs tho, Dynamo can get pricey if you’re not careful.
Good luck! ✌️