I’ve been using Octoparse for a while now, and it’s decent for scraping tweets, but yeah, Twitter’s anti-scraping is brutal. What worked for me was setting up a super slow scraping schedule—like one request every 10-15 seconds.
Also, using residential proxies helps a lot. It’s not perfect, but it’s better than getting blocked every 5 minutes.
Also, using residential proxies helps a lot. It’s not perfect, but it’s better than getting blocked every 5 minutes.