Ugh, Twitter’s ratelimits are the worst.
I’ve had luck with:
- 20 sec delays
- Rotating IPs *and* user agents every 50 reqs
- Using a VPN + proxy combo (weirdly helps?)
Tools? Octoparse is decent if you want a no-code twitter scraper.
I’ve had luck with:
- 20 sec delays
- Rotating IPs *and* user agents every 50 reqs
- Using a VPN + proxy combo (weirdly helps?)
Tools? Octoparse is decent if you want a no-code twitter scraper.
