Hey! I feel your pain with scraping twitter data. It’s such a headache sometimes. I’ve been using Snscrape for a while now, and it’s been a lifesaver for scraping twitter at scale. No API limits, and it’s pretty fast.
For handling rate limits, I’ve been rotating proxies with Bright Data. It’s a bit pricey, but worth it if you’re scraping twitter data regularly. Also, don’t forget to randomize user agents—it helps a ton with avoiding bans.
If you’re looking for something more GUI-based, maybe check out ParseHub. It’s not perfect, but it’s decent for smaller projects.
For handling rate limits, I’ve been rotating proxies with Bright Data. It’s a bit pricey, but worth it if you’re scraping twitter data regularly. Also, don’t forget to randomize user agents—it helps a ton with avoiding bans.
If you’re looking for something more GUI-based, maybe check out ParseHub. It’s not perfect, but it’s decent for smaller projects.