Scraping Twitter is def a pain these days, ngl. I’ve been using Octoparse for a while now, and it’s been pretty solid for me. It’s not free, but it’s worth it if you’re doing a lot of data scraping.
Twitter’s API changes are brutal tho, so I’ve also been using a combo of DIY Python scripts with BeautifulSoup and Selenium. It’s a bit of a learning curve, but once you get it, it’s super flexible.
If you’re looking for free tools, check out ParseHub. It’s not perfect, but it’s decent for smaller projects.
Twitter’s API changes are brutal tho, so I’ve also been using a combo of DIY Python scripts with BeautifulSoup and Selenium. It’s a bit of a learning curve, but once you get it, it’s super flexible.
If you’re looking for free tools, check out ParseHub. It’s not perfect, but it’s decent for smaller projects.
