Hey! I’ve been in the same boat trying to scrape twitter data for my research. I ended up using a combo of Tweepy and a headless browser like Puppeteer. It’s a bit technical, but it lets you bypass some of Twitter’s restrictions.
Also, if you’re scraping at scale, consider using a service like Scrapy. It’s a web scraping framework that works well with Twitter, and you can integrate proxies to avoid bans.
One thing to keep in mind: always respect Twitter’s terms of service. Getting banned is not fun.
Also, if you’re scraping at scale, consider using a service like Scrapy. It’s a web scraping framework that works well with Twitter, and you can integrate proxies to avoid bans.
One thing to keep in mind: always respect Twitter’s terms of service. Getting banned is not fun.