Yeah, crawling tweets googlechrome has gotten way harder lately. Twitter cracked down on scraping, so most free tools don’t work anymore.
I’ve had some luck with Octoparse—it’s a web scraper that can handle Twitter if you tweak the settings. Not totally free, but they have a trial.
Also, try slowing down your requests. Twitter blocks IPs super fast if you’re too aggressive.
I’ve had some luck with Octoparse—it’s a web scraper that can handle Twitter if you tweak the settings. Not totally free, but they have a trial.
Also, try slowing down your requests. Twitter blocks IPs super fast if you’re too aggressive.
