Wow, thanks for all the suggestions! Scrapy and Selenium sound like the top contenders for what I need.
Quick follow-up: anyone have experience with Proxies for Scrapy? I’ve heard some sites block scrapers fast, and I don’t wanna get IP-banned mid-project.
Also, ParseHub looks interesting for quick jobs—might give that a spin too. Appreciate the help!
Quick follow-up: anyone have experience with Proxies for Scrapy? I’ve heard some sites block scrapers fast, and I don’t wanna get IP-banned mid-project.
Also, ParseHub looks interesting for quick jobs—might give that a spin too. Appreciate the help!
