Wow, thanks for all the suggestions, everyone! I’ve been trying out Scrapy based on a few of your recommendations, and it’s definitely faster than what I was using before. Still getting the hang of it though.
I also gave Octoparse a shot, and it’s pretty user-friendly, but I think I’ll stick with Scrapy for now.
Quick question—anyone have tips on handling dynamic content with Scrapy? I’m running into some issues with JavaScript-heavy sites. Also, is Bright Data worth the investment for proxies? Thanks again, you guys are awesome! 🍻
I also gave Octoparse a shot, and it’s pretty user-friendly, but I think I’ll stick with Scrapy for now.
Quick question—anyone have tips on handling dynamic content with Scrapy? I’m running into some issues with JavaScript-heavy sites. Also, is Bright Data worth the investment for proxies? Thanks again, you guys are awesome! 🍻
