Wow, thanks for all the suggestions, everyone! I’m definitely gonna check out Octoparse and Apify first—they sound like exactly what I need.
Also, big shoutout to the person who mentioned building their own scraper with Python. I’m not super into coding, but I might give it a shot if the tools don’t work out.
Quick question though: for those using Scrapy or DataMiner, how often do you run into issues with websites blocking the scraper? That’s been my biggest headache so far.
Thanks again, y’all are the best! 🙌
Also, big shoutout to the person who mentioned building their own scraper with Python. I’m not super into coding, but I might give it a shot if the tools don’t work out.
Quick question though: for those using Scrapy or DataMiner, how often do you run into issues with websites blocking the scraper? That’s been my biggest headache so far.
Thanks again, y’all are the best! 🙌