Wow, thanks for all the suggestions! Scrapy and Puppeteer sound promising, but I’m kinda nervous about the coding part.
Has anyone used Apify or Octoparse for super large projects? Like, millions of pages?
Also, how do you guys handle CAPTCHAs? Do these tools have built-in solutions, or do you need extra stuff?
Appreciate the help!
Has anyone used Apify or Octoparse for super large projects? Like, millions of pages?
Also, how do you guys handle CAPTCHAs? Do these tools have built-in solutions, or do you need extra stuff?
Appreciate the help!
