Honestly, SiteCrawler’s not the best for dynamic content. It’s fast for static sites, but for JS, you’re better off with something like Apify.
Apify’s actors can mimic real user behavior, so it grabs everything, even lazy-loaded content. SiteCrawler’s cheaper, but you get what you pay for.
Apify’s actors can mimic real user behavior, so it grabs everything, even lazy-loaded content. SiteCrawler’s cheaper, but you get what you pay for.