Wow, thanks for all the advice, everyone! I didn’t expect so many responses.
I think I’m gonna give scrapping linkedin screaming frog a shot with proxies and a slower crawl speed like a few of you suggested. I’ll also check out Octoparse and PhantomBuster as alternatives—sounds like they might be easier to handle.
Quick question though: anyone have a recommendation for a good proxy service? I’ve seen a few mentioned, but not sure which one to go with.
Thanks again, you guys are awesome!
I think I’m gonna give scrapping linkedin screaming frog a shot with proxies and a slower crawl speed like a few of you suggested. I’ll also check out Octoparse and PhantomBuster as alternatives—sounds like they might be easier to handle.
Quick question though: anyone have a recommendation for a good proxy service? I’ve seen a few mentioned, but not sure which one to go with.
Thanks again, you guys are awesome!