Thanks so much for all the suggestions, everyone! I tried switching to a VPN like some of you mentioned, and it actually helped a ton. The screaming frog connection timed out errors are way less frequent now.
I also broke the crawl into smaller chunks, which made it more manageable. Still running into a few hiccups, but it’s way better than before.
Quick question though—has anyone tried using proxies with Screaming Frog? I’m curious if it’s worth investing in a proxy service for this. Thanks again!
I also broke the crawl into smaller chunks, which made it more manageable. Still running into a few hiccups, but it’s way better than before.
Quick question though—has anyone tried using proxies with Screaming Frog? I’m curious if it’s worth investing in a proxy service for this. Thanks again!