Ugh, screaming frog connection timed out errors are the worst. I feel your pain!
One thing I’d suggest is checking the server logs of the site you’re crawling. Sometimes the server is just overloaded or has strict rate limits. If you have access to the server, you can tweak those settings.
If not, try breaking the crawl into smaller chunks. Like, crawl specific directories instead of the whole site at once. It’s slower but way less frustrating.
One thing I’d suggest is checking the server logs of the site you’re crawling. Sometimes the server is just overloaded or has strict rate limits. If you have access to the server, you can tweak those settings.
If not, try breaking the crawl into smaller chunks. Like, crawl specific directories instead of the whole site at once. It’s slower but way less frustrating.