Same issue here. Scrape failures unknown started happening out of nowhere. I think it’s because of stricter bot detection on some sites.
I’ve been using a tool called ScrapingAnt, and it’s been a lifesaver. They handle all the proxy and headless browser stuff, so you don’t have to worry about it. Also, try adding some random headers to your requests—it can help avoid detection.
I’ve been using a tool called ScrapingAnt, and it’s been a lifesaver. They handle all the proxy and headless browser stuff, so you don’t have to worry about it. Also, try adding some random headers to your requests—it can help avoid detection.