Having trouble with your scrapy setup? Need help getting started? or What’s the best way to handle a

14 Replies, 638 Views

Wow, thanks for all the tips, folks! Definitely gonna try tweaking DOWNLOAD_DELAY and check out ScraperAPI for proxies.

Quick q: Anyone got a favorite middleware for handling 403 errors? I’m getting slammed by those too.

Also, shoutout to the logging tip—totally forgot about that. Gonna dive deeper into the docs tonight. Cheers! 🍻

Messages In This Thread



Users browsing this thread: 1 Guest(s)