Having trouble with your scrapy setup? Need help getting started? or What’s the best way to handle a

Yo! For timing out, def check your middleware settings. ThrottleAutoMiddleware + AutoThrottle extension saved my scrapy setup.

Proxies? I use free ones from https://free-proxy-list.net/ but they’re hit or miss. Paid ones are worth it if you’re serious.

And hey, if you’re stuck, the scrapy subreddit is lowkey helpful.