+- Proxy Community (https://proxycommunity.com/forum)
+-- Forum: Proxy Types (https://proxycommunity.com/forum/forum-proxy-types)
+--- Forum: Dedicated Proxies - Datacenter Proxies (https://proxycommunity.com/forum/forum-dedicated-proxies-datacenter-proxies)
+--- Thread: Need Help Using Proxy with Scrapy: Best Practices and Common Pitfalls? (/thread-need-help-using-proxy-with-scrapy-best-practices-and-common-pitfalls)
Pages:
1
2
“” - StealthWebX - 06-03-2025
Hey! Using proxy with scrapy is tricky, but here’s my two cents:
I use Scrapy-Proxy-Rotation middleware. It’s easy to set up and works like a charm.
For proxies, I recommend NetNut. They’re a bit pricey, but their residential proxies are worth it.
Also, make sure you’re not overloading the site. Use a delay of at least 2-3 seconds between requests.
Good luck, and let us know how it goes!