I scrape Amazon for product research. Here’s what works:
- Rotating user agents
- 5-10 second delays between requests
- Honeybadger proxies (they’re cheap and reliable)
It’s slow, but I haven’t been blocked in months. Just don’t get greedy with the request rate.
- Rotating user agents
- 5-10 second delays between requests
- Honeybadger proxies (they’re cheap and reliable)
It’s slow, but I haven’t been blocked in months. Just don’t get greedy with the request rate.
