Hey! Web scraping Amazon can definitely be tricky, but it’s doable if you’re careful. I’ve been using Scrapy with rotating proxies, and it’s been a game-changer. Make sure to set a reasonable crawl rate and mimic human behavior with headers.
Also, check out Bright Data—they’ve got some solid proxy solutions that help avoid blocks. And yeah, always respect robots.txt. It’s not just ethical, it’s smart.
Good luck!
Also, check out Bright Data—they’ve got some solid proxy solutions that help avoid blocks. And yeah, always respect robots.txt. It’s not just ethical, it’s smart.
Good luck!