Wait, so if I’m scraping Amazon for prices, do I *need* to crawl?
I thought web scraping vs web crawling was just semantics, but your post made it click.
Used BeautifulSoup for scraping, but Amazon blocks fast. Had to rotate IPs. Pain.
Any tools that handle anti-scraping better?
I thought web scraping vs web crawling was just semantics, but your post made it click.
Used BeautifulSoup for scraping, but Amazon blocks fast. Had to rotate IPs. Pain.
Any tools that handle anti-scraping better?
