Scrapy’s awesome, but it’s overkill for simple jobs. If you’re just scraping a few pages, stick with requests + BS4.
For big sites though, Scrapy’s built-in features like auto-throttling and retries are lifesavers.
For big sites though, Scrapy’s built-in features like auto-throttling and retries are lifesavers.