Try Zyte (formerly Scrapinghub). It’s built on Scrapy but managed for you. Handles JS, scales well, and they deal with anti-bot stuff.
Expensive, but if you’re doing big projects, it’s the best web scraper for avoiding headaches.
For small stuff, just stick with BeautifulSoup and save the cash.
Expensive, but if you’re doing big projects, it’s the best web scraper for avoiding headaches.
For small stuff, just stick with BeautifulSoup and save the cash.
