Playwright’s worth a shot if you’re starting fresh, but if you’ve already built stuff with selenium scraping, switching might not be worth the hassle.
For speed, try parallelizing your scrapers with something like Scrapy + selenium. It’s a bit of work, but the throughput is insane.
And for CAPTCHAs… honestly, sometimes you just gotta accept defeat and find another data source. Not all sites are scrape-friendly.
For speed, try parallelizing your scrapers with something like Scrapy + selenium. It’s a bit of work, but the throughput is insane.
And for CAPTCHAs… honestly, sometimes you just gotta accept defeat and find another data source. Not all sites are scrape-friendly.