Has anyone tried Crawlee for web scraping? How does it compare to other tools? or Is Crawlee the best

18 Replies, 854 Views

Yo, Crawlee’s autoscaling is low-key underrated. Ran it on a cloud cluster for a client, and it handled 10k pages/day without breaking a sweat.

But fair warning: the error messages can be cryptic. Had to tweak the configs for hours once.

For docs, their GitHub wiki has some hidden gems.

Messages In This Thread



Users browsing this thread: 1 Guest(s)