Yo, Crawlee’s autoscaling is low-key underrated. Ran it on a cloud cluster for a client, and it handled 10k pages/day without breaking a sweat.
But fair warning: the error messages can be cryptic. Had to tweak the configs for hours once.
For docs, their GitHub wiki has some hidden gems.
But fair warning: the error messages can be cryptic. Had to tweak the configs for hours once.
For docs, their GitHub wiki has some hidden gems.
