Thanks for all the insights, folks! Gonna stick with Crawlee for now and try pairing it with Cheerio like someone suggested.
Also, joined their Discord—already found a workaround for that AJAX issue I was having.
Still curious though: anyone tried Crawlee with distributed scraping? Wondering if it’s worth setting up Kubernetes for it.
Also, joined their Discord—already found a workaround for that AJAX issue I was having.
Still curious though: anyone tried Crawlee with distributed scraping? Wondering if it’s worth setting up Kubernetes for it.
