What's the Best HTML Parser Python for Web Scraping?

I usually stick to Beautiful Soup for smaller projects, but I'm curious about lxml for handling larger datasets.

Do you think the complexity is worth it for the performance boost?