What's the best way to parse HTML/XML with lxml in Python? or How do you handle large XML files effic

14 Replies, 1838 Views

Thanks for all the insights! Definitely gonna check out selectolax and parsel—sounds like they might be worth testing for my use case.

But yeah, after skimming that benchmark repo, lxml python still seems like the safest bet. The XPath support alone is a killer feature.

Quick follow-up: anyone tried combining lxml with multiprocessing for *really* large scrapes? Wondering if it’s worth the hassle.

Messages In This Thread



Users browsing this thread: 1 Guest(s)