If you're dealing with inconsistent files, maybe try a schema validation tool like `Great Expectations`? It lets you define rules for your data (e.g., "this column must exist") and flags violations.
For parsing data in Python, `pydantic` is awesome for validating and cleaning input as you go.
For parsing data in Python, `pydantic` is awesome for validating and cleaning input as you go.
