OP here—wow, didn’t expect so many great suggestions!
Tried `orjson` + `pydantic` based on the comments, and it’s *so* much faster than what I was using. Still getting the hang of `jq`, but it’s already saved me a headache.
Anyone got tips for handling *really* malformed JSON? Like, missing quotes or unescaped chars? `json5` helps, but sometimes it still chokes.
Also, big thanks for the streaming lib recs—had no idea those existed!
Tried `orjson` + `pydantic` based on the comments, and it’s *so* much faster than what I was using. Still getting the hang of `jq`, but it’s already saved me a headache.
Anyone got tips for handling *really* malformed JSON? Like, missing quotes or unescaped chars? `json5` helps, but sometimes it still chokes.
Also, big thanks for the streaming lib recs—had no idea those existed!