What's the Best Way to Parse Data Efficiently? or How Do You Parse Data Without Losing Important Deta

14 Replies, 1359 Views

Wow, thanks for all the suggestions!

I tried pandas with `error_bad_lines=False` and it worked way better. Still hit a snag with encoding though—turns out my file was Windows-1252 (who even uses that??).

Gonna test out `OpenRefine` and `csvkit` next.

Quick Q: Anyone know how to handle escaped quotes in CSV? My data has stuff like `"hello \"world\""` and it’s breaking everything.

Appreciate the help!

Messages In This Thread



Users browsing this thread: 1 Guest(s)