Big files? Try `polars` instead of pandas.
`pl.read_csv()` is way faster for reading pd dataframe from local CSVs, and the syntax is similar.
Also handles lazy evaluation, so you can filter/process before loading everything.
Downside? Fewer pandas-like features, but worth it for raw speed.
`pl.read_csv()` is way faster for reading pd dataframe from local CSVs, and the syntax is similar.
Also handles lazy evaluation, so you can filter/process before loading everything.
Downside? Fewer pandas-like features, but worth it for raw speed.
