Yo, CSV is slow af for big files.
Try `pd.read_csv(..., usecols=[...])` to only load the columns you need. Saves memory + time.
Also, set `dtypes` manually if you know them—stops pandas from guessing (which is slow).
For Excel, openpyxl is faster than xlrd for newer .xlsx files.
Try `pd.read_csv(..., usecols=[...])` to only load the columns you need. Saves memory + time.
Also, set `dtypes` manually if you know them—stops pandas from guessing (which is slow).
For Excel, openpyxl is faster than xlrd for newer .xlsx files.
