Skip to content

Instantly share code, notes, and snippets.

@salma71

salma71/intuitive_read

Created February 8, 2021 13:59
Show Gist options
  • Save salma71/3dbd7eb6429341357e6795302353bdf7 to your computer and use it in GitHub Desktop.
Save salma71/3dbd7eb6429341357e6795302353bdf7 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
intuitive_read
import pandas as pd
chunksize = 10 ** 8
for chunk in pd.read_csv(filename, chunksize=chunksize):
process(chunk)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment