Skip to content

Instantly share code, notes, and snippets.

@isaacmg

isaacmg/fix_large_file.py

Created August 13, 2018 05:23
Show Gist options
  • Save isaacmg/96150f83a04633cf129192f3d8668e36 to your computer and use it in GitHub Desktop.
Save isaacmg/96150f83a04633cf129192f3d8668e36 to your computer and use it in GitHub Desktop.
Download ZIP
large_file
Raw
fix_large_file.py
for i,chunk in enumerate(pd.read_csv('bigfile.csv', chunksize=500000)):
chunk.to_csv('chunk{}.csv'.format(i))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment