Skip to content

Instantly share code, notes, and snippets.

@m0smith

m0smith/SplitCSVStorm

Created August 5, 2021 16:38
Show Gist options
  • Save m0smith/b9ca62d0d166e1e6868032a3efe21c10 to your computer and use it in GitHub Desktop.
Save m0smith/b9ca62d0d166e1e6868032a3efe21c10 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
SplitCSVStorm
cd ~/annals/storm/
mkdir Storm202{0,1}
cat Storm\ 2020\ Transactions.csv | parallel --header : --pipe -N500000 'cat >Storm2020/Storm2020_{#}.csv'
cat Storm\ 2021\ Transactions.csv | parallel --header : --pipe -N500000 'cat >Storm2021/Storm2021_{#}.csv'
zip -r storm.zip Storm202[01]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment