rririanto/jq_large_remove.sh

Last active March 27, 2022 14:43

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/rririanto/c7c63fcc1fcfcf989279ff5b000e8c32.js"></script>
Save rririanto/c7c63fcc1fcfcf989279ff5b000e8c32 to your computer and use it in GitHub Desktop.

Download ZIP

Using Jq on large json file (10GB), remove one key from json large file

Raw

jq_large_remove.sh

jq -n --stream 'fromstream(inputs|select((length == 2 and .[0][1] == "_id")|not))' users_large.json > users.json

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment