Skip to content

Instantly share code, notes, and snippets.

@YordanGeorgiev

YordanGeorgiev/how-to-parse-spark-cconf-settings-from-zpln-json-conf.sh

Last active November 8, 2018 15:13
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save YordanGeorgiev/06c748723973073e2ea6d7cb75ae5daa to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save YordanGeorgiev/06c748723973073e2ea6d7cb75ae5daa to your computer and use it in GitHub Desktop.
Download ZIP
[how-to parse spark configuration settings from zeppelin json conf] how-to parse spark configuration settings from zeppelin json conf #spark #conf #zeppelin #jq
Raw
how-to-parse-spark-cconf-settings-from-zpln-json-conf.sh
cat interpreter-s3-project_665.json | jq -r '.interpreterSettings[] | objects | select(.name | contains("spark")) | .properties[] | recurse (.children) | "name: \"\(.name)\"; value: \"\(.value)\""' | grep shuffle
# chk: https://programminghistorian.org/en/lessons/json-and-jq#filter-select
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment