Last active
May 19, 2021 03:04
-
-
Save BobyMCbobs/1e06d794157a4a504f20df35bb3d6d6d to your computer and use it in GitHub Desktop.
k8s-infra-image-tag-hash-map
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| addon-builder | am-i-a-manifest-list/amd64 | da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e | |
|---|---|---|---|
| addon-builder | latest/20180730/amd64 | 86e19e068cdfb7d5b60335d7ed6ba26571892a28ca79391e2f5c1bac1797221e | |
| addon-builder | latest/amd64 | ae70aaac32f04914947cfbc62f03d6a0772e5f496ab2d8f8fb4c487bac4545a3 | |
| addon-builder | test/amd64 | 50e71a9a26a6488680202499bc72fb31dfa1d69fe2bfb3ac6aa3bc437c9e30d9 | |
| addon-manager/kube-addon-manager-amd64 | v9.1.2/amd64 | fd8c717ac0da29bc6386a8406c74559449e1bf658175e358a3b2710088a08868 | |
| addon-manager/kube-addon-manager-amd64 | v9.1.4/amd64 | 645f6420f62fcfd40c28110cf458a970f0031cd9b477d20ff148e874a65dc0bc | |
| addon-manager/kube-addon-manager-amd64 | v9.1.5/amd64 | 12afe8af2fdbbc46e9cd83f161309c9214110fa9d81503b64fb57928f2216b46 | |
| addon-manager/kube-addon-manager-arm64 | v9.1.2/amd64 | f1784c76b6b1dc2e7601ff6466ddb26f88df0f8675ae8a91f8fbc74e4f2166f4 | |
| addon-manager/kube-addon-manager-arm64 | v9.1.4/amd64 | 06dd560d8b6e45a9be7943f4172acc8c465b7f334ed9954f7efc358e19458343 | |
| addon-manager/kube-addon-manager-arm64 | v9.1.5/amd64 | 07c6c220114ef26b17942363b1b8828e2739b27096db541b1ef721b2c1d11607 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # load-to-bq.sh | |
| # loads the tags from https://github.com/kubernetes/k8s.io/pull/2044 into a BQ table | |
| # for use in join on usage (the k8s.gcr.io real logs table) | |
| # the output to the data is currently stored in gs://ii_bq_scratch_dump/image-tag-hash.csv | |
| cd ~/kubernetes/k8s.io/metrics/access-logs/poc-layer-mapper/tags | |
| # takes some time | |
| for FILENAME in *; do | |
| FILENAME_CLEAN=$(echo $FILENAME | sed 's/_/\//g') | |
| IMAGE=$(echo $FILENAME_CLEAN | cut -d ':' -f1) | |
| TAG=$(echo $FILENAME_CLEAN | cut -d ':' -f2) | |
| echo "image,tag,hash" > /tmp/image-tag-hash.csv | |
| cat $FILENAME | jq -r '(.config.digest |= split(":")[1]) | [$ARGS.named["image"], $ARGS.named["tag"], .config.digest] | @csv' --arg image "$IMAGE" --arg tag "$TAG" | tee -a /tmp/image-tag-hash.csv | |
| done | |
| gsutil cp /tmp/image-tag-hash.csv gs://ii_bq_scratch_dump/image-tag-hash.csv | |
| bq load --autodetect --source_format=CSV k8s_artifacts_gcslogs_appspot.image_tag_hash gs://ii_bq_scratch_dump/image-tag-hash.csv image:string,tag:string,hash:string |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment