Skip to content

Instantly share code, notes, and snippets.

View fatherlinux's full-sized avatar

Scott McCarty fatherlinux

View GitHub Profile
@fatherlinux
fatherlinux / gist:18a57d5ccc530218216c
Created February 3, 2016 23:11
Metrics Mangement
== Deploy and Test Cluster Metrics ==
=== Deploy Cluster Metrics ===
Instructions developed from the [https://docs.openshift.org/latest/install_config/cluster_metrics.html Origin Docs]. First enter the project. Then, create the metrics-deployer service account. Then, add the heapster account permissions. Then, set up secrets.
oc new-project openshift-infra
oc project openshift-infra
oc create -f - <<API
apiVersion: v1
kind: ServiceAccount
metadata:
name: metrics-deployer
== Deploy and Test Cluster Metrics ==
=== Deploy Cluster Metrics ===
Instructions developed from the [https://docs.openshift.org/latest/install_config/cluster_metrics.html Origin Docs]. First enter the project. Then, create the metrics-deployer service account. Then, add the heapster account permissions. Then, set up secrets.
oc new-project openshift-infra
oc project openshift-infra
oc create -f - <<API
apiVersion: v1
kind: ServiceAccount
metadata:
name: metrics-deployer
oc get pods
NAME READY STATUS RESTARTS AGE
hawkular-cassandra-1-5vo3g 1/1 Running 0 19m
hawkular-metrics-h48pd 0/1 Error 0 19m
heapster-92gho 0/1 CrashLoopBackOff 6 8m
metrics-deployer-k2s3e 0/1 Completed 0 26m
oc get pods
NAME READY STATUS RESTARTS AGE
hawkular-cassandra-1-xic4v 0/1 Pending 0 1m
hawkular-metrics-8ypo1 0/1 Pending 0 1m
heapster-elu2f 0/1 CrashLoopBackOff 2 1m
metrics-deployer-hlyrj 0/1 Completed 0 2m
oc logs -p heapster-elu2f
Starting Heapster with the following arguments: --source=kubernetes:https://aep-all.dc4.crunchtools.com:8443?useServiceAccount=true&kubeletHttps=true&kubeletPort=10250 --sink=hawkular:https://hawkular-metrics:443?tenant=_system&labelToTenant=pod_namespace&caCert=/hawkular-cert/hawkular-metrics-ca.certificate&user=hawkular&pass=fLoYse1SQKh6mle&filter=label(container_name:^/system.slice.*|^/user.slice) --logtostderr=true --tls_cert=/secrets/heapster.cert --tls_key=/secrets/heapster.key --tls_client_ca=/secrets/heapster.client-ca --allowed_users=system:master-proxy
=== Cleanup Instructions ===
Developed from instructions [https://github.com/openshift/origin-metrics here]. Delete all items
oc delete all --selector=metrics-infra -n openshift-infra
oc delete secrets --selector=metrics-infra -n openshift-infra
oc delete sa --selector=metrics-infra -n openshift-infra
oc delete templates --selector=metrics-infra -n openshift-infra
oc delete sa metrics-deployer -n openshift-infra
oc delete secret metrics-deployer -n openshift-infra
systemctl restart docker
docker rm `docker ps -qa`
=== Deploy Cluster Metrics ===
Instructions developed from the [https://docs.openshift.org/latest/install_config/cluster_metrics.html Origin Docs]. First enter the project. Then, create the metrics-deployer service account. Then, add the heapster account permissions. Then, set up secrets.
oc new-project openshift-infra
oc project openshift-infra
oc create -f - <<API
apiVersion: v1
kind: ServiceAccount
metadata:
name: metrics-deployer
secrets:
export KUBECONFIG=/etc/origin/master/admin.kubeconfig
oc delete namespace test
oc new-project test
oc process -f /root/rails-ex-external/openshift/templates/rails-postgresql.json -v DATABASE_SERVICE_PORT=5432,DATABASE_SERVICE_HOST=192.168.1.245,DATABASE_USER=fred,DATABASE_PASSWORD=johnson | sed -e 's/"port": "5432"/"port": 5432/g' | oc create -f -
[----] E, [2016-01-21T08:45:14.030662 #4273:bcf994] ERROR -- : MIQ(ManageIQ::Providers::Openshift::ContainerManager::Refresher#refresh) EMS: [aep-master.dc2.crunchtools.com], id: [1000000000006] Refresh failed
[----] E, [2016-01-21T08:45:14.031007 #4273:bcf994] ERROR -- : MIQ(ManageIQ::Providers::Openshift::ContainerManager::Refresher#refresh) EMS: [aep-master.dc2.crunchtools.com], id: [1000000000006] Unable to perform refresh for the following targets:
[----] E, [2016-01-21T08:45:14.031119 #4273:bcf994] ERROR -- : MIQ(ManageIQ::Providers::Openshift::ContainerManager::Refresher#refresh) --- ManageIQ::Providers::Openshift::ContainerManager [aep-master.dc2.crunchtools.com] id [1000000000006]
[----] E, [2016-01-21T08:45:19.904989 #4273:bcf994] ERROR -- : MIQ(ManageIQ::Providers::Openshift::ContainerManager::Refresher#refresh) EMS: [aep-master.dc2.crunchtools.com], id: [1000000000006] Refresh failed
[----] E, [2016-01-21T08:45:19.905569 #4273:bcf994] ERROR -- : MIQ(ManageIQ::Providers::Openshift::ContainerManage
oc logs -p metrics-deployer-8fzah
Error from server: Internal error occurred: Pod "metrics-deployer-8fzah" in namespace "openshift-infra": previous terminated container "metrics-deployer" not found
oc logs metrics-deployer-8fzah
+ image_prefix=aep3_beta/
+ image_version=latest
+ master_url=https://aep-master.dc2.crunchtools.com:8443
+ redeploy=false
+ cassandra_nodes=1
+ use_persistent_storage=false
[root@aep-master ~]# cat metrics.yaml
apiVersion: "v1"
kind: "Template"
metadata:
name: metrics-deployer-template
annotations:
description: "Template for deploying the required Metrics integration. Requires cluster-admin 'metrics-deployer' service account and 'metrics-deployer' secret."
tags: "infrastructure"