Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save jayunit100/339cfe3e06d3bfc3cc45c39ac88535b7 to your computer and use it in GitHub Desktop.
Save jayunit100/339cfe3e06d3bfc3cc45c39ac88535b7 to your computer and use it in GitHub Desktop.
Logging kubelet events for node kubernetes-minion-u92b
Apr 4 09:55:59.369: INFO:
Logging pods the kubelet thinks is on node kubernetes-minion-u92b
Apr 4 09:55:59.479: INFO: monitoring-influxdb-grafana-v3-cbfy6 started at 2016-04-04 08:52:19 -0400 EDT (2 container statuses recorded)
Apr 4 09:55:59.479: INFO: Container grafana ready: true, restart count 0
Apr 4 09:55:59.479: INFO: Container influxdb ready: true, restart count 0
Apr 4 09:55:59.479: INFO: kube-dns-v11-fdc4r started at 2016-04-04 08:52:19 -0400 EDT (4 container statuses recorded)
Apr 4 09:55:59.479: INFO: Container etcd ready: true, restart count 0
Apr 4 09:55:59.479: INFO: Container healthz ready: true, restart count 0
Apr 4 09:55:59.479: INFO: Container kube2sky ready: true, restart count 0
Apr 4 09:55:59.479: INFO: Container skydns ready: true, restart count 0
Apr 4 09:55:59.479: INFO: fluentd-cloud-logging-kubernetes-minion-u92b started at <nil> (0 container statuses recorded)
Apr 4 09:55:59.479: INFO: kube-proxy-kubernetes-minion-u92b started at <nil> (0 container statuses recorded)
Apr 4 09:55:59.479: INFO: l7-lb-controller-v0.6.0-uq2bw started at 2016-04-04 08:52:19 -0400 EDT (2 container statuses recorded)
Apr 4 09:55:59.479: INFO: Container default-http-backend ready: true, restart count 0
Apr 4 09:55:59.479: INFO: Container l7-lb-controller ready: true, restart count 1
Apr 4 09:55:59.714: INFO: ERROR kubelet_docker_errors{operation_type="info"} => 1 @[0]
Apr 4 09:55:59.714: INFO: ERROR kubelet_docker_errors{operation_type="inspect_image"} => 11 @[0]
Apr 4 09:55:59.714: INFO: ERROR kubelet_docker_errors{operation_type="list_containers"} => 32 @[0]
Apr 4 09:55:59.714: INFO: ERROR kubelet_docker_errors{operation_type="list_images"} => 10 @[0]
Apr 4 09:55:59.714: INFO: ERROR kubelet_docker_errors{operation_type="version"} => 16 @[0]
Apr 4 09:55:59.714: INFO:
Latency metrics for node kubernetes-minion-u92b
Apr 4 09:55:59.714: INFO:
Logging node info for node kubernetes-minion-yttk
Apr 4 09:55:59.769: INFO: Node Info: &{{ } {kubernetes-minion-yttk /api/v1/nodes/kubernetes-minion-yttk 06a1baec-fa64-11e5-a894-42010af00003 2243 0 2016-04-04 08:52:01 -0400 EDT <nil> <nil> map[kubernetes.io/hostname:kubernetes-minion-yttk beta.kubernetes.io/instance-type:n1-standard-2 failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-b] map[]} {10.244.3.0/24 6304096460429319660 gce://kube-dev-jay/us-central1-b/kubernetes-minion-yttk false} {map[cpu:{2.000 DecimalSI} memory:{7864135680.000 BinarySI} pods:{110.000 DecimalSI}] map[pods:{110.000 DecimalSI} cpu:{2.000 DecimalSI} memory:{7864135680.000 BinarySI}] [{OutOfDisk False 2016-04-04 09:55:52 -0400 EDT 2016-04-04 08:52:01 -0400 EDT KubeletHasSufficientDisk kubelet has sufficient disk space available} {Ready True 2016-04-04 09:55:52 -0400 EDT 2016-04-04 08:52:48 -0400 EDT KubeletReady kubelet is posting ready status. WARNING: CPU hardcapping unsupported}] [{InternalIP 10.240.0.7} {ExternalIP 104.197.125.20}] {{10250}} { B6937010-4661-B189-9104-0EBDE4DFE9B2 e1f31001-0440-4f97-a2e5-db168e53a6f1 3.16.0-4-amd64 Debian GNU/Linux 7 (wheezy) docker://1.9.1 v1.3.0-alpha.0.573+caaaed2e2bfcfd-dirty v1.3.0-alpha.0.573+caaaed2e2bfcfd-dirty} [{[gcr.io/google_containers/kube-proxy:f96d46946de3188c38adef424ca88bc6] 165880697} {[gcr.io/google_containers/fluentd-gcp:1.18] 411450900} {[gcr.io/google_containers/pause:2.0] 350164} {[gcr.io/google_samples/gb-frontend:v3] 509707703} {[gcr.io/google_samples/gb-redisslave:v1] 109508753} {[gcr.io/google_containers/pause:0.8.0] 241656} {[gcr.io/google_containers/redis:e2e] 419003740}]}}
Apr 4 09:55:59.769: INFO:
Logging kubelet events for node kubernetes-minion-yttk
Apr 4 09:55:59.820: INFO:
Logging pods the kubelet thinks is on node kubernetes-minion-yttk
Apr 4 09:55:59.935: INFO: fluentd-cloud-logging-kubernetes-minion-yttk started at <nil> (0 container statuses recorded)
Apr 4 09:55:59.935: INFO: kube-proxy-kubernetes-minion-yttk started at <nil> (0 container statuses recorded)
Apr 4 09:55:59.935: INFO: redis-master-yxmpb started at 2016-04-04 09:55:56 -0400 EDT (1 container statuses recorded)
Apr 4 09:55:59.935: INFO: Container redis-master ready: false, restart count 0
Apr 4 09:56:00.095: INFO: ERROR kubelet_docker_errors{operation_type="info"} => 1 @[0]
Apr 4 09:56:00.095: INFO: ERROR kubelet_docker_errors{operation_type="inspect_image"} => 8 @[0]
Apr 4 09:56:00.095: INFO: ERROR kubelet_docker_errors{operation_type="list_containers"} => 32 @[0]
Apr 4 09:56:00.095: INFO: ERROR kubelet_docker_errors{operation_type="list_images"} => 6 @[0]
Apr 4 09:56:00.095: INFO: ERROR kubelet_docker_errors{operation_type="version"} => 12 @[0]
Apr 4 09:56:00.095: INFO:
Latency metrics for node kubernetes-minion-yttk
Apr 4 09:56:00.095: INFO: Waiting up to 1m0s for all nodes to be ready
STEP: Destroying namespace "e2e-tests-kubectl-3f9f7" for this suite.
• Failure [24.631 seconds]
[k8s.io] Kubectl client
/Users/jayunit100/Development/gopath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework.go:421
[k8s.io] Kubectl describe
/Users/jayunit100/Development/gopath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework.go:421
should check if kubectl describe prints relevant information for rc and pods [Conformance] [It]
/Users/jayunit100/Development/gopath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/kubectl.go:680
Apr 4 09:55:58.171: Failed to find 1 Running in Pods Status: 0 Running / 1 Waiting / 0 Succeeded / 0 Failed
/Users/jayunit100/Development/gopath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/kubectl.go:1170
------------------------------
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
Summarizing 1 Failure:
[Fail] [k8s.io] Kubectl client [k8s.io] Kubectl describe [It] should check if kubectl describe prints relevant information for rc and pods [Conformance]
/Users/jayunit100/Development/gopath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/kubectl.go:1170
Ran 1 of 268 Specs in 25.019 seconds
FAIL! -- 0 Passed | 1 Failed | 0 Pending | 267 Skipped --- FAIL: TestE2E (25.03s)
FAIL
➜ kubernetes git:(ClusterVerificationFramework) ✗ git show
➜ kubernetes git:(ClusterVerificationFramework) ✗ git show
➜ kubernetes git:(ClusterVerificationFramework) ✗ hack/build-go.sh test/e2e/e2e.test
Go version: go version go1.5.1 darwin/amd64
+++ [0404 10:11:33] Building go targets for darwin/amd64:
test/e2e/e2e.test
+++ [0404 10:12:11] Placing binaries
➜ kubernetes git:(ClusterVerificationFramework) ✗ _output/local/bin/darwin/amd64/e2e.test --kubeconfig=/Users/jayunit100/.kube/config --repo-root=./ --ginkgo.focus="should check if kubectl describe prints relevant information for rc and pods" --kubectl-path=./cluster/kubectl.sh
I0404 10:12:36.334603 30057 e2e.go:103] The --provider flag is not set. Treating as a conformance test. Some tests may not be run.
I0404 10:12:36.334710 30057 e2e.go:275] Starting e2e run "47d4f347-fa6f-11e5-b7f9-acbc329f948d" on Ginkgo node 1
Running Suite: Kubernetes e2e suite
===================================
Random Seed: 1459779155 - Will randomize all specs
Will run 1 of 268 specs
Apr 4 10:12:36.348: INFO: >>> testContext.KubeConfig: /Users/jayunit100/.kube/config
Apr 4 10:12:36.351: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'kube-system' to be running and ready
Apr 4 10:12:36.710: INFO: 17 / 17 pods in namespace 'kube-system' are running and ready (0 seconds elapsed)
Apr 4 10:12:36.710: INFO: expected 5 pod replicas in namespace 'kube-system', 5 are Running and Ready.
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[k8s.io] Kubectl client [k8s.io] Kubectl describe
should check if kubectl describe prints relevant information for rc and pods [Conformance]
/Users/jayunit100/Development/gopath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/kubectl.go:680
[BeforeEach] [k8s.io] Kubectl client
/Users/jayunit100/Development/gopath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework.go:102
STEP: Creating a kubernetes client
Apr 4 10:12:36.710: INFO: >>> testContext.KubeConfig: /Users/jayunit100/.kube/config
STEP: Building a namespace api object
Apr 4 10:12:36.767: INFO: Waiting up to 2m0s for service account default to be provisioned in ns e2e-tests-kubectl-3oijk
Apr 4 10:12:36.823: INFO: Service account default in ns e2e-tests-kubectl-3oijk with secrets found. (55.496764ms)
STEP: Waiting for a default service account to be provisioned in namespace
Apr 4 10:12:36.823: INFO: Waiting up to 2m0s for service account default to be provisioned in ns e2e-tests-kubectl-3oijk
Apr 4 10:12:36.872: INFO: Service account default in ns e2e-tests-kubectl-3oijk with secrets found. (49.263621ms)
[BeforeEach] [k8s.io] Kubectl client
/Users/jayunit100/Development/gopath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/kubectl.go:130
[It] should check if kubectl describe prints relevant information for rc and pods [Conformance]
/Users/jayunit100/Development/gopath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/kubectl.go:680
Apr 4 10:12:36.924: INFO: Running './cluster/kubectl.sh --kubeconfig=/Users/jayunit100/.kube/config create -f examples/guestbook-go/redis-master-controller.json --namespace=e2e-tests-kubectl-3oijk'
Apr 4 10:12:37.649: INFO: stderr: ""
Apr 4 10:12:37.649: INFO: stdout: "replicationcontroller \"redis-master\" created"
Apr 4 10:12:37.649: INFO: Running './cluster/kubectl.sh --kubeconfig=/Users/jayunit100/.kube/config create -f examples/guestbook-go/redis-master-service.json --namespace=e2e-tests-kubectl-3oijk'
Apr 4 10:12:38.249: INFO: stderr: ""
Apr 4 10:12:38.249: INFO: stdout: "service \"redis-master\" created"
Apr 4 10:12:38.333: INFO: Selector matched 1 pods for map[app:redis]=%!v(MISSING)
Apr 4 10:12:38.333: INFO: pod redis-master-q94nv state, name, verified false, true, true
Apr 4 10:12:38.333: INFO: Found 0 pods from the filter. Now runnning looping through them.
Apr 4 10:12:38.333: INFO: Running './cluster/kubectl.sh --kubeconfig=/Users/jayunit100/.kube/config describe rc redis-master --namespace=e2e-tests-kubectl-3oijk'
Apr 4 10:12:39.009: INFO: stderr: ""
Apr 4 10:12:39.009: INFO: stdout: "Name:\t\tredis-master\nNamespace:\te2e-tests-kubectl-3oijk\nImage(s):\tredis\nSelector:\tapp=redis,role=master\nLabels:\t\tapp=redis,role=master\nReplicas:\t1 current / 1 desired\nPods Status:\t0 Running / 1 Waiting / 0 Succeeded / 0 Failed\nNo volumes.\nEvents:\n FirstSeen\tLastSeen\tCount\tFrom\t\t\t\tSubobjectPath\tType\t\tReason\t\t\tMessage\n ---------\t--------\t-----\t----\t\t\t\t-------------\t--------\t------\t\t\t-------\n 2s\t\t2s\t\t1\t{replication-controller }\t\t\tNormal\t\tSuccessfulCreate\tCreated pod: redis-master-q94nv"
Apr 4 10:12:39.009: FAIL: Failed to find 1 Running in Pods Status: 0 Running / 1 Waiting / 0 Succeeded / 0 Failed
[AfterEach] [k8s.io] Kubectl client
/Users/jayunit100/Development/gopath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework.go:103
STEP: Collecting events from namespace "e2e-tests-kubectl-3oijk".
Apr 4 10:12:39.109: INFO: At 2016-04-04 10:12:37 -0400 EDT - event for redis-master: {replication-controller } SuccessfulCreate: Created pod: redis-master-q94nv
Apr 4 10:12:39.109: INFO: At 2016-04-04 10:12:37 -0400 EDT - event for redis-master-q94nv: {default-scheduler } Scheduled: Successfully assigned redis-master-q94nv to kubernetes-minion-yttk
Apr 4 10:12:39.109: INFO: At 2016-04-04 10:12:38 -0400 EDT - event for redis-master-q94nv: {kubelet kubernetes-minion-yttk} Pulling: pulling image "redis"
Apr 4 10:12:39.109: INFO: At 2016-04-04 10:12:38 -0400 EDT - event for redis-master-q94nv: {kubelet kubernetes-minion-yttk} Pulled: Successfully pulled image "redis"
Apr 4 10:12:39.109: INFO: At 2016-04-04 10:12:38 -0400 EDT - event for redis-master-q94nv: {kubelet kubernetes-minion-yttk} Created: Created container with docker id 97196c049418
Apr 4 10:12:39.109: INFO: At 2016-04-04 10:12:38 -0400 EDT - event for redis-master-q94nv: {kubelet kubernetes-minion-yttk} Started: Started container with docker id 97196c049418
Apr 4 10:12:39.270: INFO: POD NODE PHASE GRACE CONDITIONS
Apr 4 10:12:39.270: INFO: redis-master-q94nv kubernetes-minion-yttk Pending [{Ready False 0001-01-01 00:00:00 +0000 UTC 2016-04-04 10:12:37 -0400 EDT ContainersNotReady containers with unready status: [redis-master]}]
Apr 4 10:12:39.270: INFO: etcd-server-events-kubernetes-master kubernetes-master Running [{Ready True 0001-01-01 00:00:00 +0000 UTC 2016-04-04 08:51:06 -0400 EDT }]
Apr 4 10:12:39.270: INFO: etcd-server-kubernetes-master kubernetes-master Running [{Ready True 0001-01-01 00:00:00 +0000 UTC 2016-04-04 08:51:06 -0400 EDT }]
Apr 4 10:12:39.270: INFO: fluentd-cloud-logging-kubernetes-master kubernetes-master Running [{Ready True 0001-01-01 00:00:00 +0000 UTC 2016-04-04 08:51:33 -0400 EDT }]
Apr 4 10:12:39.270: INFO: fluentd-cloud-logging-kubernetes-minion-tfbw kubernetes-minion-tfbw Running [{Ready True 0001-01-01 00:00:00 +0000 UTC 2016-04-04 08:52:30 -0400 EDT }]
Apr 4 10:12:39.270: INFO: fluentd-cloud-logging-kubernetes-minion-u92b kubernetes-minion-u92b Running [{Ready True 0001-01-01 00:00:00 +0000 UTC 2016-04-04 08:52:30 -0400 EDT }]
Apr 4 10:12:39.270: INFO: fluentd-cloud-logging-kubernetes-minion-yttk kubernetes-minion-yttk Running [{Ready True 0001-01-01 00:00:00 +0000 UTC 2016-04-04 08:53:11 -0400 EDT }]
Apr 4 10:12:39.270: INFO: heapster-v1.0.0-0wlul kubernetes-minion-tfbw Running [{Ready True 0001-01-01 00:00:00 +0000 UTC 2016-04-04 08:52:35 -0400 EDT }]
Apr 4 10:12:39.270: INFO: kube-apiserver-kubernetes-master kubernetes-master Running [{Ready True 0001-01-01 00:00:00 +0000 UTC 2016-04-04 08:51:34 -0400 EDT }]
Apr 4 10:12:39.270: INFO: kube-controller-manager-kubernetes-master kubernetes-master Running [{Ready True 0001-01-01 00:00:00 +0000 UTC 2016-04-04 08:53:06 -0400 EDT }]
Apr 4 10:12:39.270: INFO: kube-dns-v11-fdc4r kubernetes-minion-u92b Running [{Ready True 0001-01-01 00:00:00 +0000 UTC 2016-04-04 08:53:29 -0400 EDT }]
Apr 4 10:12:39.270: INFO: kube-proxy-kubernetes-minion-tfbw kubernetes-minion-tfbw Running [{Ready True 0001-01-01 00:00:00 +0000 UTC 2016-04-04 08:52:13 -0400 EDT }]
Apr 4 10:12:39.270: INFO: kube-proxy-kubernetes-minion-u92b kubernetes-minion-u92b Running [{Ready True 0001-01-01 00:00:00 +0000 UTC 2016-04-04 08:52:12 -0400 EDT }]
Apr 4 10:12:39.270: INFO: kube-proxy-kubernetes-minion-yttk kubernetes-minion-yttk Running [{Ready True 0001-01-01 00:00:00 +0000 UTC 2016-04-04 08:52:49 -0400 EDT }]
Apr 4 10:12:39.270: INFO: kube-scheduler-kubernetes-master kubernetes-master Running [{Ready True 0001-01-01 00:00:00 +0000 UTC 2016-04-04 08:51:48 -0400 EDT }]
Apr 4 10:12:39.271: INFO: kubernetes-dashboard-v1.0.0-oldss kubernetes-minion-tfbw Running [{Ready True 0001-01-01 00:00:00 +0000 UTC 2016-04-04 08:52:36 -0400 EDT }]
Apr 4 10:12:39.271: INFO: l7-lb-controller-v0.6.0-uq2bw kubernetes-minion-u92b Running [{Ready True 0001-01-01 00:00:00 +0000 UTC 2016-04-04 08:52:54 -0400 EDT }]
Apr 4 10:12:39.271: INFO: monitoring-influxdb-grafana-v3-cbfy6 kubernetes-minion-u92b Running [{Ready True 0001-01-01 00:00:00 +0000 UTC 2016-04-04 08:53:05 -0400 EDT }]
Apr 4 10:12:39.271: INFO:
Apr 4 10:12:39.328: INFO:
Logging node info for node kubernetes-master
Apr 4 10:12:39.381: INFO: Node Info: &{{ } {kubernetes-master /api/v1/nodes/kubernetes-master f8d2d54a-fa63-11e5-a894-42010af00003 2672 0 2016-04-04 08:51:38 -0400 EDT <nil> <nil> map[failure-domain.beta.kubernetes.io/zone:us-central1-b kubernetes.io/hostname:kubernetes-master beta.kubernetes.io/instance-type:n1-standard-1 failure-domain.beta.kubernetes.io/region:us-central1] map[]} {10.244.0.0/24 792372132132674596 gce://kube-dev-jay/us-central1-b/kubernetes-master true} {map[cpu:{1.000 DecimalSI} memory:{3892244480.000 BinarySI} pods:{110.000 DecimalSI}] map[cpu:{1.000 DecimalSI} memory:{3892244480.000 BinarySI} pods:{110.000 DecimalSI}] [{OutOfDisk False 2016-04-04 10:12:36 -0400 EDT 2016-04-04 08:51:38 -0400 EDT KubeletHasSufficientDisk kubelet has sufficient disk space available} {Ready True 2016-04-04 10:12:36 -0400 EDT 2016-04-04 08:51:38 -0400 EDT KubeletReady kubelet is posting ready status. WARNING: CPU hardcapping unsupported}] [{InternalIP 10.240.0.3} {ExternalIP 146.148.100.74}] {{10250}} { D037055C-8935-CE3F-4292-86D122C59E6C a8c3b1db-3d60-46a7-9845-a3b659b92c58 3.16.0-4-amd64 Debian GNU/Linux 7 (wheezy) docker://1.9.1 v1.3.0-alpha.0.573+caaaed2e2bfcfd-dirty v1.3.0-alpha.0.573+caaaed2e2bfcfd-dirty} [{[gcr.io/google_containers/kube-apiserver:d84c035b5debd6c187317453284bbab2] 62322114} {[gcr.io/google_containers/kube-scheduler:c87458352afbbce5a7b744376f2140f3] 45172282} {[gcr.io/google_containers/kube-controller-manager:83c4fc5961dfc5262801e118315a71d2] 55420610} {[gcr.io/google_containers/fluentd-gcp:1.18] 411450900} {[gcr.io/google_containers/etcd:2.2.1] 28191895} {[gcr.io/google_containers/pause:2.0] 350164} {[gcr.io/google_containers/kube-registry-proxy:0.3] 151228508} {[gcr.io/google_containers/pause:0.8.0] 241656}]}}
Apr 4 10:12:39.381: INFO:
Logging kubelet events for node kubernetes-master
Apr 4 10:12:39.435: INFO:
Logging pods the kubelet thinks is on node kubernetes-master
Apr 4 10:12:39.559: INFO: fluentd-cloud-logging-kubernetes-master started at <nil> (0 container statuses recorded)
Apr 4 10:12:39.559: INFO: kube-apiserver-kubernetes-master started at <nil> (0 container statuses recorded)
Apr 4 10:12:39.559: INFO: kube-controller-manager-kubernetes-master started at <nil> (0 container statuses recorded)
Apr 4 10:12:39.559: INFO: kube-scheduler-kubernetes-master started at <nil> (0 container statuses recorded)
Apr 4 10:12:39.559: INFO: etcd-server-events-kubernetes-master started at <nil> (0 container statuses recorded)
Apr 4 10:12:39.559: INFO: etcd-server-kubernetes-master started at <nil> (0 container statuses recorded)
Apr 4 10:12:39.757: INFO: ERROR kubelet_docker_errors{operation_type="inspect_image"} => 8 @[0]
Apr 4 10:12:39.757: INFO: ERROR kubelet_docker_errors{operation_type="pull_image"} => 4 @[0]
Apr 4 10:12:39.757: INFO:
Latency metrics for node kubernetes-master
Apr 4 10:12:39.757: INFO:
Logging node info for node kubernetes-minion-tfbw
Apr 4 10:12:39.807: INFO: Node Info: &{{ } {kubernetes-minion-tfbw /api/v1/nodes/kubernetes-minion-tfbw f7f73361-fa63-11e5-a894-42010af00003 2671 0 2016-04-04 08:51:37 -0400 EDT <nil> <nil> map[beta.kubernetes.io/instance-type:n1-standard-2 failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-b kubernetes.io/hostname:kubernetes-minion-tfbw] map[]} {10.244.1.0/24 4344437749532581356 gce://kube-dev-jay/us-central1-b/kubernetes-minion-tfbw false} {map[cpu:{2.000 DecimalSI} memory:{7864135680.000 BinarySI} pods:{110.000 DecimalSI}] map[memory:{7864135680.000 BinarySI} pods:{110.000 DecimalSI} cpu:{2.000 DecimalSI}] [{OutOfDisk False 2016-04-04 10:12:31 -0400 EDT 2016-04-04 08:51:37 -0400 EDT KubeletHasSufficientDisk kubelet has sufficient disk space available} {Ready True 2016-04-04 10:12:31 -0400 EDT 2016-04-04 08:52:07 -0400 EDT KubeletReady kubelet is posting ready status. WARNING: CPU hardcapping unsupported}] [{InternalIP 10.240.0.6} {ExternalIP 173.255.115.203}] {{10250}} { D4101DEF-E099-06AA-70A6-B22D103D617C 50045df3-f0f0-41e9-91e8-4a7ae9b1ea45 3.16.0-4-amd64 Debian GNU/Linux 7 (wheezy) docker://1.9.1 v1.3.0-alpha.0.573+caaaed2e2bfcfd-dirty v1.3.0-alpha.0.573+caaaed2e2bfcfd-dirty} [{[gcr.io/google_containers/kube-proxy:f96d46946de3188c38adef424ca88bc6] 165880697} {[gcr.io/google_containers/heapster:v1.0.0] 96204288} {[gcr.io/google_containers/kubernetes-dashboard-amd64:v1.0.0] 40688848} {[gcr.io/google_containers/fluentd-gcp:1.18] 411450900} {[gcr.io/google_containers/pause:2.0] 350164} {[gcr.io/google_samples/gb-frontend:v3] 509707703} {[gcr.io/google_samples/gb-redisslave:v1] 109508753} {[gcr.io/google_containers/pause:0.8.0] 241656}]}}
Apr 4 10:12:39.808: INFO:
Logging kubelet events for node kubernetes-minion-tfbw
Apr 4 10:12:39.857: INFO:
Logging pods the kubelet thinks is on node kubernetes-minion-tfbw
Apr 4 10:12:39.970: INFO: fluentd-cloud-logging-kubernetes-minion-tfbw started at <nil> (0 container statuses recorded)
Apr 4 10:12:39.970: INFO: kube-proxy-kubernetes-minion-tfbw started at <nil> (0 container statuses recorded)
Apr 4 10:12:39.970: INFO: kubernetes-dashboard-v1.0.0-oldss started at 2016-04-04 08:52:19 -0400 EDT (1 container statuses recorded)
Apr 4 10:12:39.970: INFO: Container kubernetes-dashboard ready: true, restart count 0
Apr 4 10:12:39.970: INFO: heapster-v1.0.0-0wlul started at 2016-04-04 08:52:19 -0400 EDT (2 container statuses recorded)
Apr 4 10:12:39.970: INFO: Container eventer ready: true, restart count 0
Apr 4 10:12:39.970: INFO: Container heapster ready: true, restart count 0
Apr 4 10:12:40.178: INFO: ERROR kubelet_docker_errors{operation_type="info"} => 1 @[0]
Apr 4 10:12:40.178: INFO: ERROR kubelet_docker_errors{operation_type="inspect_image"} => 7 @[0]
Apr 4 10:12:40.178: INFO: ERROR kubelet_docker_errors{operation_type="list_containers"} => 32 @[0]
Apr 4 10:12:40.178: INFO: ERROR kubelet_docker_errors{operation_type="list_images"} => 10 @[0]
Apr 4 10:12:40.178: INFO: ERROR kubelet_docker_errors{operation_type="version"} => 16 @[0]
Apr 4 10:12:40.178: INFO:
Latency metrics for node kubernetes-minion-tfbw
Apr 4 10:12:40.178: INFO:
Logging node info for node kubernetes-minion-u92b
Apr 4 10:12:40.231: INFO: Node Info: &{{ } {kubernetes-minion-u92b /api/v1/nodes/kubernetes-minion-u92b f7fa2423-fa63-11e5-a894-42010af00003 2687 0 2016-04-04 08:51:37 -0400 EDT <nil> <nil> map[beta.kubernetes.io/instance-type:n1-standard-2 failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-b kubernetes.io/hostname:kubernetes-minion-u92b] map[]} {10.244.2.0/24 6548269500145327596 gce://kube-dev-jay/us-central1-b/kubernetes-minion-u92b false} {map[cpu:{2.000 DecimalSI} memory:{7864135680.000 BinarySI} pods:{110.000 DecimalSI}] map[pods:{110.000 DecimalSI} cpu:{2.000 DecimalSI} memory:{7864135680.000 BinarySI}] [{OutOfDisk False 2016-04-04 10:12:38 -0400 EDT 2016-04-04 08:51:37 -0400 EDT KubeletHasSufficientDisk kubelet has sufficient disk space available} {Ready True 2016-04-04 10:12:38 -0400 EDT 2016-04-04 08:52:07 -0400 EDT KubeletReady kubelet is posting ready status. WARNING: CPU hardcapping unsupported}] [{InternalIP 10.240.0.5} {ExternalIP 104.197.215.24}] {{10250}} { 4D881D13-DD57-738D-EFE4-DFCCB1C1D1F7 a0c47d79-0028-488e-b959-e8ce289a8b54 3.16.0-4-amd64 Debian GNU/Linux 7 (wheezy) docker://1.9.1 v1.3.0-alpha.0.573+caaaed2e2bfcfd-dirty v1.3.0-alpha.0.573+caaaed2e2bfcfd-dirty} [{[gcr.io/google_containers/kube-proxy:f96d46946de3188c38adef424ca88bc6] 165880697} {[gcr.io/google_containers/exechealthz:1.0] 7115733} {[gcr.io/google_containers/kube2sky:1.14] 27804037} {[gcr.io/google_containers/fluentd-gcp:1.18] 411450900} {[gcr.io/google_containers/glbc:0.6.0] 229770249} {[gcr.io/google_containers/heapster_grafana:v2.6.0-2] 230092866} {[gcr.io/google_containers/etcd-amd64:2.2.1] 28192476} {[gcr.io/google_containers/defaultbackend:1.0] 7513643} {[gcr.io/google_containers/skydns:2015-10-13-8c72f8c] 40551394} {[gcr.io/google_containers/pause:2.0] 350164} {[gcr.io/google_containers/heapster_influxdb:v0.5] 251005705} {[gcr.io/google_containers/pause:0.8.0] 241656}]}}
Apr 4 10:12:40.231: INFO:
Logging kubelet events for node kubernetes-minion-u92b
Apr 4 10:12:40.281: INFO:
Logging pods the kubelet thinks is on node kubernetes-minion-u92b
Apr 4 10:12:40.393: INFO: fluentd-cloud-logging-kubernetes-minion-u92b started at <nil> (0 container statuses recorded)
Apr 4 10:12:40.393: INFO: kube-proxy-kubernetes-minion-u92b started at <nil> (0 container statuses recorded)
Apr 4 10:12:40.393: INFO: l7-lb-controller-v0.6.0-uq2bw started at 2016-04-04 08:52:19 -0400 EDT (2 container statuses recorded)
Apr 4 10:12:40.393: INFO: Container default-http-backend ready: true, restart count 0
Apr 4 10:12:40.393: INFO: Container l7-lb-controller ready: true, restart count 1
Apr 4 10:12:40.393: INFO: monitoring-influxdb-grafana-v3-cbfy6 started at 2016-04-04 08:52:19 -0400 EDT (2 container statuses recorded)
Apr 4 10:12:40.393: INFO: Container grafana ready: true, restart count 0
Apr 4 10:12:40.393: INFO: Container influxdb ready: true, restart count 0
Apr 4 10:12:40.393: INFO: kube-dns-v11-fdc4r started at 2016-04-04 08:52:19 -0400 EDT (4 container statuses recorded)
Apr 4 10:12:40.393: INFO: Container etcd ready: true, restart count 0
Apr 4 10:12:40.393: INFO: Container healthz ready: true, restart count 0
Apr 4 10:12:40.393: INFO: Container kube2sky ready: true, restart count 0
Apr 4 10:12:40.393: INFO: Container skydns ready: true, restart count 0
Apr 4 10:12:40.589: INFO: ERROR kubelet_docker_errors{operation_type="info"} => 1 @[0]
Apr 4 10:12:40.589: INFO: ERROR kubelet_docker_errors{operation_type="inspect_image"} => 11 @[0]
Apr 4 10:12:40.589: INFO: ERROR kubelet_docker_errors{operation_type="list_containers"} => 32 @[0]
Apr 4 10:12:40.589: INFO: ERROR kubelet_docker_errors{operation_type="list_images"} => 10 @[0]
Apr 4 10:12:40.589: INFO: ERROR kubelet_docker_errors{operation_type="version"} => 16 @[0]
Apr 4 10:12:40.589: INFO:
Latency metrics for node kubernetes-minion-u92b
Apr 4 10:12:40.589: INFO:
Logging node info for node kubernetes-minion-yttk
Apr 4 10:12:40.640: INFO: Node Info: &{{ } {kubernetes-minion-yttk /api/v1/nodes/kubernetes-minion-yttk 06a1baec-fa64-11e5-a894-42010af00003 2677 0 2016-04-04 08:52:01 -0400 EDT <nil> <nil> map[failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-b kubernetes.io/hostname:kubernetes-minion-yttk beta.kubernetes.io/instance-type:n1-standard-2] map[]} {10.244.3.0/24 6304096460429319660 gce://kube-dev-jay/us-central1-b/kubernetes-minion-yttk false} {map[pods:{110.000 DecimalSI} cpu:{2.000 DecimalSI} memory:{7864135680.000 BinarySI}] map[cpu:{2.000 DecimalSI} memory:{7864135680.000 BinarySI} pods:{110.000 DecimalSI}] [{OutOfDisk False 2016-04-04 10:12:37 -0400 EDT 2016-04-04 08:52:01 -0400 EDT KubeletHasSufficientDisk kubelet has sufficient disk space available} {Ready True 2016-04-04 10:12:37 -0400 EDT 2016-04-04 08:52:48 -0400 EDT KubeletReady kubelet is posting ready status. WARNING: CPU hardcapping unsupported}] [{InternalIP 10.240.0.7} {ExternalIP 104.197.125.20}] {{10250}} { B6937010-4661-B189-9104-0EBDE4DFE9B2 e1f31001-0440-4f97-a2e5-db168e53a6f1 3.16.0-4-amd64 Debian GNU/Linux 7 (wheezy) docker://1.9.1 v1.3.0-alpha.0.573+caaaed2e2bfcfd-dirty v1.3.0-alpha.0.573+caaaed2e2bfcfd-dirty} [{[gcr.io/google_containers/kube-proxy:f96d46946de3188c38adef424ca88bc6] 165880697} {[gcr.io/google_containers/fluentd-gcp:1.18] 411450900} {[redis:latest] 177586452} {[gcr.io/google_containers/pause:2.0] 350164} {[gcr.io/google_samples/gb-frontend:v3] 509707703} {[gcr.io/google_samples/gb-redisslave:v1] 109508753} {[gcr.io/google_containers/pause:0.8.0] 241656} {[gcr.io/google_containers/redis:e2e] 419003740}]}}
Apr 4 10:12:40.641: INFO:
Logging kubelet events for node kubernetes-minion-yttk
Apr 4 10:12:40.694: INFO:
Logging pods the kubelet thinks is on node kubernetes-minion-yttk
Apr 4 10:12:40.798: INFO: fluentd-cloud-logging-kubernetes-minion-yttk started at <nil> (0 container statuses recorded)
Apr 4 10:12:40.798: INFO: kube-proxy-kubernetes-minion-yttk started at <nil> (0 container statuses recorded)
Apr 4 10:12:40.798: INFO: redis-master-q94nv started at 2016-04-04 10:12:37 -0400 EDT (1 container statuses recorded)
Apr 4 10:12:40.799: INFO: Container redis-master ready: true, restart count 0
Apr 4 10:12:40.957: INFO: ERROR kubelet_docker_errors{operation_type="info"} => 1 @[0]
Apr 4 10:12:40.957: INFO: ERROR kubelet_docker_errors{operation_type="inspect_image"} => 8 @[0]
Apr 4 10:12:40.957: INFO: ERROR kubelet_docker_errors{operation_type="list_containers"} => 32 @[0]
Apr 4 10:12:40.957: INFO: ERROR kubelet_docker_errors{operation_type="list_images"} => 6 @[0]
Apr 4 10:12:40.957: INFO: ERROR kubelet_docker_errors{operation_type="version"} => 12 @[0]
Apr 4 10:12:40.957: INFO:
Latency metrics for node kubernetes-minion-yttk
Apr 4 10:12:40.957: INFO: Waiting up to 1m0s for all nodes to be ready
STEP: Destroying namespace "e2e-tests-kubectl-3oijk" for this suite.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment