Skip to content

Instantly share code, notes, and snippets.

@mjudeikis
Last active January 2, 2019 15:16
Show Gist options
  • Save mjudeikis/0a9e1bc38a2007841ecdfeee5035f0be to your computer and use it in GitHub Desktop.
Save mjudeikis/0a9e1bc38a2007841ecdfeee5035f0be to your computer and use it in GitHub Desktop.
prometheus-operator-logs
/ $ cat /tmp/artifacts/cluster-monitoring-operator.log
I0102 14:31:35.496843 1 operator.go:114] Connection established (cluster-version: v1.11.0+d4cacc0)
I0102 14:31:35.572382 1 operator.go:165] Waiting for initial cache sync.
I0102 14:31:35.572630 1 reflector.go:202] Starting reflector *v1.ConfigMap (5m0s) from github.com/openshift/cluster-monitoring-operator/pkg/operator/operator.go:130
I0102 14:31:35.572658 1 reflector.go:240] Listing and watching *v1.ConfigMap from github.com/openshift/cluster-monitoring-operator/pkg/operator/operator.go:130
I0102 14:31:35.772560 1 operator.go:155] ConfigMap updated: openshift-monitoring/cluster-monitoring-config
I0102 14:31:36.572700 1 operator.go:167] Initial cache sync done.
I0102 14:31:36.572810 1 decoder.go:224] decoding stream as YAML
I0102 14:31:36.575337 1 tasks.go:37] running task Updating Prometheus Operator
I0102 14:31:36.575472 1 decoder.go:224] decoding stream as YAML
I0102 14:31:37.074171 1 decoder.go:224] decoding stream as YAML
I0102 14:31:37.372707 1 decoder.go:224] decoding stream as YAML
I0102 14:31:37.472722 1 decoder.go:224] decoding stream as YAML
I0102 14:31:37.672753 1 decoder.go:224] decoding stream as YAML
I0102 14:32:30.221633 1 decoder.go:224] decoding stream as YAML
I0102 14:32:30.272878 1 tasks.go:37] running task Updating Cluster Monitoring Operator
I0102 14:32:30.272977 1 decoder.go:224] decoding stream as YAML
I0102 14:32:30.372623 1 decoder.go:224] decoding stream as YAML
I0102 14:32:30.384007 1 decoder.go:224] decoding stream as YAML
I0102 14:32:30.509660 1 tasks.go:37] running task Updating Grafana
I0102 14:32:30.509772 1 decoder.go:224] decoding stream as YAML
I0102 14:32:30.672659 1 decoder.go:224] decoding stream as YAML
I0102 14:32:30.718870 1 decoder.go:224] decoding stream as YAML
I0102 14:32:36.877889 1 decoder.go:224] decoding stream as YAML
I0102 14:32:36.973045 1 decoder.go:224] decoding stream as YAML
I0102 14:32:37.097500 1 decoder.go:224] decoding stream as YAML
I0102 14:32:37.572469 1 decoder.go:224] decoding stream as YAML
I0102 14:32:38.973623 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-cluster-rsrc-use
I0102 14:32:38.973656 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-cluster-rsrc-use) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:32:39.574058 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-node-rsrc-use
I0102 14:32:39.574090 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-node-rsrc-use) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:32:40.573351 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-cluster
I0102 14:32:40.573393 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-cluster) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:32:40.872406 1 decoder.go:224] decoding stream as YAML
I0102 14:32:40.873190 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-namespace
I0102 14:32:41.072406 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-namespace) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:32:41.072457 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-pod
I0102 14:32:41.072466 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-pod) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:32:41.083059 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboards
I0102 14:32:41.083080 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboards) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:32:41.172695 1 decoder.go:224] decoding stream as YAML
I0102 14:32:41.189733 1 decoder.go:224] decoding stream as YAML
I0102 14:32:41.408670 1 decoder.go:224] decoding stream as YAML
I0102 14:33:05.690962 1 tasks.go:37] running task Updating Prometheus-k8s
I0102 14:33:05.691060 1 decoder.go:224] decoding stream as YAML
I0102 14:33:06.776809 1 decoder.go:224] decoding stream as YAML
I0102 14:33:06.879848 1 decoder.go:224] decoding stream as YAML
I0102 14:33:06.972668 1 decoder.go:224] decoding stream as YAML
I0102 14:33:07.028126 1 decoder.go:224] decoding stream as YAML
I0102 14:33:07.203620 1 decoder.go:224] decoding stream as YAML
I0102 14:33:07.296875 1 decoder.go:224] decoding stream as YAML
I0102 14:33:07.373558 1 decoder.go:224] decoding stream as YAML
I0102 14:33:07.663112 1 decoder.go:224] decoding stream as YAML
I0102 14:33:07.872732 1 request.go:485] Throttling request took 194.937623ms, request: POST:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/default/rolebindings
I0102 14:33:08.072735 1 request.go:485] Throttling request took 142.755657ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/kube-system/rolebindings/prometheus-k8s
I0102 14:33:08.272872 1 request.go:485] Throttling request took 195.905627ms, request: POST:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/kube-system/rolebindings
I0102 14:33:08.472922 1 request.go:485] Throttling request took 159.081108ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/openshift-monitoring/rolebindings/prometheus-k8s
I0102 14:33:08.672720 1 request.go:485] Throttling request took 196.253527ms, request: POST:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/openshift-monitoring/rolebindings
I0102 14:33:08.714822 1 decoder.go:224] decoding stream as YAML
I0102 14:33:08.872726 1 request.go:485] Throttling request took 157.581804ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/openshift-monitoring/rolebindings/prometheus-k8s-config
I0102 14:33:09.072742 1 request.go:485] Throttling request took 195.523525ms, request: POST:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/openshift-monitoring/rolebindings
I0102 14:33:09.128885 1 decoder.go:224] decoding stream as YAML
I0102 14:33:10.474985 1 decoder.go:224] decoding stream as YAML
I0102 14:33:10.586231 1 decoder.go:224] decoding stream as YAML
I0102 14:33:10.972954 1 decoder.go:224] decoding stream as YAML
I0102 14:33:11.181585 1 decoder.go:224] decoding stream as YAML
I0102 14:33:11.372443 1 decoder.go:224] decoding stream as YAML
I0102 14:33:11.496810 1 decoder.go:224] decoding stream as YAML
I0102 14:33:11.527027 1 prometheus.go:263] initializing Prometheus object
I0102 14:33:11.527152 1 decoder.go:224] decoding stream as YAML
I0102 14:33:11.575056 1 prometheus.go:269] reconciling Prometheus object
I0102 14:33:11.875416 1 prometheus.go:275] waiting for Prometheus object changes
I0102 14:33:12.072400 1 operator.go:155] ConfigMap updated: openshift-monitoring/prometheus-k8s-rulefiles-0
I0102 14:33:12.072441 1 operator.go:158] ConfigMap (openshift-monitoring/prometheus-k8s-rulefiles-0) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:36:02.073395 1 tasks.go:37] running task Updating Alertmanager
I0102 14:36:02.073514 1 decoder.go:224] decoding stream as YAML
I0102 14:36:03.099457 1 decoder.go:224] decoding stream as YAML
I0102 14:36:03.173142 1 decoder.go:224] decoding stream as YAML
I0102 14:36:03.473036 1 decoder.go:224] decoding stream as YAML
I0102 14:36:03.813426 1 decoder.go:224] decoding stream as YAML
I0102 14:36:04.603605 1 decoder.go:224] decoding stream as YAML
I0102 14:36:04.615502 1 decoder.go:224] decoding stream as YAML
I0102 14:36:04.672692 1 decoder.go:224] decoding stream as YAML
I0102 14:36:04.773781 1 decoder.go:224] decoding stream as YAML
I0102 14:36:35.772550 1 reflector.go:286] github.com/openshift/cluster-monitoring-operator/pkg/operator/operator.go:130: forcing resync
I0102 14:36:35.772670 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-cluster-rsrc-use
I0102 14:36:35.772685 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-cluster-rsrc-use) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:36:35.772697 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-node-rsrc-use
I0102 14:36:35.772706 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-node-rsrc-use) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:36:35.772718 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-cluster
I0102 14:36:35.772728 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-cluster) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:36:35.772737 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-namespace
I0102 14:36:35.772746 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-namespace) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:36:35.772757 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-pod
I0102 14:36:35.772765 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-pod) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:36:35.772774 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboards
I0102 14:36:35.772782 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboards) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:36:35.772792 1 operator.go:155] ConfigMap updated: openshift-monitoring/prometheus-k8s-rulefiles-0
I0102 14:36:35.772800 1 operator.go:158] ConfigMap (openshift-monitoring/prometheus-k8s-rulefiles-0) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:36:35.772808 1 operator.go:155] ConfigMap updated: openshift-monitoring/cluster-monitoring-config
I0102 14:39:04.976578 1 tasks.go:37] running task Updating node-exporter
I0102 14:39:04.976673 1 decoder.go:224] decoding stream as YAML
I0102 14:39:05.109520 1 decoder.go:224] decoding stream as YAML
I0102 14:39:05.372575 1 decoder.go:224] decoding stream as YAML
I0102 14:39:05.484144 1 decoder.go:224] decoding stream as YAML
I0102 14:39:05.591608 1 decoder.go:224] decoding stream as YAML
I0102 14:39:05.711591 1 decoder.go:224] decoding stream as YAML
I0102 14:39:05.787108 1 decoder.go:224] decoding stream as YAML
I0102 14:39:36.682405 1 reflector.go:428] github.com/openshift/cluster-monitoring-operator/pkg/operator/operator.go:130: Watch close - *v1.ConfigMap total 7 items received
I0102 14:41:35.772806 1 reflector.go:286] github.com/openshift/cluster-monitoring-operator/pkg/operator/operator.go:130: forcing resync
I0102 14:41:35.772949 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-pod
I0102 14:41:35.772960 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-pod) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:41:35.772970 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboards
I0102 14:41:35.772977 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboards) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:41:35.772988 1 operator.go:155] ConfigMap updated: openshift-monitoring/prometheus-k8s-rulefiles-0
I0102 14:41:35.773012 1 operator.go:158] ConfigMap (openshift-monitoring/prometheus-k8s-rulefiles-0) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:41:35.773020 1 operator.go:155] ConfigMap updated: openshift-monitoring/cluster-monitoring-config
I0102 14:41:35.773076 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-cluster-rsrc-use
I0102 14:41:35.773086 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-cluster-rsrc-use) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:41:35.773094 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-node-rsrc-use
I0102 14:41:35.773102 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-node-rsrc-use) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:41:35.773113 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-cluster
I0102 14:41:35.773121 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-cluster) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:41:35.773129 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-namespace
I0102 14:41:35.773137 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-namespace) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
E0102 14:44:06.982394 1 operator.go:206] Syncing "openshift-monitoring/cluster-monitoring-config" failed
E0102 14:44:06.982446 1 operator.go:207] sync "openshift-monitoring/cluster-monitoring-config" failed: running task Updating node-exporter failed: reconciling node-exporter DaemonSet failed: creating DaemonSet object failed: timed out waiting for the condition
I0102 14:44:06.982513 1 decoder.go:224] decoding stream as YAML
I0102 14:44:06.983225 1 tasks.go:37] running task Updating Prometheus Operator
I0102 14:44:06.983318 1 decoder.go:224] decoding stream as YAML
I0102 14:44:06.987168 1 decoder.go:224] decoding stream as YAML
I0102 14:44:07.204138 1 decoder.go:224] decoding stream as YAML
I0102 14:44:07.238908 1 decoder.go:224] decoding stream as YAML
I0102 14:44:07.372805 1 decoder.go:224] decoding stream as YAML
I0102 14:44:25.972784 1 decoder.go:224] decoding stream as YAML
I0102 14:44:26.175847 1 tasks.go:37] running task Updating Cluster Monitoring Operator
I0102 14:44:26.175939 1 decoder.go:224] decoding stream as YAML
I0102 14:44:26.279795 1 decoder.go:224] decoding stream as YAML
I0102 14:44:26.383874 1 decoder.go:224] decoding stream as YAML
I0102 14:44:26.607226 1 tasks.go:37] running task Updating Grafana
I0102 14:44:26.607349 1 decoder.go:224] decoding stream as YAML
I0102 14:44:26.704795 1 decoder.go:224] decoding stream as YAML
I0102 14:44:26.772453 1 request.go:485] Throttling request took 64.158388ms, request: PUT:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/clusterrolebindings/grafana
I0102 14:44:26.813163 1 decoder.go:224] decoding stream as YAML
I0102 14:44:27.821408 1 decoder.go:224] decoding stream as YAML
I0102 14:44:27.824732 1 decoder.go:224] decoding stream as YAML
I0102 14:44:27.877348 1 decoder.go:224] decoding stream as YAML
I0102 14:44:28.172354 1 decoder.go:224] decoding stream as YAML
I0102 14:44:31.074080 1 decoder.go:224] decoding stream as YAML
I0102 14:44:31.179682 1 decoder.go:224] decoding stream as YAML
I0102 14:44:31.272698 1 decoder.go:224] decoding stream as YAML
I0102 14:44:31.372829 1 decoder.go:224] decoding stream as YAML
I0102 14:44:32.577996 1 tasks.go:37] running task Updating Prometheus-k8s
I0102 14:44:32.578074 1 decoder.go:224] decoding stream as YAML
I0102 14:44:33.587171 1 decoder.go:224] decoding stream as YAML
I0102 14:44:33.594036 1 decoder.go:224] decoding stream as YAML
I0102 14:44:33.872907 1 decoder.go:224] decoding stream as YAML
I0102 14:44:33.972782 1 decoder.go:224] decoding stream as YAML
I0102 14:44:34.326824 1 decoder.go:224] decoding stream as YAML
I0102 14:44:34.403555 1 decoder.go:224] decoding stream as YAML
I0102 14:44:34.572777 1 decoder.go:224] decoding stream as YAML
I0102 14:44:34.806042 1 decoder.go:224] decoding stream as YAML
I0102 14:44:34.972413 1 request.go:485] Throttling request took 99.749091ms, request: PUT:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/default/rolebindings/prometheus-k8s
I0102 14:44:35.072844 1 request.go:485] Throttling request took 66.994095ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/kube-system/rolebindings/prometheus-k8s
I0102 14:44:35.272890 1 request.go:485] Throttling request took 196.407473ms, request: PUT:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/kube-system/rolebindings/prometheus-k8s
I0102 14:44:36.118537 1 decoder.go:224] decoding stream as YAML
I0102 14:44:36.175089 1 decoder.go:224] decoding stream as YAML
I0102 14:44:38.598420 1 decoder.go:224] decoding stream as YAML
I0102 14:44:38.772978 1 decoder.go:224] decoding stream as YAML
I0102 14:44:38.980903 1 decoder.go:224] decoding stream as YAML
I0102 14:44:39.177915 1 decoder.go:224] decoding stream as YAML
I0102 14:44:39.281543 1 decoder.go:224] decoding stream as YAML
I0102 14:44:39.472736 1 decoder.go:224] decoding stream as YAML
I0102 14:44:39.572751 1 prometheus.go:263] initializing Prometheus object
I0102 14:44:39.572895 1 decoder.go:224] decoding stream as YAML
I0102 14:44:39.574165 1 prometheus.go:269] reconciling Prometheus object
I0102 14:44:39.874057 1 prometheus.go:275] waiting for Prometheus object changes
I0102 14:44:49.978748 1 tasks.go:37] running task Updating Alertmanager
I0102 14:44:49.978837 1 decoder.go:224] decoding stream as YAML
I0102 14:44:51.077730 1 decoder.go:224] decoding stream as YAML
I0102 14:44:51.272837 1 decoder.go:224] decoding stream as YAML
I0102 14:44:51.277556 1 decoder.go:224] decoding stream as YAML
I0102 14:44:51.378392 1 decoder.go:224] decoding stream as YAML
I0102 14:44:52.141634 1 decoder.go:224] decoding stream as YAML
I0102 14:44:52.151472 1 decoder.go:224] decoding stream as YAML
I0102 14:44:52.172832 1 decoder.go:224] decoding stream as YAML
I0102 14:44:52.296880 1 decoder.go:224] decoding stream as YAML
I0102 14:45:02.672979 1 tasks.go:37] running task Updating node-exporter
I0102 14:45:02.673077 1 decoder.go:224] decoding stream as YAML
I0102 14:45:02.877830 1 decoder.go:224] decoding stream as YAML
I0102 14:45:03.072820 1 decoder.go:224] decoding stream as YAML
I0102 14:45:03.172640 1 decoder.go:224] decoding stream as YAML
I0102 14:45:03.213807 1 decoder.go:224] decoding stream as YAML
I0102 14:45:03.311473 1 decoder.go:224] decoding stream as YAML
I0102 14:45:03.472843 1 decoder.go:224] decoding stream as YAML
I0102 14:46:35.773143 1 reflector.go:286] github.com/openshift/cluster-monitoring-operator/pkg/operator/operator.go:130: forcing resync
I0102 14:46:35.773247 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-cluster-rsrc-use
I0102 14:46:35.773262 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-cluster-rsrc-use) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:46:35.773300 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-node-rsrc-use
I0102 14:46:35.773308 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-node-rsrc-use) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:46:35.773329 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-cluster
I0102 14:46:35.773338 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-cluster) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:46:35.773346 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-namespace
I0102 14:46:35.773355 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-namespace) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:46:35.773372 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-pod
I0102 14:46:35.773381 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-pod) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:46:35.773391 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboards
I0102 14:46:35.773399 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboards) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:46:35.773423 1 operator.go:155] ConfigMap updated: openshift-monitoring/prometheus-k8s-rulefiles-0
I0102 14:46:35.773435 1 operator.go:158] ConfigMap (openshift-monitoring/prometheus-k8s-rulefiles-0) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:46:35.773445 1 operator.go:155] ConfigMap updated: openshift-monitoring/cluster-monitoring-config
I0102 14:49:18.691134 1 reflector.go:428] github.com/openshift/cluster-monitoring-operator/pkg/operator/operator.go:130: Watch close - *v1.ConfigMap total 0 items received
W0102 14:49:18.701303 1 reflector.go:341] github.com/openshift/cluster-monitoring-operator/pkg/operator/operator.go:130: watch of *v1.ConfigMap ended with: The resourceVersion for the provided watch is too old.
I0102 14:49:19.701534 1 reflector.go:240] Listing and watching *v1.ConfigMap from github.com/openshift/cluster-monitoring-operator/pkg/operator/operator.go:130
I0102 14:49:20.472827 1 operator.go:155] ConfigMap updated: openshift-monitoring/cluster-monitoring-config
I0102 14:49:20.472877 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-cluster-rsrc-use
I0102 14:49:20.472890 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-cluster-rsrc-use) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:49:20.472912 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-node-rsrc-use
I0102 14:49:20.472923 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-node-rsrc-use) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:49:20.472935 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-cluster
I0102 14:49:20.472946 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-cluster) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:49:20.472966 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-namespace
I0102 14:49:20.472976 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-namespace) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:49:20.472988 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-pod
I0102 14:49:20.473000 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-pod) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:49:20.473019 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboards
I0102 14:49:20.473029 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboards) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:49:20.473042 1 operator.go:155] ConfigMap updated: openshift-monitoring/prometheus-k8s-rulefiles-0
I0102 14:49:20.473052 1 operator.go:158] ConfigMap (openshift-monitoring/prometheus-k8s-rulefiles-0) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
E0102 14:50:03.680768 1 operator.go:206] Syncing "openshift-monitoring/cluster-monitoring-config" failed
E0102 14:50:03.680816 1 operator.go:207] sync "openshift-monitoring/cluster-monitoring-config" failed: running task Updating node-exporter failed: reconciling node-exporter DaemonSet failed: updating DaemonSet object failed: timed out waiting for the condition
I0102 14:50:03.680890 1 decoder.go:224] decoding stream as YAML
I0102 14:50:03.681644 1 tasks.go:37] running task Updating Prometheus Operator
I0102 14:50:03.681701 1 decoder.go:224] decoding stream as YAML
I0102 14:50:03.772692 1 decoder.go:224] decoding stream as YAML
I0102 14:50:03.911014 1 decoder.go:224] decoding stream as YAML
I0102 14:50:04.027043 1 decoder.go:224] decoding stream as YAML
I0102 14:50:04.113672 1 decoder.go:224] decoding stream as YAML
I0102 14:50:22.073179 1 decoder.go:224] decoding stream as YAML
I0102 14:50:22.181779 1 tasks.go:37] running task Updating Cluster Monitoring Operator
I0102 14:50:22.181887 1 decoder.go:224] decoding stream as YAML
I0102 14:50:22.281025 1 decoder.go:224] decoding stream as YAML
I0102 14:50:22.472865 1 decoder.go:224] decoding stream as YAML
I0102 14:50:22.507758 1 tasks.go:37] running task Updating Grafana
I0102 14:50:22.507857 1 decoder.go:224] decoding stream as YAML
I0102 14:50:22.672668 1 decoder.go:224] decoding stream as YAML
I0102 14:50:22.714756 1 decoder.go:224] decoding stream as YAML
I0102 14:50:23.973576 1 decoder.go:224] decoding stream as YAML
I0102 14:50:24.172952 1 decoder.go:224] decoding stream as YAML
I0102 14:50:24.374123 1 decoder.go:224] decoding stream as YAML
I0102 14:50:24.673534 1 decoder.go:224] decoding stream as YAML
I0102 14:50:27.481908 1 decoder.go:224] decoding stream as YAML
I0102 14:50:27.672573 1 decoder.go:224] decoding stream as YAML
I0102 14:50:27.772726 1 decoder.go:224] decoding stream as YAML
I0102 14:50:27.796314 1 decoder.go:224] decoding stream as YAML
I0102 14:50:29.114539 1 tasks.go:37] running task Updating Prometheus-k8s
I0102 14:50:29.114624 1 decoder.go:224] decoding stream as YAML
I0102 14:50:30.125232 1 decoder.go:224] decoding stream as YAML
I0102 14:50:30.272407 1 decoder.go:224] decoding stream as YAML
I0102 14:50:30.372996 1 decoder.go:224] decoding stream as YAML
I0102 14:50:30.576884 1 decoder.go:224] decoding stream as YAML
I0102 14:50:30.872579 1 decoder.go:224] decoding stream as YAML
I0102 14:50:30.909593 1 decoder.go:224] decoding stream as YAML
I0102 14:50:31.072865 1 decoder.go:224] decoding stream as YAML
I0102 14:50:31.313586 1 decoder.go:224] decoding stream as YAML
I0102 14:50:31.473137 1 request.go:485] Throttling request took 96.040586ms, request: PUT:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/default/rolebindings/prometheus-k8s
I0102 14:50:31.673128 1 request.go:485] Throttling request took 159.370173ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/kube-system/rolebindings/prometheus-k8s
I0102 14:50:31.873165 1 request.go:485] Throttling request took 195.677981ms, request: PUT:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/kube-system/rolebindings/prometheus-k8s
I0102 14:50:32.073387 1 request.go:485] Throttling request took 164.784689ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/openshift-monitoring/rolebindings/prometheus-k8s
I0102 14:50:32.273204 1 request.go:485] Throttling request took 187.514157ms, request: PUT:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/openshift-monitoring/rolebindings/prometheus-k8s
I0102 14:50:32.320098 1 decoder.go:224] decoding stream as YAML
I0102 14:50:32.473126 1 request.go:485] Throttling request took 152.653453ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/openshift-monitoring/rolebindings/prometheus-k8s-config
I0102 14:50:32.673141 1 request.go:485] Throttling request took 196.022383ms, request: PUT:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/openshift-monitoring/rolebindings/prometheus-k8s-config
I0102 14:50:32.713543 1 decoder.go:224] decoding stream as YAML
I0102 14:50:34.772612 1 decoder.go:224] decoding stream as YAML
I0102 14:50:34.872962 1 decoder.go:224] decoding stream as YAML
I0102 14:50:35.078407 1 decoder.go:224] decoding stream as YAML
I0102 14:50:35.272820 1 decoder.go:224] decoding stream as YAML
I0102 14:50:35.372765 1 decoder.go:224] decoding stream as YAML
I0102 14:50:35.484960 1 decoder.go:224] decoding stream as YAML
I0102 14:50:35.582034 1 prometheus.go:263] initializing Prometheus object
I0102 14:50:35.582182 1 decoder.go:224] decoding stream as YAML
I0102 14:50:35.672522 1 prometheus.go:269] reconciling Prometheus object
I0102 14:50:36.373121 1 prometheus.go:275] waiting for Prometheus object changes
I0102 14:50:46.577156 1 tasks.go:37] running task Updating Alertmanager
I0102 14:50:46.577226 1 decoder.go:224] decoding stream as YAML
I0102 14:50:47.690107 1 decoder.go:224] decoding stream as YAML
I0102 14:50:47.772364 1 decoder.go:224] decoding stream as YAML
I0102 14:50:47.776029 1 decoder.go:224] decoding stream as YAML
I0102 14:50:48.005231 1 decoder.go:224] decoding stream as YAML
I0102 14:50:48.106815 1 decoder.go:224] decoding stream as YAML
I0102 14:50:48.172615 1 decoder.go:224] decoding stream as YAML
I0102 14:50:48.176690 1 decoder.go:224] decoding stream as YAML
I0102 14:50:48.272825 1 decoder.go:224] decoding stream as YAML
I0102 14:50:58.973348 1 tasks.go:37] running task Updating node-exporter
I0102 14:50:58.973459 1 decoder.go:224] decoding stream as YAML
I0102 14:50:59.372880 1 decoder.go:224] decoding stream as YAML
I0102 14:50:59.381792 1 decoder.go:224] decoding stream as YAML
I0102 14:50:59.472615 1 decoder.go:224] decoding stream as YAML
I0102 14:50:59.572675 1 decoder.go:224] decoding stream as YAML
I0102 14:50:59.672659 1 decoder.go:224] decoding stream as YAML
I0102 14:50:59.772718 1 decoder.go:224] decoding stream as YAML
I0102 14:54:20.472907 1 reflector.go:286] github.com/openshift/cluster-monitoring-operator/pkg/operator/operator.go:130: forcing resync
I0102 14:54:20.473034 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-cluster-rsrc-use
I0102 14:54:20.473048 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-cluster-rsrc-use) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:54:20.473057 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-node-rsrc-use
I0102 14:54:20.473065 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-node-rsrc-use) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:54:20.473075 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-cluster
I0102 14:54:20.473084 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-cluster) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:54:20.473092 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-namespace
I0102 14:54:20.473099 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-namespace) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:54:20.473108 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-pod
I0102 14:54:20.473116 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-pod) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:54:20.473123 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboards
I0102 14:54:20.473130 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboards) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:54:20.473140 1 operator.go:155] ConfigMap updated: openshift-monitoring/prometheus-k8s-rulefiles-0
I0102 14:54:20.473147 1 operator.go:158] ConfigMap (openshift-monitoring/prometheus-k8s-rulefiles-0) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:54:20.473156 1 operator.go:155] ConfigMap updated: openshift-monitoring/cluster-monitoring-config
E0102 14:55:59.889246 1 operator.go:206] Syncing "openshift-monitoring/cluster-monitoring-config" failed
E0102 14:55:59.889312 1 operator.go:207] sync "openshift-monitoring/cluster-monitoring-config" failed: running task Updating node-exporter failed: reconciling node-exporter DaemonSet failed: updating DaemonSet object failed: timed out waiting for the condition
I0102 14:55:59.889375 1 decoder.go:224] decoding stream as YAML
I0102 14:55:59.890051 1 tasks.go:37] running task Updating Prometheus Operator
I0102 14:55:59.890117 1 decoder.go:224] decoding stream as YAML
I0102 14:56:00.072659 1 decoder.go:224] decoding stream as YAML
I0102 14:56:00.173756 1 decoder.go:224] decoding stream as YAML
I0102 14:56:00.235637 1 decoder.go:224] decoding stream as YAML
I0102 14:56:00.273066 1 decoder.go:224] decoding stream as YAML
I0102 14:56:18.973252 1 decoder.go:224] decoding stream as YAML
I0102 14:56:19.476754 1 tasks.go:37] running task Updating Cluster Monitoring Operator
I0102 14:56:19.476851 1 decoder.go:224] decoding stream as YAML
I0102 14:56:19.486781 1 decoder.go:224] decoding stream as YAML
I0102 14:56:19.577173 1 decoder.go:224] decoding stream as YAML
I0102 14:56:19.708204 1 tasks.go:37] running task Updating Grafana
I0102 14:56:19.708321 1 decoder.go:224] decoding stream as YAML
I0102 14:56:19.872627 1 decoder.go:224] decoding stream as YAML
I0102 14:56:19.910131 1 decoder.go:224] decoding stream as YAML
I0102 14:56:20.980948 1 decoder.go:224] decoding stream as YAML
I0102 14:56:20.985338 1 decoder.go:224] decoding stream as YAML
I0102 14:56:21.172745 1 decoder.go:224] decoding stream as YAML
I0102 14:56:21.272644 1 decoder.go:224] decoding stream as YAML
I0102 14:56:24.372542 1 decoder.go:224] decoding stream as YAML
I0102 14:56:24.381121 1 decoder.go:224] decoding stream as YAML
I0102 14:56:24.477198 1 decoder.go:224] decoding stream as YAML
I0102 14:56:24.587845 1 decoder.go:224] decoding stream as YAML
I0102 14:56:25.819418 1 tasks.go:37] running task Updating Prometheus-k8s
I0102 14:56:25.819515 1 decoder.go:224] decoding stream as YAML
I0102 14:56:26.830849 1 decoder.go:224] decoding stream as YAML
I0102 14:56:26.837813 1 decoder.go:224] decoding stream as YAML
I0102 14:56:26.877108 1 decoder.go:224] decoding stream as YAML
I0102 14:56:26.883928 1 decoder.go:224] decoding stream as YAML
I0102 14:56:27.072705 1 decoder.go:224] decoding stream as YAML
I0102 14:56:27.206320 1 decoder.go:224] decoding stream as YAML
I0102 14:56:27.241537 1 decoder.go:224] decoding stream as YAML
I0102 14:56:27.510246 1 decoder.go:224] decoding stream as YAML
I0102 14:56:27.672409 1 request.go:485] Throttling request took 161.484587ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/default/rolebindings/prometheus-k8s
I0102 14:56:27.772628 1 request.go:485] Throttling request took 96.858491ms, request: PUT:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/default/rolebindings/prometheus-k8s
I0102 14:56:27.972620 1 request.go:485] Throttling request took 154.508166ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/kube-system/rolebindings/prometheus-k8s
I0102 14:56:28.172611 1 request.go:485] Throttling request took 195.598189ms, request: PUT:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/kube-system/rolebindings/prometheus-k8s
I0102 14:56:28.372604 1 request.go:485] Throttling request took 157.375674ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/openshift-monitoring/rolebindings/prometheus-k8s
I0102 14:56:28.572626 1 request.go:485] Throttling request took 195.94279ms, request: PUT:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/openshift-monitoring/rolebindings/prometheus-k8s
I0102 14:56:28.611714 1 decoder.go:224] decoding stream as YAML
I0102 14:56:28.772626 1 request.go:485] Throttling request took 160.545884ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/openshift-monitoring/rolebindings/prometheus-k8s-config
I0102 14:56:28.972650 1 request.go:485] Throttling request took 186.410762ms, request: PUT:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/openshift-monitoring/rolebindings/prometheus-k8s-config
I0102 14:56:29.007049 1 decoder.go:224] decoding stream as YAML
I0102 14:56:31.273179 1 decoder.go:224] decoding stream as YAML
I0102 14:56:31.473045 1 decoder.go:224] decoding stream as YAML
I0102 14:56:31.377264 1 reflector.go:428] github.com/openshift/cluster-monitoring-operator/pkg/operator/operator.go:130: Watch close - *v1.ConfigMap total 0 items received
I0102 14:56:31.673127 1 decoder.go:224] decoding stream as YAML
I0102 14:56:32.273010 1 decoder.go:224] decoding stream as YAML
I0102 14:56:32.482250 1 decoder.go:224] decoding stream as YAML
I0102 14:56:32.709202 1 decoder.go:224] decoding stream as YAML
I0102 14:56:32.772372 1 request.go:485] Throttling request took 59.067278ms, request: PUT:https://172.30.0.1:443/api/v1/namespaces/kube-system/services/kube-controllers
I0102 14:56:32.789144 1 prometheus.go:263] initializing Prometheus object
I0102 14:56:32.789318 1 decoder.go:224] decoding stream as YAML
I0102 14:56:32.872644 1 prometheus.go:269] reconciling Prometheus object
I0102 14:56:33.172731 1 prometheus.go:275] waiting for Prometheus object changes
I0102 14:56:43.273142 1 tasks.go:37] running task Updating Alertmanager
I0102 14:56:43.273243 1 decoder.go:224] decoding stream as YAML
I0102 14:56:44.381998 1 decoder.go:224] decoding stream as YAML
I0102 14:56:44.498566 1 decoder.go:224] decoding stream as YAML
I0102 14:56:44.572726 1 decoder.go:224] decoding stream as YAML
I0102 14:56:44.704664 1 decoder.go:224] decoding stream as YAML
I0102 14:56:44.804828 1 decoder.go:224] decoding stream as YAML
I0102 14:56:44.872717 1 decoder.go:224] decoding stream as YAML
I0102 14:56:44.877082 1 decoder.go:224] decoding stream as YAML
I0102 14:56:44.904836 1 decoder.go:224] decoding stream as YAML
I0102 14:56:55.277670 1 tasks.go:37] running task Updating node-exporter
I0102 14:56:55.277770 1 decoder.go:224] decoding stream as YAML
I0102 14:56:55.381814 1 decoder.go:224] decoding stream as YAML
I0102 14:56:55.477055 1 decoder.go:224] decoding stream as YAML
I0102 14:56:55.672612 1 decoder.go:224] decoding stream as YAML
I0102 14:56:55.772430 1 decoder.go:224] decoding stream as YAML
I0102 14:56:55.838400 1 decoder.go:224] decoding stream as YAML
I0102 14:56:55.972741 1 decoder.go:224] decoding stream as YAML
I0102 14:59:20.473179 1 reflector.go:286] github.com/openshift/cluster-monitoring-operator/pkg/operator/operator.go:130: forcing resync
I0102 14:59:20.473327 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-namespace
I0102 14:59:20.473345 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-namespace) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:59:20.473361 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-pod
I0102 14:59:20.473372 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-pod) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:59:20.473396 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboards
I0102 14:59:20.473405 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboards) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:59:20.473414 1 operator.go:155] ConfigMap updated: openshift-monitoring/prometheus-k8s-rulefiles-0
I0102 14:59:20.473421 1 operator.go:158] ConfigMap (openshift-monitoring/prometheus-k8s-rulefiles-0) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:59:20.473432 1 operator.go:155] ConfigMap updated: openshift-monitoring/cluster-monitoring-config
I0102 14:59:20.473445 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-cluster-rsrc-use
I0102 14:59:20.473453 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-cluster-rsrc-use) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:59:20.473463 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-node-rsrc-use
I0102 14:59:20.473472 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-node-rsrc-use) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
I0102 14:59:20.473483 1 operator.go:155] ConfigMap updated: openshift-monitoring/grafana-dashboard-k8s-resources-cluster
I0102 14:59:20.473493 1 operator.go:158] ConfigMap (openshift-monitoring/grafana-dashboard-k8s-resources-cluster) not triggering an update. Only changes to openshift-monitoring/cluster-monitoring-config configure the cluster monitoring stack.
ts=2019-01-02T14:32:09.335548784Z caller=main.go:130 msg="Starting Prometheus Operator version '0.23.2'."
level=info ts=2019-01-02T14:32:09.396327183Z caller=operator.go:176 component=alertmanageroperator msg="connection established" cluster-version=v1.11.0+d4cacc0
level=info ts=2019-01-02T14:32:09.401050498Z caller=operator.go:320 component=prometheusoperator msg="connection established" cluster-version=v1.11.0+d4cacc0
level=info ts=2019-01-02T14:32:09.509153252Z caller=operator.go:559 component=alertmanageroperator msg="CRD created" crd=Alertmanager
level=info ts=2019-01-02T14:32:09.516055775Z caller=operator.go:1351 component=prometheusoperator msg="CRD created" crd=Prometheus
level=info ts=2019-01-02T14:32:09.605917069Z caller=operator.go:1351 component=prometheusoperator msg="CRD created" crd=ServiceMonitor
level=info ts=2019-01-02T14:32:09.864429916Z caller=operator.go:1351 component=prometheusoperator msg="CRD created" crd=PrometheusRule
level=info ts=2019-01-02T14:32:12.54020268Z caller=operator.go:192 component=alertmanageroperator msg="CRD API endpoints ready"
level=info ts=2019-01-02T14:32:18.950445575Z caller=operator.go:336 component=prometheusoperator msg="CRD API endpoints ready"
level=info ts=2019-01-02T14:33:11.802877226Z caller=operator.go:911 component=prometheusoperator msg="sync prometheus" key=openshift-monitoring/k8s
level=info ts=2019-01-02T14:33:12.038098178Z caller=operator.go:911 component=prometheusoperator msg="sync prometheus" key=openshift-monitoring/k8s
level=info ts=2019-01-02T14:33:12.14818123Z caller=operator.go:911 component=prometheusoperator msg="sync prometheus" key=openshift-monitoring/k8s
level=info ts=2019-01-02T14:33:12.350454077Z caller=operator.go:911 component=prometheusoperator msg="sync prometheus" key=openshift-monitoring/k8s
level=info ts=2019-01-02T14:34:25.248193747Z caller=operator.go:911 component=prometheusoperator msg="sync prometheus" key=openshift-monitoring/k8s
level=info ts=2019-01-02T14:36:00.212859932Z caller=operator.go:911 component=prometheusoperator msg="sync prometheus" key=openshift-monitoring/k8s
level=info ts=2019-01-02T14:36:03.147467178Z caller=operator.go:911 component=prometheusoperator msg="sync prometheus" key=openshift-monitoring/k8s
level=info ts=2019-01-02T14:36:03.239589791Z caller=operator.go:911 component=prometheusoperator msg="sync prometheus" key=openshift-monitoring/k8s
level=info ts=2019-01-02T14:36:03.380123467Z caller=operator.go:911 component=prometheusoperator msg="sync prometheus" key=openshift-monitoring/k8s
level=info ts=2019-01-02T14:36:04.643088547Z caller=operator.go:911 component=prometheusoperator msg="sync prometheus" key=openshift-monitoring/k8s
level=info ts=2019-01-02T14:36:04.786520833Z caller=operator.go:911 component=prometheusoperator msg="sync prometheus" key=openshift-monitoring/k8s
level=info ts=2019-01-02T14:36:04.910719454Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:36:05.015995011Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:36:05.057451852Z caller=operator.go:911 component=prometheusoperator msg="sync prometheus" key=openshift-monitoring/k8s
level=info ts=2019-01-02T14:36:05.199165432Z caller=operator.go:911 component=prometheusoperator msg="sync prometheus" key=openshift-monitoring/k8s
level=info ts=2019-01-02T14:36:05.349805343Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:36:16.878878317Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:36:56.563450156Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:37:12.545153861Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:37:28.704162889Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:37:54.494770736Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:38:49.386285483Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:38:56.733443371Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:39:05.109635594Z caller=operator.go:911 component=prometheusoperator msg="sync prometheus" key=openshift-monitoring/k8s
level=info ts=2019-01-02T14:39:05.224778244Z caller=operator.go:911 component=prometheusoperator msg="sync prometheus" key=openshift-monitoring/k8s
level=info ts=2019-01-02T14:39:05.446028719Z caller=operator.go:911 component=prometheusoperator msg="sync prometheus" key=openshift-monitoring/k8s
level=info ts=2019-01-02T14:39:05.619502247Z caller=operator.go:911 component=prometheusoperator msg="sync prometheus" key=openshift-monitoring/k8s
level=info ts=2019-01-02T14:39:06.501006233Z caller=operator.go:911 component=prometheusoperator msg="sync prometheus" key=openshift-monitoring/k8s
level=info ts=2019-01-02T14:40:46.319954211Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:42:00.541219849Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:42:12.545440191Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:43:18.914309897Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
W0102 14:44:26.059220 1 reflector.go:341] github.com/coreos/prometheus-operator/pkg/prometheus/operator.go:346: watch of *v1.ConfigMap ended with: The resourceVersion for the provided watch is too old.
level=info ts=2019-01-02T14:44:43.054881301Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:45:53.610607942Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:47:12.545796702Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:47:15.128011625Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
W0102 14:48:22.095667 1 reflector.go:341] github.com/coreos/prometheus-operator/pkg/prometheus/operator.go:348: watch of *v1beta2.StatefulSet ended with: The resourceVersion for the provided watch is too old.
level=info ts=2019-01-02T14:48:42.869811179Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:50:22.673784694Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:51:43.969816294Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
W0102 14:51:46.652161 1 reflector.go:341] github.com/coreos/prometheus-operator/pkg/alertmanager/operator.go:200: watch of *v1beta2.StatefulSet ended with: The resourceVersion for the provided watch is too old.
level=info ts=2019-01-02T14:52:12.545856113Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:53:16.684609387Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:54:44.942837797Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:56:38.34581192Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T14:57:12.546107735Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
W0102 14:57:16.059831 1 reflector.go:341] github.com/coreos/prometheus-operator/pkg/prometheus/operator.go:347: watch of *v1.Secret ended with: The resourceVersion for the provided watch is too old.
W0102 14:57:58.145581 1 reflector.go:341] github.com/coreos/prometheus-operator/pkg/prometheus/operator.go:346: watch of *v1.ConfigMap ended with: The resourceVersion for the provided watch is too old.
level=info ts=2019-01-02T14:58:12.596561313Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
W0102 14:59:14.745202 1 reflector.go:341] github.com/coreos/prometheus-operator/pkg/alertmanager/operator.go:200: watch of *v1beta2.StatefulSet ended with: The resourceVersion for the provided watch is too old.
level=info ts=2019-01-02T14:59:39.201602477Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
level=info ts=2019-01-02T15:01:18.297459264Z caller=operator.go:402 component=alertmanageroperator msg="sync alertmanager" key=openshift-monitoring/main
/ $ cat /tmp/artifacts/prometheus-operator-pprof-goroutine
goroutine 1779 [running]:
runtime/pprof.writeGoroutineStacks(0x1e75cc0, 0xc42038a000, 0x0, 0x0)
/usr/lib/golang/src/runtime/pprof/pprof.go:608 +0xa7
runtime/pprof.writeGoroutine(0x1e75cc0, 0xc42038a000, 0x2, 0x30, 0x1274480)
/usr/lib/golang/src/runtime/pprof/pprof.go:597 +0x44
runtime/pprof.(*Profile).WriteTo(0x1edce60, 0x1e75cc0, 0xc42038a000, 0x2, 0xc42038a000, 0xc420477c20)
/usr/lib/golang/src/runtime/pprof/pprof.go:310 +0x3ab
net/http/pprof.handler.ServeHTTP(0xc42030e551, 0x9, 0x1e8bb80, 0xc42038a000, 0xc4200faa00)
/usr/lib/golang/src/net/http/pprof/pprof.go:237 +0x1b8
net/http/pprof.Index(0x1e8bb80, 0xc42038a000, 0xc4200faa00)
/usr/lib/golang/src/net/http/pprof/pprof.go:248 +0x1db
net/http.HandlerFunc.ServeHTTP(0x13e4a60, 0x1e8bb80, 0xc42038a000, 0xc4200faa00)
/usr/lib/golang/src/net/http/server.go:1918 +0x44
net/http.(*ServeMux).ServeHTTP(0xc420477c20, 0x1e8bb80, 0xc42038a000, 0xc4200faa00)
/usr/lib/golang/src/net/http/server.go:2254 +0x130
net/http.serverHandler.ServeHTTP(0xc42003a4e0, 0x1e8bb80, 0xc42038a000, 0xc4200faa00)
/usr/lib/golang/src/net/http/server.go:2619 +0xb4
net/http.(*conn).serve(0xc42014ce60, 0x1e8c840, 0xc4208cc1c0)
/usr/lib/golang/src/net/http/server.go:1801 +0x71d
created by net/http.(*Server).Serve
/usr/lib/golang/src/net/http/server.go:2720 +0x288
goroutine 1 [select, 29 minutes]:
main.Main(0x10edddc)
/go/src/github.com/coreos/prometheus-operator/cmd/operator/main.go:185 +0x135c
main.main()
/go/src/github.com/coreos/prometheus-operator/cmd/operator/main.go:201 +0x22
goroutine 6 [syscall, 29 minutes]:
os/signal.signal_recv(0x0)
/usr/lib/golang/src/runtime/sigqueue.go:131 +0xa6
os/signal.loop()
/usr/lib/golang/src/os/signal/signal_unix.go:22 +0x22
created by os/signal.init.0
/usr/lib/golang/src/os/signal/signal_unix.go:28 +0x41
goroutine 9 [chan receive, 1 minutes]:
github.com/coreos/prometheus-operator/vendor/github.com/golang/glog.(*loggingT).flushDaemon(0x1eee460)
/go/src/github.com/coreos/prometheus-operator/vendor/github.com/golang/glog/glog.go:882 +0x9f
created by github.com/coreos/prometheus-operator/vendor/github.com/golang/glog.init.0
/go/src/github.com/coreos/prometheus-operator/vendor/github.com/golang/glog/glog.go:410 +0x203
goroutine 13 [select]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc42049eb40)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:206 +0x3ba
created by github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:54 +0x1e2
goroutine 14 [select]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc4201baaa0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:206 +0x3ba
created by github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:54 +0x1e2
goroutine 37 [chan receive, 29 minutes]:
github.com/coreos/prometheus-operator/pkg/prometheus.(*Operator).Run(0xc420161500, 0xc4203660c0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/pkg/prometheus/operator.go:357 +0x420
main.Main.func1(0xc400000008, 0x13e4ff8)
/go/src/github.com/coreos/prometheus-operator/cmd/operator/main.go:176 +0x46
github.com/coreos/prometheus-operator/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1(0xc4201cc100, 0xc4201472c0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/sync/errgroup/errgroup.go:58 +0x57
created by github.com/coreos/prometheus-operator/vendor/golang.org/x/sync/errgroup.(*Group).Go
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/sync/errgroup/errgroup.go:55 +0x66
goroutine 38 [chan receive, 29 minutes]:
github.com/coreos/prometheus-operator/pkg/alertmanager.(*Operator).Run(0xc4201010e0, 0xc4203660c0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/pkg/alertmanager/operator.go:202 +0x30b
main.Main.func2(0x8, 0x13e4ff8)
/go/src/github.com/coreos/prometheus-operator/cmd/operator/main.go:177 +0x46
github.com/coreos/prometheus-operator/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1(0xc4201cc100, 0xc4201472e0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/sync/errgroup/errgroup.go:58 +0x57
created by github.com/coreos/prometheus-operator/vendor/golang.org/x/sync/errgroup.(*Group).Go
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/sync/errgroup/errgroup.go:55 +0x66
goroutine 39 [IO wait]:
internal/poll.runtime_pollWait(0x7fbe9dceaf70, 0x72, 0xffffffffffffffff)
/usr/lib/golang/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc4203d5818, 0x72, 0xc4204bfd00, 0x0, 0x0)
/usr/lib/golang/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc4203d5818, 0xffffffffffffff00, 0x0, 0x0)
/usr/lib/golang/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Accept(0xc4203d5800, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/lib/golang/src/internal/poll/fd_unix.go:335 +0x1e2
net.(*netFD).accept(0xc4203d5800, 0xc4204bfec0, 0x401137, 0xc42014cee0)
/usr/lib/golang/src/net/fd_unix.go:238 +0x42
net.(*TCPListener).accept(0xc4201ce558, 0x6829f8, 0x459730, 0xc4204bff08)
/usr/lib/golang/src/net/tcpsock_posix.go:136 +0x2e
net.(*TCPListener).Accept(0xc4201ce558, 0x13e4858, 0xc42014ce60, 0x1e8c900, 0xc420413170)
/usr/lib/golang/src/net/tcpsock.go:247 +0x49
net/http.(*Server).Serve(0xc42003a4e0, 0x1e8b900, 0xc4201ce558, 0x0, 0x0)
/usr/lib/golang/src/net/http/server.go:2695 +0x1b2
created by main.Main
/go/src/github.com/coreos/prometheus-operator/cmd/operator/main.go:180 +0x11ca
goroutine 40 [select, 29 minutes, locked to thread]:
runtime.gopark(0x13e4ec0, 0x0, 0x135684b, 0x6, 0x18, 0x1)
/usr/lib/golang/src/runtime/proc.go:287 +0x12c
runtime.selectgo(0xc4204c8f50, 0xc420058de0)
/usr/lib/golang/src/runtime/select.go:395 +0x1149
runtime.ensureSigM.func1()
/usr/lib/golang/src/runtime/signal_unix.go:511 +0x220
runtime.goexit()
/usr/lib/golang/src/runtime/asm_amd64.s:2337 +0x1
goroutine 54 [semacquire, 1 minutes]:
sync.runtime_notifyListWait(0xc42004a250, 0xc40000001d)
/usr/lib/golang/src/runtime/sema.go:507 +0x110
sync.(*Cond).Wait(0xc42004a240)
/usr/lib/golang/src/sync/cond.go:56 +0x80
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/util/workqueue.(*Type).Get(0xc4201baa50, 0x0, 0x0, 0x11a9500)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/util/workqueue/queue.go:124 +0x95
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/util/workqueue.(*delayingType).Get(0xc4201baaa0, 0xc4201baaa0, 0x11a9500, 0xc4209f9830)
<autogenerated>:1 +0x3c
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/util/workqueue.(*rateLimitingType).Get(0xc4201ca720, 0x11a9500, 0xc4209f9830, 0x0)
<autogenerated>:1 +0x3c
github.com/coreos/prometheus-operator/pkg/alertmanager.(*Operator).processNextWorkItem(0xc4201010e0, 0x0)
/go/src/github.com/coreos/prometheus-operator/pkg/alertmanager/operator.go:265 +0x40
github.com/coreos/prometheus-operator/pkg/alertmanager.(*Operator).worker(0xc4201010e0)
/go/src/github.com/coreos/prometheus-operator/pkg/alertmanager/operator.go:260 +0x2b
created by github.com/coreos/prometheus-operator/pkg/alertmanager.(*Operator).Run
/go/src/github.com/coreos/prometheus-operator/pkg/alertmanager/operator.go:197 +0x27f
goroutine 88 [semacquire, 22 minutes]:
sync.runtime_notifyListWait(0xc4202d1090, 0xc40000000a)
/usr/lib/golang/src/runtime/sema.go:507 +0x110
sync.(*Cond).Wait(0xc4202d1080)
/usr/lib/golang/src/sync/cond.go:56 +0x80
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/util/workqueue.(*Type).Get(0xc42049eaf0, 0x0, 0x0, 0x11a9500)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/util/workqueue/queue.go:124 +0x95
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/util/workqueue.(*delayingType).Get(0xc42049eb40, 0xc42049eb40, 0x11a9500, 0xc4208198c0)
<autogenerated>:1 +0x3c
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/util/workqueue.(*rateLimitingType).Get(0xc42018ad00, 0x11a9500, 0xc4208198c0, 0x0)
<autogenerated>:1 +0x3c
github.com/coreos/prometheus-operator/pkg/prometheus.(*Operator).processNextWorkItem(0xc420161500, 0x0)
/go/src/github.com/coreos/prometheus-operator/pkg/prometheus/operator.go:803 +0x46
github.com/coreos/prometheus-operator/pkg/prometheus.(*Operator).worker(0xc420161500)
/go/src/github.com/coreos/prometheus-operator/pkg/prometheus/operator.go:798 +0x2b
created by github.com/coreos/prometheus-operator/pkg/prometheus.(*Operator).Run
/go/src/github.com/coreos/prometheus-operator/pkg/prometheus/operator.go:341 +0x285
goroutine 113 [select, 4 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc42048e3c0, 0x1e7dd40, 0xc420a5f830, 0xc420fbdb78, 0xc4203414a0, 0xc4203660c0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x288
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc42048e3c0, 0xc4203660c0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:339 +0xffc
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:204 +0x33
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc420fb1f18)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc420fbdf18, 0x3b9aca00, 0x0, 0xc42040e201, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc420025f18, 0x3b9aca00, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run(0xc42048e3c0, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:203 +0x164
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run-fm(0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:122 +0x34
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0x31
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc42003e180, 0xc4204b6320)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 71 [select, 1 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc42048e320, 0x1e7dd40, 0xc4201bfcb0, 0xc420b39b78, 0xc4203cec60, 0xc4203660c0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x288
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc42048e320, 0xc4203660c0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:339 +0xffc
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:204 +0x33
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc420aa7f18)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc420b39f18, 0x3b9aca00, 0x0, 0xc4202ad701, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc420aa7f18, 0x3b9aca00, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run(0xc42048e320, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:203 +0x164
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run-fm(0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:122 +0x34
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0x31
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4208d1a40, 0xc42018bf60)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 69 [chan receive, 29 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc4202cdce0, 0xc420968660)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:425 +0x46
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedProcessor).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.run)-fm(0xc420968660)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:220 +0x34
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0x31
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4208d1a20, 0xc42018bf00)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 115 [select, 4 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).pop(0xc4202a8400)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:517 +0x190
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.pop)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:391 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4202c5020, 0xc42040e460)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 70 [chan receive, 29 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc4203660c0, 0xc42066b480)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:103 +0x34
created by github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:102 +0x9c
goroutine 26 [IO wait]:
internal/poll.runtime_pollWait(0x7fbe9dceadf0, 0x72, 0x0)
/usr/lib/golang/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc42041a198, 0x72, 0xffffffffffffff00, 0x1e77f80, 0x1e714c0)
/usr/lib/golang/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc42041a198, 0xc4207c0000, 0x8000, 0x8000)
/usr/lib/golang/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc42041a180, 0xc4207c0000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
/usr/lib/golang/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc42041a180, 0xc4207c0000, 0x8000, 0x8000, 0xc8b, 0x0, 0x0)
/usr/lib/golang/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42000c060, 0xc4207c0000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
/usr/lib/golang/src/net/net.go:176 +0x6d
crypto/tls.(*block).readFromUntil(0xc42046e330, 0x7fbe9dcf8de8, 0xc42000c060, 0x5, 0xc42000c060, 0x0)
/usr/lib/golang/src/crypto/tls/conn.go:488 +0x95
crypto/tls.(*Conn).readRecord(0xc4202d2000, 0x13e4f17, 0xc4202d2120, 0x20)
/usr/lib/golang/src/crypto/tls/conn.go:590 +0xe0
crypto/tls.(*Conn).Read(0xc4202d2000, 0xc420511000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/lib/golang/src/crypto/tls/conn.go:1134 +0x110
bufio.(*Reader).Read(0xc420409020, 0xc420216578, 0x9, 0x9, 0x81d273, 0x1183260, 0x42dbfb)
/usr/lib/golang/src/bufio/bufio.go:213 +0x30b
io.ReadAtLeast(0x1e72d40, 0xc420409020, 0xc420216578, 0x9, 0x9, 0x9, 0x42b176, 0x13e4fd8, 0xc4204cfcf0)
/usr/lib/golang/src/io/io.go:309 +0x86
io.ReadFull(0x1e72d40, 0xc420409020, 0xc420216578, 0x9, 0x9, 0x82721c, 0xc4208ce028, 0xc420808000)
/usr/lib/golang/src/io/io.go:327 +0x58
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.readFrameHeader(0xc420216578, 0x9, 0x9, 0x1e72d40, 0xc420409020, 0x0, 0x0, 0xc6d, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/frame.go:237 +0x7b
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc420216540, 0xc420bdc3c0, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/frame.go:492 +0xa4
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.(*clientConnReadLoop).run(0xc4204cffb8, 0x13e3e90, 0xc420025fb8)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/transport.go:1477 +0x90
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.(*ClientConn).readLoop(0xc4203e0000)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/transport.go:1405 +0x68
created by github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.(*Transport).newClientConn
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/transport.go:592 +0x6c4
goroutine 55 [semacquire, 1 minutes]:
sync.runtime_notifyListWait(0xc4203de5a8, 0x18)
/usr/lib/golang/src/runtime/sema.go:507 +0x110
sync.(*Cond).Wait(0xc4203de598)
/usr/lib/golang/src/sync/cond.go:56 +0x80
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc4203de580, 0xc4202ad670, 0x0, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:431 +0xb6
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).processLoop(0xc42066b480)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:150 +0x40
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.processLoop)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:124 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc4204beec8)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc4204beec8, 0x3b9aca00, 0x0, 0xc4204bee01, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc4204beec8, 0x3b9aca00, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run(0xc42066b480, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:124 +0x2b7
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc42014e990, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:227 +0x49f
created by github.com/coreos/prometheus-operator/pkg/alertmanager.(*Operator).Run
/go/src/github.com/coreos/prometheus-operator/pkg/alertmanager/operator.go:199 +0x2b8
goroutine 56 [semacquire, 2 minutes]:
sync.runtime_notifyListWait(0xc42008abd8, 0xf)
/usr/lib/golang/src/runtime/sema.go:507 +0x110
sync.(*Cond).Wait(0xc42008abc8)
/usr/lib/golang/src/sync/cond.go:56 +0x80
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc42008abb0, 0xc4201c8d90, 0x0, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:431 +0xb6
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).processLoop(0xc4204c7500)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:150 +0x40
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.processLoop)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:124 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc4204c2ec8)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc4204c2ec8, 0x3b9aca00, 0x0, 0xc4204c2e01, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc4204c2ec8, 0x3b9aca00, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run(0xc4204c7500, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:124 +0x2b7
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc42014ea20, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:227 +0x49f
created by github.com/coreos/prometheus-operator/pkg/alertmanager.(*Operator).Run
/go/src/github.com/coreos/prometheus-operator/pkg/alertmanager/operator.go:200 +0x2f1
goroutine 58 [chan receive, 29 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc4202cdd50, 0xc420366c00)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:425 +0x46
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedProcessor).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.run)-fm(0xc420366c00)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:220 +0x34
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0x31
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4205c5a40, 0xc42036cf40)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 59 [chan receive, 29 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc4203660c0, 0xc4204c7500)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:103 +0x34
created by github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:102 +0x9c
goroutine 60 [select, 2 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc420075360, 0x1e7dd40, 0xc420bc48d0, 0xc420139b78, 0xc4203ce8a0, 0xc4203660c0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x288
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc420075360, 0xc4203660c0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:339 +0xffc
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:204 +0x33
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc420805f18)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc420139f18, 0x3b9aca00, 0x0, 0xc4201c8d01, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc42001ef18, 0x3b9aca00, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run(0xc420075360, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:203 +0x164
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run-fm(0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:122 +0x34
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0x31
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4205c5a60, 0xc42036cf80)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 61 [chan receive, 2 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0xc42049e730, 0xc4203660c0, 0xc420019300)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:549 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0xc4206acdf0, 0x18, 0x83fbb0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:203 +0x9c
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:548 +0x81
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc42001ef68)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc4206acf68, 0xdf8475800, 0x0, 0x11e3101, 0xc420366de0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc42001ef68, 0xdf8475800, 0xc420366de0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run(0xc420380680)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:546 +0x78
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.run)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:390 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4202cddb0, 0xc4201c8fd0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 62 [select, 2 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).pop(0xc420380680)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:517 +0x190
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.pop)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:391 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4202cddb0, 0xc4201c8fe0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 63 [chan receive, 1 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0xc42049e7d0, 0x0, 0xc420019300)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:549 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0xc420a4edf0, 0x18, 0x83fbb0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:203 +0x9c
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:548 +0x81
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc420586768)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc420a4ef68, 0xdf8475800, 0x0, 0x11e3101, 0xc420366e40)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc420586768, 0xdf8475800, 0xc420366e40)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run(0xc420380480)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:546 +0x78
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.run)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:390 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4202cdd40, 0xc4201c8ff0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 64 [select, 1 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).pop(0xc420380480)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:517 +0x190
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.pop)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:391 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4202cdd40, 0xc4201c9000)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 82 [select, 5 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func1(0xc42048e320, 0xc4203660c0, 0xc420366ea0, 0xc4203cec60)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:278 +0x190
created by github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:272 +0xa2c
goroutine 80 [chan receive, 29 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc4203660c0, 0xc4204c6300)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:103 +0x34
created by github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:102 +0x9c
goroutine 114 [chan receive, 4 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0xc4202aa4b0, 0x13336e0, 0xc420018000)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:549 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0xc420770df0, 0x18, 0x83fbb0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:203 +0x9c
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:548 +0x81
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc420aa4768)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc420770f68, 0xdf8475800, 0x0, 0x11e3101, 0xc420059140)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc420aa4768, 0xdf8475800, 0xc420059140)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run(0xc4202a8400)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:546 +0x78
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.run)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:390 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4202c5020, 0xc42040e450)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 79 [chan receive, 29 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc4202c4fc0, 0xc420058540)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:425 +0x46
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedProcessor).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.run)-fm(0xc420058540)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:220 +0x34
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0x31
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc42003e160, 0xc4204b6300)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 89 [semacquire]:
sync.runtime_notifyListWait(0xc42008a4f8, 0x1a)
/usr/lib/golang/src/runtime/sema.go:507 +0x110
sync.(*Cond).Wait(0xc42008a4e8)
/usr/lib/golang/src/sync/cond.go:56 +0x80
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc42008a4d0, 0xc4209a8d20, 0x0, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:431 +0xb6
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).processLoop(0xc42099da80)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:150 +0x40
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.processLoop)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:124 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc4204caec8)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc4204caec8, 0x3b9aca00, 0x0, 0xc4204cae01, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc4204caec8, 0x3b9aca00, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run(0xc42099da80, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:124 +0x2b7
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc42014e5a0, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:227 +0x49f
created by github.com/coreos/prometheus-operator/pkg/prometheus.(*Operator).Run
/go/src/github.com/coreos/prometheus-operator/pkg/prometheus/operator.go:343 +0x2be
goroutine 90 [semacquire, 1 minutes]:
sync.runtime_notifyListWait(0xc42008a5a8, 0x55)
/usr/lib/golang/src/runtime/sema.go:507 +0x110
sync.(*Cond).Wait(0xc42008a598)
/usr/lib/golang/src/sync/cond.go:56 +0x80
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc42008a580, 0xc4209a8ea0, 0x0, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:431 +0xb6
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).processLoop(0xc4206d2000)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:150 +0x40
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.processLoop)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:124 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc4204cbec8)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc4204cbec8, 0x3b9aca00, 0x0, 0xc4204cbe01, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc4204cbec8, 0x3b9aca00, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run(0xc4206d2000, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:124 +0x2b7
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc42014e630, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:227 +0x49f
created by github.com/coreos/prometheus-operator/pkg/prometheus.(*Operator).Run
/go/src/github.com/coreos/prometheus-operator/pkg/prometheus/operator.go:344 +0x2f7
goroutine 91 [semacquire, 1 minutes]:
sync.runtime_notifyListWait(0xc42008a658, 0x19)
/usr/lib/golang/src/runtime/sema.go:507 +0x110
sync.(*Cond).Wait(0xc42008a648)
/usr/lib/golang/src/sync/cond.go:56 +0x80
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc42008a630, 0xc4209a9040, 0x0, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:431 +0xb6
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).processLoop(0xc4206d2600)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:150 +0x40
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.processLoop)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:124 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc420a4aec8)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc420a4aec8, 0x3b9aca00, 0x0, 0xc420a4ae01, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc420a4aec8, 0x3b9aca00, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run(0xc4206d2600, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:124 +0x2b7
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc42014e6c0, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:227 +0x49f
created by github.com/coreos/prometheus-operator/pkg/prometheus.(*Operator).Run
/go/src/github.com/coreos/prometheus-operator/pkg/prometheus/operator.go:345 +0x330
goroutine 92 [semacquire, 4 minutes]:
sync.runtime_notifyListWait(0xc4203de028, 0xe)
/usr/lib/golang/src/runtime/sema.go:507 +0x110
sync.(*Cond).Wait(0xc4203de018)
/usr/lib/golang/src/sync/cond.go:56 +0x80
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc4203de000, 0xc42040e1e0, 0x0, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:431 +0xb6
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).processLoop(0xc4204c6300)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:150 +0x40
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.processLoop)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:124 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc4204c1ec8)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc4204c1ec8, 0x3b9aca00, 0x0, 0xc4204c1e01, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc4204c1ec8, 0x3b9aca00, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run(0xc4204c6300, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:124 +0x2b7
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc42014e750, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:227 +0x49f
created by github.com/coreos/prometheus-operator/pkg/prometheus.(*Operator).Run
/go/src/github.com/coreos/prometheus-operator/pkg/prometheus/operator.go:346 +0x369
goroutine 93 [semacquire, 4 minutes]:
sync.runtime_notifyListWait(0xc42008a708, 0x24)
/usr/lib/golang/src/runtime/sema.go:507 +0x110
sync.(*Cond).Wait(0xc42008a6f8)
/usr/lib/golang/src/sync/cond.go:56 +0x80
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc42008a6e0, 0xc4209a91e0, 0x0, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:431 +0xb6
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).processLoop(0xc4206d2a80)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:150 +0x40
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.processLoop)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:124 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc420a48ec8)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc420a48ec8, 0x3b9aca00, 0x0, 0xc420a48e01, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc420a48ec8, 0x3b9aca00, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run(0xc4206d2a80, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:124 +0x2b7
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc42014e7e0, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:227 +0x49f
created by github.com/coreos/prometheus-operator/pkg/prometheus.(*Operator).Run
/go/src/github.com/coreos/prometheus-operator/pkg/prometheus/operator.go:347 +0x3a8
goroutine 94 [semacquire, 3 minutes]:
sync.runtime_notifyListWait(0xc4203de188, 0xf)
/usr/lib/golang/src/runtime/sema.go:507 +0x110
sync.(*Cond).Wait(0xc4203de178)
/usr/lib/golang/src/sync/cond.go:56 +0x80
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc4203de160, 0xc42040e480, 0x0, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:431 +0xb6
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).processLoop(0xc4204c6700)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:150 +0x40
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.processLoop)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:124 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc420a4fec8)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc420a4fec8, 0x3b9aca00, 0x0, 0xc420a4fe01, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc420a4fec8, 0x3b9aca00, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run(0xc4204c6700, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:124 +0x2b7
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc42014e870, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:227 +0x49f
created by github.com/coreos/prometheus-operator/pkg/prometheus.(*Operator).Run
/go/src/github.com/coreos/prometheus-operator/pkg/prometheus/operator.go:348 +0x3e7
goroutine 95 [select, 2 minutes]:
github.com/coreos/prometheus-operator/pkg/prometheus.(*Operator).reconcileNodeEndpoints(0xc420161500, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/pkg/prometheus/operator.go:411 +0x11d
created by github.com/coreos/prometheus-operator/pkg/prometheus.(*Operator).Run
/go/src/github.com/coreos/prometheus-operator/pkg/prometheus/operator.go:354 +0x478
goroutine 136 [chan receive, 3 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0xc42049f860, 0x0, 0xc420019300)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:549 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0xc420812df0, 0x18, 0x83fbb0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:203 +0x9c
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:548 +0x81
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc420581f68)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc420812f68, 0xdf8475800, 0x0, 0x11e3101, 0xc420a3bc80)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc420581f68, 0xdf8475800, 0xc420a3bc80)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run(0xc4202a8680)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:546 +0x78
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.run)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:390 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4202c5170, 0xc4209a9620)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 97 [chan receive, 29 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc4202c4e70, 0xc420a3b0e0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:425 +0x46
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedProcessor).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.run)-fm(0xc420a3b0e0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:220 +0x34
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0x31
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc420862db0, 0xc42040c260)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 98 [chan receive, 29 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc4203660c0, 0xc42099da80)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:103 +0x34
created by github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:102 +0x9c
goroutine 99 [select]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc420075860, 0x1e7dd40, 0xc420bdc390, 0xc420b37b78, 0xc4203ce540, 0xc4203660c0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x288
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc420075860, 0xc4203660c0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:339 +0xffc
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:204 +0x33
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc420587718)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc420b37f18, 0x3b9aca00, 0x0, 0xc4209a8d01, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc420587718, 0x3b9aca00, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run(0xc420075860, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:203 +0x164
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run-fm(0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:122 +0x34
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0x31
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc420862dd0, 0xc42040c2c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 108 [chan receive, 1 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0xc42049f4a0, 0xc4203660c0, 0xc420019300)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:549 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0xc420a4ddf0, 0x18, 0x83fbb0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:203 +0x9c
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:548 +0x81
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc420587768)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc420a4df68, 0xdf8475800, 0x0, 0x11e3101, 0xc420a3b8c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc420587768, 0xdf8475800, 0xc420a3b8c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run(0xc4202a8200)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:546 +0x78
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.run)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:390 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4202c4f40, 0xc4209a9160)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 101 [chan receive, 29 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc4202c4ee0, 0xc420a3b380)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:425 +0x46
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedProcessor).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.run)-fm(0xc420a3b380)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:220 +0x34
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0x31
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc420862e20, 0xc42040c3e0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 102 [chan receive, 29 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc4203660c0, 0xc4206d2000)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:103 +0x34
created by github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:102 +0x9c
goroutine 103 [select, 1 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc420075d60, 0x1e7dd40, 0xc42091b200, 0xc4208bdb78, 0xc4203ce780, 0xc4203660c0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x288
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc420075d60, 0xc4203660c0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:339 +0xffc
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:204 +0x33
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc420587f18)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc4208bdf18, 0x3b9aca00, 0x0, 0xc4209a8e01, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc420587f18, 0x3b9aca00, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run(0xc420075d60, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:203 +0x164
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run-fm(0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:122 +0x34
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0x31
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc420862e40, 0xc42040c400)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 110 [chan receive, 1 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0xc42049f4f0, 0xc4203660c0, 0xc420019300)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:549 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0xc420814df0, 0x18, 0x83fbb0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:203 +0x9c
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:548 +0x81
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc420587f68)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc420814f68, 0xdf8475800, 0x0, 0x11e3101, 0xc420a3b920)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc420587f68, 0xdf8475800, 0xc420a3b920)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run(0xc4202a8380)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:546 +0x78
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.run)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:390 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4202c4fb0, 0xc4209a9180)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 105 [chan receive, 29 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc4202c4f50, 0xc420a3b620)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:425 +0x46
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedProcessor).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.run)-fm(0xc420a3b620)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:220 +0x34
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0x31
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc420862ea0, 0xc42040c560)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 106 [chan receive, 29 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc4203660c0, 0xc4206d2600)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:103 +0x34
created by github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:102 +0x9c
goroutine 107 [select, 1 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc42014c280, 0x1e7dd40, 0xc420a5f3b0, 0xc420fb9b78, 0xc42025a7e0, 0xc4203660c0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x288
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc42014c280, 0xc4203660c0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:339 +0xffc
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:204 +0x33
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc420aa7f18)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc420fb9f18, 0x3b9aca00, 0x0, 0xc4209a9001, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc420aa7f18, 0x3b9aca00, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run(0xc42014c280, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:203 +0x164
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run-fm(0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:122 +0x34
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0x31
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc420862ec0, 0xc42040c580)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 109 [select, 1 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).pop(0xc4202a8200)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:517 +0x190
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.pop)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:391 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4202c4f40, 0xc4209a9170)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 111 [select, 1 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).pop(0xc4202a8380)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:517 +0x190
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.pop)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:391 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4202c4fb0, 0xc4209a9190)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 112 [chan receive]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0xc4202aa550, 0xc4203660c0, 0xc420018000)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:549 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0xc420813df0, 0x18, 0x83fbb0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:203 +0x9c
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:548 +0x81
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc420587f68)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc420813f68, 0xdf8475800, 0x0, 0x11e3101, 0xc4200591a0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc420587f68, 0xdf8475800, 0xc4200591a0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run(0xc4202a8180)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:546 +0x78
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.run)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:390 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4202c4ed0, 0xc4209a91a0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 129 [select]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).pop(0xc4202a8180)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:517 +0x190
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.pop)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:391 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4202c4ed0, 0xc4209a91c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 134 [chan receive, 4 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run.func1.1(0xc42049f7c0, 0xc420587748, 0xc420019300)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:549 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.ExponentialBackoff(0x989680, 0x3ff0000000000000, 0x3fb999999999999a, 0x5, 0xc420810df0, 0x18, 0x83fbb0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:203 +0x9c
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:548 +0x81
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc420587768)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc420810f68, 0xdf8475800, 0x0, 0x11e3101, 0xc420a3bc20)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc420587768, 0xdf8475800, 0xc420a3bc20)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).run(0xc4202a8580)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:546 +0x78
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.run)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:390 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4202c5090, 0xc4209a9600)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 131 [chan receive, 29 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc4202c5030, 0xc420a3b980)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:425 +0x46
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedProcessor).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.run)-fm(0xc420a3b980)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:220 +0x34
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0x31
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc420862f20, 0xc42040c800)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 132 [chan receive, 29 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc4203660c0, 0xc4206d2a80)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:103 +0x34
created by github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:102 +0x9c
goroutine 133 [select, 4 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc42014c780, 0x1e7dd40, 0xc420bc4210, 0xc420b35b78, 0xc42031da40, 0xc4203660c0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x288
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc42014c780, 0xc4203660c0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:339 +0xffc
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:204 +0x33
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc420fb5f18)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc420b35f18, 0x3b9aca00, 0x0, 0xc4209a9201, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc420aa2f18, 0x3b9aca00, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run(0xc42014c780, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:203 +0x164
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run-fm(0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:122 +0x34
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0x31
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc420862f40, 0xc42040c840)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 137 [select, 3 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).pop(0xc4202a8680)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:517 +0x190
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.pop)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:391 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4202c5170, 0xc4209a9660)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 117 [chan receive, 29 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc4202c5110, 0xc420059200)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:425 +0x46
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*sharedProcessor).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.run)-fm(0xc420059200)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:220 +0x34
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0x31
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc42003e2a0, 0xc4204b6600)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 118 [chan receive, 29 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc4203660c0, 0xc4204c6700)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:103 +0x34
created by github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*controller).Run
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:102 +0x9c
goroutine 135 [select, 4 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).pop(0xc4202a8580)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:517 +0x190
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*processorListener).(github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.pop)-fm()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/shared_informer.go:391 +0x2a
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc4202c5090, 0xc4209a9610)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 119 [select, 7 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc42048e460, 0x1e7dd40, 0xc4201be3c0, 0xc420fbfb78, 0xc4203311a0, 0xc4203660c0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x288
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc42048e460, 0xc4203660c0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:339 +0xffc
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:204 +0x33
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc420611f18)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x5e
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc420fbff18, 0x3b9aca00, 0x0, 0xc42040e501, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134 +0xbd
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc420aa3718, 0x3b9aca00, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88 +0x4d
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run(0xc42048e460, 0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:203 +0x164
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).Run-fm(0xc4203660c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/controller.go:122 +0x34
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0x31
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc42003e2c0, 0xc4204b6660)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x4f
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0x62
goroutine 121 [select, 4 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func1(0xc420075860, 0xc4203660c0, 0xc420059500, 0xc4203ce540)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:278 +0x190
created by github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:272 +0xa2c
goroutine 122 [select, 4 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func1(0xc420075d60, 0xc4203660c0, 0xc4200596e0, 0xc4203ce780)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:278 +0x190
created by github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:272 +0xa2c
goroutine 143 [select, 4 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func1(0xc42014c280, 0xc4203660c0, 0xc420a3bda0, 0xc42025a7e0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:278 +0x190
created by github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:272 +0xa2c
goroutine 1728 [semacquire, 1 minutes]:
sync.runtime_notifyListWait(0xc42015e040, 0xc400000001)
/usr/lib/golang/src/runtime/sema.go:507 +0x110
sync.(*Cond).Wait(0xc42015e030)
/usr/lib/golang/src/sync/cond.go:56 +0x80
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.(*pipe).Read(0xc42015e028, 0xc42074b001, 0xdff, 0xdff, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/pipe.go:64 +0x9c
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.transportResponseBody.Read(0xc42015e000, 0xc42074b001, 0xdff, 0xdff, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/transport.go:1739 +0xb1
encoding/json.(*Decoder).refill(0xc4206d8a80, 0x123ae0a, 0x9)
/usr/lib/golang/src/encoding/json/stream.go:152 +0x114
encoding/json.(*Decoder).readValue(0xc4206d8a80, 0x0, 0x0, 0x411408)
/usr/lib/golang/src/encoding/json/stream.go:128 +0x275
encoding/json.(*Decoder).Decode(0xc4206d8a80, 0x1175180, 0xc4205ef180, 0x1, 0x8404fe)
/usr/lib/golang/src/encoding/json/stream.go:57 +0x78
github.com/coreos/prometheus-operator/pkg/client/monitoring/v1.(*alertmanagerDecoder).Decode(0xc4204780e0, 0xc420fb5fa8, 0x5, 0x1e78f40, 0xc42014b190, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/pkg/client/monitoring/v1/alertmanager.go:212 +0x5d
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc4201bfcb0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:93 +0x138
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xb4
goroutine 1586 [select, 4 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func1(0xc42048e3c0, 0xc4203660c0, 0xc4209e4840, 0xc4203414a0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:278 +0x190
created by github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:272 +0xa2c
goroutine 1665 [select, 2 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func1(0xc420075360, 0xc4203660c0, 0xc420059560, 0xc4203ce8a0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:278 +0x190
created by github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:272 +0xa2c
goroutine 1800 [semacquire]:
sync.runtime_notifyListWait(0xc4208ce040, 0xc400000001)
/usr/lib/golang/src/runtime/sema.go:507 +0x110
sync.(*Cond).Wait(0xc4208ce030)
/usr/lib/golang/src/sync/cond.go:56 +0x80
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.(*pipe).Read(0xc4208ce028, 0xc420698001, 0xdff, 0xdff, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/pipe.go:64 +0x9c
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.transportResponseBody.Read(0xc4208ce000, 0xc420698001, 0xdff, 0xdff, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/transport.go:1739 +0xb1
encoding/json.(*Decoder).refill(0xc4206e61c0, 0x123ae0a, 0x9)
/usr/lib/golang/src/encoding/json/stream.go:152 +0x114
encoding/json.(*Decoder).readValue(0xc4206e61c0, 0x0, 0x0, 0x411408)
/usr/lib/golang/src/encoding/json/stream.go:128 +0x275
encoding/json.(*Decoder).Decode(0xc4206e61c0, 0x11751c0, 0xc42099ac00, 0x1, 0x8404fe)
/usr/lib/golang/src/encoding/json/stream.go:57 +0x78
github.com/coreos/prometheus-operator/pkg/client/monitoring/v1.(*prometheusDecoder).Decode(0xc4209a8140, 0xc4209d1fa8, 0x5, 0x1e79000, 0xc42099a610, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/pkg/client/monitoring/v1/prometheus.go:211 +0x5d
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc420bdc390)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:93 +0x138
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xb4
goroutine 630 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0x7fbe9dceaaf0, 0x72, 0x0)
/usr/lib/golang/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc4205a2418, 0x72, 0xffffffffffffff00, 0x1e77f80, 0x1e714c0)
/usr/lib/golang/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc4205a2418, 0xc420874000, 0x1000, 0x1000)
/usr/lib/golang/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc4205a2400, 0xc420874000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/lib/golang/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc4205a2400, 0xc420874000, 0x1000, 0x1000, 0xc4208b78c8, 0x678dba, 0xc42091a338)
/usr/lib/golang/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc420a32ca8, 0xc420874000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/lib/golang/src/net/net.go:176 +0x6d
net/http.(*connReader).Read(0xc42091a330, 0xc420874000, 0x1000, 0x1000, 0xc4207f78c0, 0x1e71034, 0x2)
/usr/lib/golang/src/net/http/server.go:753 +0x105
bufio.(*Reader).fill(0xc42031d200)
/usr/lib/golang/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).ReadSlice(0xc42031d200, 0xc4208b7a0a, 0x410816, 0x7fbe9dc96688, 0x8, 0xc4208b7a48, 0x4341e4)
/usr/lib/golang/src/bufio/bufio.go:338 +0x2c
bufio.(*Reader).ReadLine(0xc42031d200, 0x100, 0xf8, 0x13272c0, 0xc4208b7a01, 0x1220000402299, 0xf8)
/usr/lib/golang/src/bufio/bufio.go:367 +0x34
net/textproto.(*Reader).readLineSlice(0xc420bdc000, 0xc4208b7b20, 0xc4208b7b20, 0x411408, 0x100, 0x13272c0)
/usr/lib/golang/src/net/textproto/reader.go:55 +0x70
net/textproto.(*Reader).ReadLine(0xc420bdc000, 0xc42027c800, 0x0, 0xc4208b7b90, 0x496212)
/usr/lib/golang/src/net/textproto/reader.go:36 +0x2b
net/http.readRequest(0xc42031d200, 0x0, 0xc42027c800, 0x0, 0x0)
/usr/lib/golang/src/net/http/request.go:925 +0x99
net/http.(*conn).readRequest(0xc42014cb40, 0x1e8c840, 0xc4207f7780, 0x0, 0x0, 0x0)
/usr/lib/golang/src/net/http/server.go:933 +0x17c
net/http.(*conn).serve(0xc42014cb40, 0x1e8c840, 0xc4207f7780)
/usr/lib/golang/src/net/http/server.go:1739 +0x50e
created by net/http.(*Server).Serve
/usr/lib/golang/src/net/http/server.go:2720 +0x288
goroutine 1747 [semacquire, 1 minutes]:
sync.runtime_notifyListWait(0xc420096540, 0xc400000001)
/usr/lib/golang/src/runtime/sema.go:507 +0x110
sync.(*Cond).Wait(0xc420096530)
/usr/lib/golang/src/sync/cond.go:56 +0x80
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.(*pipe).Read(0xc420096528, 0xc420ae6001, 0xfdff, 0xfdff, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/pipe.go:64 +0x9c
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.transportResponseBody.Read(0xc420096500, 0xc420ae6001, 0xfdff, 0xfdff, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/transport.go:1739 +0xb1
encoding/json.(*Decoder).refill(0xc4206d8000, 0x123af0a, 0x9)
/usr/lib/golang/src/encoding/json/stream.go:152 +0x114
encoding/json.(*Decoder).readValue(0xc4206d8000, 0x0, 0x0, 0x411408)
/usr/lib/golang/src/encoding/json/stream.go:128 +0x275
encoding/json.(*Decoder).Decode(0xc4206d8000, 0x1175200, 0xc4208cfb80, 0x1, 0x8404fe)
/usr/lib/golang/src/encoding/json/stream.go:57 +0x78
github.com/coreos/prometheus-operator/pkg/client/monitoring/v1.(*prometheusRuleDecoder).Decode(0xc4205b1750, 0xc420323fa8, 0x5, 0x1e79080, 0xc420096650, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/pkg/client/monitoring/v1/prometheusrule.go:196 +0x5d
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc420a5f3b0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:93 +0x138
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xb4
goroutine 1384 [semacquire, 7 minutes]:
sync.runtime_notifyListWait(0xc42032da80, 0xc400000000)
/usr/lib/golang/src/runtime/sema.go:507 +0x110
sync.(*Cond).Wait(0xc42032da70)
/usr/lib/golang/src/sync/cond.go:56 +0x80
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.(*pipe).Read(0xc42032da68, 0xc420916400, 0x200, 0x200, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/pipe.go:64 +0x9c
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.transportResponseBody.Read(0xc42032da40, 0xc420916400, 0x200, 0x200, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/transport.go:1739 +0xb1
encoding/json.(*Decoder).refill(0xc4206e6700, 0x11f0e20, 0xc420019300)
/usr/lib/golang/src/encoding/json/stream.go:152 +0x114
encoding/json.(*Decoder).readValue(0xc4206e6700, 0x0, 0x0, 0x411408)
/usr/lib/golang/src/encoding/json/stream.go:128 +0x275
encoding/json.(*Decoder).Decode(0xc4206e6700, 0x12091c0, 0xc42036d440, 0xc4206d8218, 0x0)
/usr/lib/golang/src/encoding/json/stream.go:57 +0x78
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc4201be390, 0xc4203da000, 0x400, 0x400, 0x40, 0x38, 0x124ba40)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:150 +0x2c8
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc4201bba90, 0x0, 0x1e7d7c0, 0xc4207f6c80, 0x0, 0x327, 0xc4206d81e8, 0xc420025f20, 0x42a7d9)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0x95
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc42036d2c0, 0x13e43e0, 0x0, 0x0, 0x0, 0xc420331378, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0x7c
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc4201be3c0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:93 +0x138
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xb4
goroutine 1778 [semacquire, 1 minutes]:
sync.runtime_notifyListWait(0xc42032c680, 0xc400000003)
/usr/lib/golang/src/runtime/sema.go:507 +0x110
sync.(*Cond).Wait(0xc42032c670)
/usr/lib/golang/src/sync/cond.go:56 +0x80
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.(*pipe).Read(0xc42032c668, 0xc4206b9801, 0x5ff, 0x5ff, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/pipe.go:64 +0x9c
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.transportResponseBody.Read(0xc42032c640, 0xc4206b9801, 0x5ff, 0x5ff, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/transport.go:1739 +0xb1
encoding/json.(*Decoder).refill(0xc4206e6000, 0x123af0a, 0x9)
/usr/lib/golang/src/encoding/json/stream.go:152 +0x114
encoding/json.(*Decoder).readValue(0xc4206e6000, 0x0, 0x0, 0x411408)
/usr/lib/golang/src/encoding/json/stream.go:128 +0x275
encoding/json.(*Decoder).Decode(0xc4206e6000, 0x1175240, 0xc4201e3d40, 0x1, 0x8404fe)
/usr/lib/golang/src/encoding/json/stream.go:57 +0x78
github.com/coreos/prometheus-operator/pkg/client/monitoring/v1.(*serviceMonitorDecoder).Decode(0xc4209f9e80, 0xc4208bbfa8, 0x5, 0x1e79100, 0xc4201e3bb0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/pkg/client/monitoring/v1/servicemonitor.go:196 +0x5d
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc42091b200)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:93 +0x138
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xb4
goroutine 736 [IO wait]:
internal/poll.runtime_pollWait(0x7fbe9dceaeb0, 0x72, 0x0)
/usr/lib/golang/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc4205a3a18, 0x72, 0xffffffffffffff00, 0x1e77f80, 0x1e714c0)
/usr/lib/golang/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc4205a3a18, 0xc4203e4000, 0x1000, 0x1000)
/usr/lib/golang/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc4205a3a00, 0xc4203e4000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/lib/golang/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc4205a3a00, 0xc4203e4000, 0x1000, 0x1000, 0xc4201358c8, 0x678dba, 0xc42091b0e8)
/usr/lib/golang/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc4201cea50, 0xc4203e4000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/lib/golang/src/net/net.go:176 +0x6d
net/http.(*connReader).Read(0xc42091b0e0, 0xc4203e4000, 0x1000, 0x1000, 0x4572b0, 0xc420026800, 0xc420476480)
/usr/lib/golang/src/net/http/server.go:753 +0x105
bufio.(*Reader).fill(0xc42031dda0)
/usr/lib/golang/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).ReadSlice(0xc42031dda0, 0xc420b3d70a, 0x7fbe9dd2642f, 0xc420135a08, 0x7b, 0xc420135ab8, 0xc420135a48)
/usr/lib/golang/src/bufio/bufio.go:338 +0x2c
bufio.(*Reader).ReadLine(0xc42031dda0, 0x100, 0xf8, 0x13272c0, 0x411cd6, 0x220020135a90, 0xf8)
/usr/lib/golang/src/bufio/bufio.go:367 +0x34
net/textproto.(*Reader).readLineSlice(0xc420b3d710, 0xc420135b20, 0xc420135b20, 0x411408, 0x100, 0x13272c0)
/usr/lib/golang/src/net/textproto/reader.go:55 +0x70
net/textproto.(*Reader).ReadLine(0xc420b3d710, 0xc4200fb000, 0x0, 0xc420135b90, 0x496212)
/usr/lib/golang/src/net/textproto/reader.go:36 +0x2b
net/http.readRequest(0xc42031dda0, 0x0, 0xc4200fb000, 0x0, 0x0)
/usr/lib/golang/src/net/http/request.go:925 +0x99
net/http.(*conn).readRequest(0xc42014dcc0, 0x1e8c840, 0xc42044cb80, 0x0, 0x0, 0x0)
/usr/lib/golang/src/net/http/server.go:933 +0x17c
net/http.(*conn).serve(0xc42014dcc0, 0x1e8c840, 0xc42044cb80)
/usr/lib/golang/src/net/http/server.go:1739 +0x50e
created by net/http.(*Server).Serve
/usr/lib/golang/src/net/http/server.go:2720 +0x288
goroutine 1588 [semacquire, 4 minutes]:
sync.runtime_notifyListWait(0xc4205da040, 0xc400000000)
/usr/lib/golang/src/runtime/sema.go:507 +0x110
sync.(*Cond).Wait(0xc4205da030)
/usr/lib/golang/src/sync/cond.go:56 +0x80
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.(*pipe).Read(0xc4205da028, 0xc420917400, 0x200, 0x200, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/pipe.go:64 +0x9c
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.transportResponseBody.Read(0xc4205da000, 0xc420917400, 0x200, 0x200, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/transport.go:1739 +0xb1
encoding/json.(*Decoder).refill(0xc4206d8380, 0x11f0e20, 0x2)
/usr/lib/golang/src/encoding/json/stream.go:152 +0x114
encoding/json.(*Decoder).readValue(0xc4206d8380, 0x0, 0x0, 0x411408)
/usr/lib/golang/src/encoding/json/stream.go:128 +0x275
encoding/json.(*Decoder).Decode(0xc4206d8380, 0x12091c0, 0xc4205c0520, 0xc420bc2080, 0x1183060)
/usr/lib/golang/src/encoding/json/stream.go:57 +0x78
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc420a5f800, 0xc4208ca000, 0x400, 0x400, 0x40, 0x38, 0x124ba40)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:150 +0x2c8
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc42035f220, 0x0, 0x1e7d7c0, 0xc4203b05c0, 0x5, 0xc42069ac00, 0x5, 0xc420a0ef20, 0x42a7d9)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0x95
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc4205c0500, 0x13e43e0, 0x0, 0x0, 0x0, 0xc4203b0600, 0xc420482000)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0x7c
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc420a5f830)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:93 +0x138
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xb4
goroutine 1062 [select, 3 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func1(0xc42048e460, 0xc4203660c0, 0xc420969b60, 0xc4203311a0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:278 +0x190
created by github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:272 +0xa2c
goroutine 1503 [semacquire, 4 minutes]:
sync.runtime_notifyListWait(0xc4208cfa80, 0xc400000000)
/usr/lib/golang/src/runtime/sema.go:507 +0x110
sync.(*Cond).Wait(0xc4208cfa70)
/usr/lib/golang/src/sync/cond.go:56 +0x80
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.(*pipe).Read(0xc4208cfa68, 0xc420422000, 0x200, 0x200, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/pipe.go:64 +0x9c
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.transportResponseBody.Read(0xc4208cfa40, 0xc420422000, 0x200, 0x200, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/transport.go:1739 +0xb1
encoding/json.(*Decoder).refill(0xc4206e68c0, 0x11f0e20, 0x2)
/usr/lib/golang/src/encoding/json/stream.go:152 +0x114
encoding/json.(*Decoder).readValue(0xc4206e68c0, 0x0, 0x0, 0x411408)
/usr/lib/golang/src/encoding/json/stream.go:128 +0x275
encoding/json.(*Decoder).Decode(0xc4206e68c0, 0x12091c0, 0xc420be0020, 0x12904e0, 0x1)
/usr/lib/golang/src/encoding/json/stream.go:57 +0x78
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc420bc41e0, 0xc4203da400, 0x400, 0x400, 0x40, 0x38, 0x124ba40)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:150 +0x2c8
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc42035e050, 0x0, 0x1e7d7c0, 0xc4201cc940, 0x3, 0x1, 0x0, 0xc420585f20, 0x42a7d9)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0x95
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc420be0000, 0x13e43e0, 0x0, 0x0, 0x0, 0x7760e7, 0xc420125200)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0x7c
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc420bc4210)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:93 +0x138
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xb4
goroutine 1654 [semacquire, 2 minutes]:
sync.runtime_notifyListWait(0xc4202c71c0, 0xc400000000)
/usr/lib/golang/src/runtime/sema.go:507 +0x110
sync.(*Cond).Wait(0xc4202c71b0)
/usr/lib/golang/src/sync/cond.go:56 +0x80
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.(*pipe).Read(0xc4202c71a8, 0xc420916200, 0x200, 0x200, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/pipe.go:64 +0x9c
github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2.transportResponseBody.Read(0xc4202c7180, 0xc420916200, 0x200, 0x200, 0x0, 0x0, 0x0)
/go/src/github.com/coreos/prometheus-operator/vendor/golang.org/x/net/http2/transport.go:1739 +0xb1
encoding/json.(*Decoder).refill(0xc4206d81c0, 0x11f0e20, 0x0)
/usr/lib/golang/src/encoding/json/stream.go:152 +0x114
encoding/json.(*Decoder).readValue(0xc4206d81c0, 0x0, 0x0, 0x411408)
/usr/lib/golang/src/encoding/json/stream.go:128 +0x275
encoding/json.(*Decoder).Decode(0xc4206d81c0, 0x12091c0, 0xc4200c5940, 0xc4209b15e8, 0x42ae98)
/usr/lib/golang/src/encoding/json/stream.go:57 +0x78
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc420bc48a0, 0xc4202dd000, 0x400, 0x400, 0x40, 0x38, 0x124ba40)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:150 +0x2c8
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc4202aa3c0, 0x0, 0x1e7d7c0, 0xc4201cd940, 0xc4209b16c8, 0x459060, 0xc4206b6780, 0xc4209b1720, 0x42a7d9)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0x95
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc4200c5900, 0x13e43e0, 0x0, 0x0, 0x0, 0xc4209b17c8, 0x679169)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0x7c
github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc420bc48d0)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:93 +0x138
created by github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xb4
goroutine 1501 [select, 4 minutes]:
github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func1(0xc42014c780, 0xc4203660c0, 0xc4209e51a0, 0xc42031da40)
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:278 +0x190
created by github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
/go/src/github.com/coreos/prometheus-operator/vendor/k8s.io/client-go/tools/cache/reflector.go:272 +0xa2c
goroutine 1780 [runnable]:
net/http.(*connReader).backgroundRead(0xc42005ba40)
/usr/lib/golang/src/net/http/server.go:659
created by net/http.(*connReader).startBackgroundRead
/usr/lib/golang/src/net/http/server.go:656 +0xd8
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment