Created
November 27, 2022 21:12
-
-
Save jaraco/65b0a3ea33405932c9cb6d0a024a585e to your computer and use it in GitHub Desktop.
This file has been truncated, but you can view the full file.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| -- Journal begins at Sat 2022-11-26 19:07:21 PST, ends at Sun 2022-11-27 13:11:13 PST. -- | |
| Nov 27 12:48:36 tanuki sh[642154]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service | |
| Nov 27 12:48:36 tanuki sh[642155]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory | |
| Nov 27 12:48:36 tanuki provision-disk.sh[642158]: Running provision-disk.sh | |
| Nov 27 12:48:36 tanuki provision-disk.sh[642158]: Not using /dev/sda because it appears to contain a partition already | |
| Nov 27 12:48:36 tanuki provision-disk.sh[642158]: Not using /dev/sdb because it appears to contain a partition already | |
| Nov 27 12:48:36 tanuki provision-disk.sh[642158]: Not using /dev/sdc because it appears to contain a partition already | |
| Nov 27 12:48:36 tanuki provision-disk.sh[642158]: Not using /dev/sdd because it appears to contain a partition already | |
| Nov 27 12:48:36 tanuki provision-disk.sh[642158]: Not using /dev/sde because it appears to contain a partition already | |
| Nov 27 12:48:36 tanuki provision-disk.sh[642160]: Volume group "pibox-group" not found | |
| Nov 27 12:48:36 tanuki provision-disk.sh[642160]: Cannot process volume group pibox-group | |
| Nov 27 12:48:36 tanuki provision-disk.sh[642161]: Volume group "pibox-group" not found | |
| Nov 27 12:48:36 tanuki provision-disk.sh[642161]: Cannot process volume group pibox-group | |
| Nov 27 12:48:36 tanuki provision-disk.sh[642158]: No disks to format, continuing. DISKS_TO_ADD was: | |
| Nov 27 12:48:36 tanuki k3s[642162]: time="2022-11-27T12:48:36-08:00" level=warning msg="no-deploy flag is deprecated, it will be removed in v1.25. Use --skip-deploy instead." | |
| Nov 27 12:48:36 tanuki k3s[642162]: time="2022-11-27T12:48:36-08:00" level=info msg="Starting k3s v1.24.4+k3s1 (c3f830e9)" | |
| Nov 27 12:48:36 tanuki k3s[642162]: time="2022-11-27T12:48:36-08:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s" | |
| Nov 27 12:48:36 tanuki k3s[642162]: time="2022-11-27T12:48:36-08:00" level=info msg="Configuring database table schema and indexes, this may take a moment..." | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Database tables and indexes are up to date" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Kine available at unix://kine.sock" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Reconciling bootstrap data between datastore and disk" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1662870196: notBefore=2022-09-11 04:23:16 +0000 UTC notAfter=2023-11-27 20:48:37 +0000 UTC" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1662870196: notBefore=2022-09-11 04:23:16 +0000 UTC notAfter=2023-11-27 20:48:37 +0000 UTC" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1662870196: notBefore=2022-09-11 04:23:16 +0000 UTC notAfter=2023-11-27 20:48:37 +0000 UTC" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Tunnel server egress proxy mode: agent" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Tunnel server egress proxy waiting for runtime core to become available" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --etcd-servers=unix://kine.sock --feature-gates=JobTrackingWithFinalizers=true --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-cluster-ip-range=172.31.11.0/24 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1662870196: notBefore=2022-09-11 04:23:16 +0000 UTC notAfter=2023-11-27 20:48:37 +0000 UTC" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Waiting for API server to become available" | |
| Nov 27 12:48:37 tanuki k3s[642162]: I1127 12:48:37.483432 642162 server.go:576] external host was not specified, using 192.168.107.204 | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=172.31.10.0/24 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,-service,-route,-cloud-node-lifecycle --feature-gates=JobTrackingWithFinalizers=true --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-cluster-ip-range=172.31.11.0/24 --use-service-account-credentials=true" | |
| Nov 27 12:48:37 tanuki k3s[642162]: I1127 12:48:37.484238 642162 server.go:168] Version: v1.24.4+k3s1 | |
| Nov 27 12:48:37 tanuki k3s[642162]: I1127 12:48:37.484765 642162 server.go:170] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-provider=k3s --cluster-cidr=172.31.10.0/24 --configure-cloud-routes=false --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --node-status-update-frequency=1m0s --profiling=false" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="To join server node to cluster: k3s server -s https://192.168.107.204:6443 -t ${SERVER_NODE_TOKEN}" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="To join agent node to cluster: k3s agent -s https://192.168.107.204:6443 -t ${AGENT_NODE_TOKEN}" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Run: k3s kubectl" | |
| Nov 27 12:48:37 tanuki k3s[642162]: I1127 12:48:37.551971 642162 shared_informer.go:255] Waiting for caches to sync for node_authorizer | |
| Nov 27 12:48:37 tanuki k3s[642162]: I1127 12:48:37.555850 642162 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. | |
| Nov 27 12:48:37 tanuki k3s[642162]: I1127 12:48:37.555926 642162 plugins.go:161] Loaded 11 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota. | |
| Nov 27 12:48:37 tanuki k3s[642162]: I1127 12:48:37.559797 642162 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. | |
| Nov 27 12:48:37 tanuki k3s[642162]: I1127 12:48:37.559860 642162 plugins.go:161] Loaded 11 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota. | |
| Nov 27 12:48:37 tanuki k3s[642162]: W1127 12:48:37.643887 642162 genericapiserver.go:557] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="certificate CN=tanuki signed by CN=k3s-server-ca@1662870196: notBefore=2022-09-11 04:23:16 +0000 UTC notAfter=2023-11-27 20:48:37 +0000 UTC" | |
| Nov 27 12:48:37 tanuki k3s[642162]: I1127 12:48:37.646778 642162 instance.go:274] Using reconciler: lease | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="certificate CN=system:node:tanuki,O=system:nodes signed by CN=k3s-client-ca@1662870196: notBefore=2022-09-11 04:23:16 +0000 UTC notAfter=2023-11-27 20:48:37 +0000 UTC" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Module overlay was already loaded" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Module nf_conntrack was already loaded" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Module br_netfilter was already loaded" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Module iptable_nat was already loaded" | |
| Nov 27 12:48:37 tanuki k3s[642162]: W1127 12:48:37.906800 642162 sysinfo.go:203] Nodes topology is not available, providing CPU topology | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" | |
| Nov 27 12:48:37 tanuki k3s[642162]: time="2022-11-27T12:48:37-08:00" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml -a /run/k3s/containerd/containerd.sock --state /run/k3s/containerd --root /var/lib/rancher/k3s/agent/containerd" | |
| Nov 27 12:48:38 tanuki k3s[642162]: I1127 12:48:38.034621 642162 instance.go:586] API group "internal.apiserver.k8s.io" is not enabled, skipping. | |
| Nov 27 12:48:38 tanuki k3s[642162]: W1127 12:48:38.866623 642162 genericapiserver.go:557] Skipping API authentication.k8s.io/v1beta1 because it has no resources. | |
| Nov 27 12:48:38 tanuki k3s[642162]: W1127 12:48:38.872582 642162 genericapiserver.go:557] Skipping API authorization.k8s.io/v1beta1 because it has no resources. | |
| Nov 27 12:48:38 tanuki k3s[642162]: time="2022-11-27T12:48:38-08:00" level=info msg="Containerd is now running" | |
| Nov 27 12:48:38 tanuki k3s[642162]: W1127 12:48:38.927589 642162 genericapiserver.go:557] Skipping API certificates.k8s.io/v1beta1 because it has no resources. | |
| Nov 27 12:48:38 tanuki k3s[642162]: time="2022-11-27T12:48:38-08:00" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" | |
| Nov 27 12:48:38 tanuki k3s[642162]: time="2022-11-27T12:48:38-08:00" level=info msg="Running kubelet --address=0.0.0.0 --anonymous-auth=false --authentication-token-webhook=true --authorization-mode=Webhook --cgroup-driver=systemd --client-ca-file=/var/lib/rancher/k3s/agent/client-ca.crt --cloud-provider=external --cluster-dns=172.31.11.10 --cluster-domain=cluster.local --container-log-max-files=3 --container-log-max-size=10Mi --container-runtime-endpoint=unix:///run/k3s/containerd/containerd.sock --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=imagefs.available<5%,nodefs.available<5% --eviction-minimum-reclaim=imagefs.available=10%,nodefs.available=10% --fail-swap-on=false --healthz-bind-address=127.0.0.1 --hostname-override=tanuki --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-labels= --pod-infra-container-image=rancher/mirrored-pause:3.6 --pod-manifest-path=/var/lib/rancher/k3s/agent/pod-manifests --read-only-port=0 --resolv-conf=/etc/resolv.conf --serialize-image-pulls=false --tls-cert-file=/var/lib/rancher/k3s/agent/serving-kubelet.crt --tls-private-key-file=/var/lib/rancher/k3s/agent/serving-kubelet.key" | |
| Nov 27 12:48:38 tanuki k3s[642162]: W1127 12:48:38.935680 642162 genericapiserver.go:557] Skipping API coordination.k8s.io/v1beta1 because it has no resources. | |
| Nov 27 12:48:38 tanuki k3s[642162]: time="2022-11-27T12:48:38-08:00" level=info msg="Handling backend connection request [tanuki]" | |
| Nov 27 12:48:38 tanuki k3s[642162]: W1127 12:48:38.963293 642162 genericapiserver.go:557] Skipping API networking.k8s.io/v1beta1 because it has no resources. | |
| Nov 27 12:48:38 tanuki k3s[642162]: time="2022-11-27T12:48:38-08:00" level=info msg="Waiting to retrieve kube-proxy configuration; server is not ready: https://127.0.0.1:6443/v1-k3s/readyz: 500 Internal Server Error" | |
| Nov 27 12:48:38 tanuki k3s[642162]: W1127 12:48:38.975752 642162 genericapiserver.go:557] Skipping API node.k8s.io/v1alpha1 because it has no resources. | |
| Nov 27 12:48:38 tanuki k3s[642162]: W1127 12:48:38.999616 642162 genericapiserver.go:557] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. | |
| Nov 27 12:48:38 tanuki k3s[642162]: W1127 12:48:38.999693 642162 genericapiserver.go:557] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. | |
| Nov 27 12:48:39 tanuki k3s[642162]: W1127 12:48:39.005505 642162 genericapiserver.go:557] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. | |
| Nov 27 12:48:39 tanuki k3s[642162]: W1127 12:48:39.005588 642162 genericapiserver.go:557] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. | |
| Nov 27 12:48:39 tanuki k3s[642162]: W1127 12:48:39.022298 642162 genericapiserver.go:557] Skipping API storage.k8s.io/v1alpha1 because it has no resources. | |
| Nov 27 12:48:39 tanuki k3s[642162]: W1127 12:48:39.040146 642162 genericapiserver.go:557] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. | |
| Nov 27 12:48:39 tanuki k3s[642162]: W1127 12:48:39.060787 642162 genericapiserver.go:557] Skipping API apps/v1beta2 because it has no resources. | |
| Nov 27 12:48:39 tanuki k3s[642162]: W1127 12:48:39.060862 642162 genericapiserver.go:557] Skipping API apps/v1beta1 because it has no resources. | |
| Nov 27 12:48:39 tanuki k3s[642162]: W1127 12:48:39.070486 642162 genericapiserver.go:557] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. | |
| Nov 27 12:48:39 tanuki k3s[642162]: I1127 12:48:39.088682 642162 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. | |
| Nov 27 12:48:39 tanuki k3s[642162]: I1127 12:48:39.088753 642162 plugins.go:161] Loaded 11 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota. | |
| Nov 27 12:48:39 tanuki k3s[642162]: W1127 12:48:39.147358 642162 genericapiserver.go:557] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. | |
| Nov 27 12:48:42 tanuki k3s[642162]: time="2022-11-27T12:48:42-08:00" level=info msg="Tunnel server egress proxy waiting for runtime core to become available" | |
| Nov 27 12:48:43 tanuki k3s[642162]: time="2022-11-27T12:48:43-08:00" level=info msg="Waiting to retrieve kube-proxy configuration; server is not ready: https://127.0.0.1:6443/v1-k3s/readyz: 500 Internal Server Error" | |
| Nov 27 12:48:43 tanuki k3s[642162]: I1127 12:48:43.997054 642162 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" | |
| Nov 27 12:48:43 tanuki k3s[642162]: I1127 12:48:43.997054 642162 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" | |
| Nov 27 12:48:43 tanuki k3s[642162]: I1127 12:48:43.998140 642162 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" | |
| Nov 27 12:48:43 tanuki k3s[642162]: I1127 12:48:43.999264 642162 secure_serving.go:210] Serving securely on 127.0.0.1:6444 | |
| Nov 27 12:48:43 tanuki k3s[642162]: I1127 12:48:43.999656 642162 tlsconfig.go:240] "Starting DynamicServingCertificateController" | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.001917 642162 autoregister_controller.go:141] Starting autoregister controller | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.002287 642162 cache.go:32] Waiting for caches to sync for autoregister controller | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.003507 642162 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.015658 642162 apiservice_controller.go:97] Starting APIServiceRegistrationController | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.015705 642162 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.017166 642162 controller.go:80] Starting OpenAPI V3 AggregationController | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.018086 642162 available_controller.go:491] Starting AvailableConditionController | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.018165 642162 cache.go:32] Waiting for caches to sync for AvailableConditionController controller | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.018292 642162 customresource_discovery_controller.go:209] Starting DiscoveryController | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.018396 642162 apf_controller.go:317] Starting API Priority and Fairness config controller | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.018612 642162 controller.go:83] Starting OpenAPI AggregationController | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.018701 642162 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue). | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.019760 642162 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.019822 642162 shared_informer.go:255] Waiting for caches to sync for cluster_authentication_trust_controller | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.037694 642162 crdregistration_controller.go:111] Starting crd-autoregister controller | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.037752 642162 shared_informer.go:255] Waiting for caches to sync for crd-autoregister | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.049208 642162 controller.go:85] Starting OpenAPI controller | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.049346 642162 controller.go:85] Starting OpenAPI V3 controller | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.049421 642162 naming_controller.go:291] Starting NamingConditionController | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.049497 642162 establishing_controller.go:76] Starting EstablishingController | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.049589 642162 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.049667 642162 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.049713 642162 crd_finalizer.go:266] Starting CRDFinalizer | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.058494 642162 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.065179 642162 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.103059 642162 cache.go:39] Caches are synced for autoregister controller | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.115807 642162 cache.go:39] Caches are synced for APIServiceRegistrationController controller | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.120270 642162 cache.go:39] Caches are synced for AvailableConditionController controller | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.120271 642162 apf_controller.go:322] Running API Priority and Fairness config worker | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.120203 642162 shared_informer.go:262] Caches are synced for cluster_authentication_trust_controller | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.138735 642162 shared_informer.go:262] Caches are synced for crd-autoregister | |
| Nov 27 12:48:44 tanuki k3s[642162]: I1127 12:48:44.154679 642162 shared_informer.go:262] Caches are synced for node_authorizer | |
| Nov 27 12:48:44 tanuki k3s[642162]: E1127 12:48:44.164440 642162 controller.go:173] Error removing old endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service | |
| Nov 27 12:48:44 tanuki k3s[642162]: E1127 12:48:44.200772 642162 repair.go:250] the cluster IP [IPv4]:10.43.0.1 for service kubernetes/default is not within the service CIDR 172.31.11.0/24; please recreate | |
| Nov 27 12:48:44 tanuki k3s[642162]: E1127 12:48:44.200885 642162 repair.go:250] the cluster IP [IPv4]:10.43.0.10 for service kube-dns/kube-system is not within the service CIDR 172.31.11.0/24; please recreate | |
| Nov 27 12:48:44 tanuki k3s[642162]: E1127 12:48:44.202006 642162 repair.go:250] the cluster IP [IPv4]:10.43.198.136 for service metrics-server/kube-system is not within the service CIDR 172.31.11.0/24; please recreate | |
| Nov 27 12:48:44 tanuki k3s[642162]: E1127 12:48:44.203716 642162 repair.go:301] the cluster IP 10.43.0.1 may have leaked: flagging for later clean up | |
| Nov 27 12:48:44 tanuki k3s[642162]: E1127 12:48:44.207409 642162 repair.go:308] the cluster IP 10.43.0.1 may have leaked, but can not be allocated: the provided IP (10.43.0.1) is not in the valid range. The range of valid IPs is 172.31.11.0/24 | |
| Nov 27 12:48:44 tanuki k3s[642162]: E1127 12:48:44.208495 642162 repair.go:301] the cluster IP 10.43.0.10 may have leaked: flagging for later clean up | |
| Nov 27 12:48:44 tanuki k3s[642162]: E1127 12:48:44.209884 642162 repair.go:308] the cluster IP 10.43.0.10 may have leaked, but can not be allocated: the provided IP (10.43.0.10) is not in the valid range. The range of valid IPs is 172.31.11.0/24 | |
| Nov 27 12:48:44 tanuki k3s[642162]: E1127 12:48:44.211311 642162 repair.go:301] the cluster IP 10.43.198.136 may have leaked: flagging for later clean up | |
| Nov 27 12:48:44 tanuki k3s[642162]: E1127 12:48:44.212518 642162 repair.go:308] the cluster IP 10.43.198.136 may have leaked, but can not be allocated: the provided IP (10.43.198.136) is not in the valid range. The range of valid IPs is 172.31.11.0/24 | |
| Nov 27 12:48:44 tanuki k3s[642162]: E1127 12:48:44.290565 642162 repair.go:250] the cluster IP [IPv4]:10.43.0.1 for service kubernetes/default is not within the service CIDR 172.31.11.0/24; please recreate | |
| Nov 27 12:48:44 tanuki k3s[642162]: E1127 12:48:44.290702 642162 repair.go:250] the cluster IP [IPv4]:10.43.0.10 for service kube-dns/kube-system is not within the service CIDR 172.31.11.0/24; please recreate | |
| Nov 27 12:48:44 tanuki k3s[642162]: E1127 12:48:44.292598 642162 repair.go:250] the cluster IP [IPv4]:10.43.198.136 for service metrics-server/kube-system is not within the service CIDR 172.31.11.0/24; please recreate | |
| Nov 27 12:48:45 tanuki k3s[642162]: I1127 12:48:45.013590 642162 storage_scheduling.go:111] all system priority classes are created successfully or already exist. | |
| Nov 27 12:48:45 tanuki k3s[642162]: W1127 12:48:45.372420 642162 handler_proxy.go:102] no RequestInfo found in the context | |
| Nov 27 12:48:45 tanuki k3s[642162]: E1127 12:48:45.372517 642162 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService | |
| Nov 27 12:48:45 tanuki k3s[642162]: I1127 12:48:45.372546 642162 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue. | |
| Nov 27 12:48:45 tanuki k3s[642162]: W1127 12:48:45.372421 642162 handler_proxy.go:102] no RequestInfo found in the context | |
| Nov 27 12:48:45 tanuki k3s[642162]: E1127 12:48:45.372681 642162 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable | |
| Nov 27 12:48:45 tanuki k3s[642162]: , Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]] | |
| Nov 27 12:48:45 tanuki k3s[642162]: I1127 12:48:45.374001 642162 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue. | |
| Nov 27 12:48:45 tanuki k3s[642162]: Flag --cloud-provider has been deprecated, will be removed in 1.24 or later, in favor of removing cloud provider code from Kubelet. | |
| Nov 27 12:48:45 tanuki k3s[642162]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. | |
| Nov 27 12:48:45 tanuki k3s[642162]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.27. Image garbage collector will get sandbox image information from CRI. | |
| Nov 27 12:48:45 tanuki k3s[642162]: I1127 12:48:45.958840 642162 server.go:192] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Stopped tunnel to 127.0.0.1:6443" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Connecting to proxy" url="wss://192.168.107.204:6443/v1-k3s/connect" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.019526 642162 server.go:395] "Kubelet version" kubeletVersion="v1.24.4+k3s1" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.019982 642162 server.go:397] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" | |
| Nov 27 12:48:46 tanuki k3s[642162]: W1127 12:48:46.024397 642162 manager.go:159] Cannot detect current cgroup on cgroup v2 | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Annotations and labels have been set successfully on node: tanuki" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Starting flannel with backend vxlan" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Handling backend connection request [tanuki]" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.027929 642162 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" | |
| Nov 27 12:48:46 tanuki k3s[642162]: W1127 12:48:46.031823 642162 sysinfo.go:203] Nodes topology is not available, providing CPU topology | |
| Nov 27 12:48:46 tanuki k3s[642162]: W1127 12:48:46.033646 642162 machine.go:65] Cannot read vendor id correctly, set empty. | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.036886 642162 server.go:644] "--cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.037635 642162 container_manager_linux.go:262] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.037838 642162 container_manager_linux.go:267] "Creating Container Manager object based on Node Config" nodeConfig={RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: KubeletOOMScoreAdj:-999 ContainerRuntime: CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:systemd KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: ReservedSystemCPUs: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:imagefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>}]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerPolicyOptions:map[] ExperimentalTopologyManagerScope:container ExperimentalCPUManagerReconcilePeriod:10s ExperimentalMemoryManagerPolicy:None ExperimentalMemoryManagerReservedMemory:[] ExperimentalPodPidsLimit:-1 EnforceCPULimits:true CPUCFSQuotaPeriod:100ms ExperimentalTopologyManagerPolicy:none} | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.037947 642162 topology_manager.go:133] "Creating topology manager with policy per scope" topologyPolicyName="none" topologyScopeName="container" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.037990 642162 container_manager_linux.go:302] "Creating device plugin manager" devicePluginEnabled=true | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.038106 642162 state_mem.go:36] "Initialized new in-memory state store" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.050309 642162 kubelet.go:376] "Attempting to sync node with API server" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.050385 642162 kubelet.go:267] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.050470 642162 kubelet.go:278] "Adding apiserver pod source" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.054224 642162 apiserver.go:42] "Waiting for node sync before watching apiserver pods" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.057874 642162 kuberuntime_manager.go:239] "Container runtime initialized" containerRuntime="containerd" version="v1.6.6-k3s1" apiVersion="v1" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.063087 642162 server.go:1177] "Started kubelet" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Kube API server is now running" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="ETCD server is now running" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="k3s is up and running" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Waiting for cloud-controller-manager privileges to become available" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.081788 642162 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.085163 642162 server.go:150] "Starting to listen" address="0.0.0.0" port=10250 | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.087792 642162 server.go:410] "Adding debug handlers to kubelet server" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.095913 642162 volume_manager.go:289] "Starting Kubelet Volume Manager" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.099030 642162 desired_state_of_world_populator.go:145] "Desired state populator starts to run" | |
| Nov 27 12:48:46 tanuki k3s[642162]: E1127 12:48:46.124300 642162 cri_stats_provider.go:455] "Failed to get the info of the filesystem with mountpoint" err="unable to find data in memory cache" mountpoint="/var/lib/rancher/k3s/agent/containerd/io.containerd.snapshotter.v1.overlayfs" | |
| Nov 27 12:48:46 tanuki k3s[642162]: E1127 12:48:46.124413 642162 kubelet.go:1298] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.150212 642162 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.230512 642162 kubelet_network_linux.go:76] "Initialized protocol iptables rules." protocol=IPv4 | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.239719 642162 kubelet_node_status.go:70] "Attempting to register node" node="tanuki" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Applying CRD addons.k3s.cattle.io" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.364698 642162 cpu_manager.go:213] "Starting CPU manager" policy="none" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.364781 642162 cpu_manager.go:214] "Reconciling" reconcilePeriod="10s" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.364867 642162 state_mem.go:36] "Initialized new in-memory state store" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.365580 642162 state_mem.go:88] "Updated default CPUSet" cpuSet="" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.365660 642162 state_mem.go:96] "Updated CPUSet assignments" assignments=map[] | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.365709 642162 policy_none.go:49] "None policy: Start" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.374928 642162 kubelet_node_status.go:108] "Node was previously registered" node="tanuki" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.376742 642162 kubelet_node_status.go:73] "Successfully registered node" node="tanuki" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.388678 642162 memory_manager.go:168] "Starting memorymanager" policy="None" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.391689 642162 state_mem.go:35] "Initializing new in-memory state store" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.392303 642162 state_mem.go:75] "Updated machine memory state" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.394802 642162 kubelet_network_linux.go:76] "Initialized protocol iptables rules." protocol=IPv6 | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.395388 642162 status_manager.go:161] "Starting to sync pod status with apiserver" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.395781 642162 kubelet.go:1986] "Starting kubelet main sync loop" | |
| Nov 27 12:48:46 tanuki k3s[642162]: E1127 12:48:46.403228 642162 kubelet.go:2010] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Applying CRD helmcharts.helm.cattle.io" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.424545 642162 setters.go:532] "Node became not ready" node="tanuki" condition={Type:Ready Status:False LastHeartbeatTime:2022-11-27 12:48:46.424414977 -0800 PST m=+9.695009033 LastTransitionTime:2022-11-27 12:48:46.424414977 -0800 PST m=+9.695009033 Reason:KubeletNotReady Message:[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]} | |
| Nov 27 12:48:46 tanuki k3s[642162]: E1127 12:48:46.506246 642162 kubelet.go:2010] "Skipping pod synchronization" err="container runtime status check may not have completed yet" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Applying CRD helmchartconfigs.helm.cattle.io" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.522999 642162 manager.go:610] "Failed to read data from checkpoint" checkpoint="kubelet_internal_checkpoint" err="checkpoint is not found" | |
| Nov 27 12:48:46 tanuki k3s[642162]: I1127 12:48:46.526063 642162 plugin_manager.go:114] "Starting Kubelet Plugin Manager" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-10.19.300.tgz" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-10.19.300.tgz" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" | |
| Nov 27 12:48:46 tanuki k3s[642162]: E1127 12:48:46.878985 642162 memcache.go:206] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:48:46 tanuki k3s[642162]: E1127 12:48:46.938905 642162 memcache.go:104] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Creating deploy event broadcaster" | |
| Nov 27 12:48:46 tanuki k3s[642162]: time="2022-11-27T12:48:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.060208 642162 apiserver.go:52] "Watching apiserver" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.137129 642162 topology_manager.go:200] "Topology Admit Handler" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.137825 642162 topology_manager.go:200] "Topology Admit Handler" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.138472 642162 topology_manager.go:200] "Topology Admit Handler" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.139167 642162 topology_manager.go:200] "Topology Admit Handler" | |
| Nov 27 12:48:47 tanuki k3s[642162]: E1127 12:48:47.181335 642162 memcache.go:206] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:48:47 tanuki k3s[642162]: E1127 12:48:47.205788 642162 memcache.go:104] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:48:47 tanuki k3s[642162]: time="2022-11-27T12:48:47-08:00" level=info msg="Creating svccontroller event broadcaster" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.253649 642162 reconciler.go:342] "operationExecutor.VerifyControllerAttachedVolume started for volume \"opt-kubesail\" (UniqueName: \"kubernetes.io/host-path/d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d-opt-kubesail\") pod \"kubesail-agent-78f6c568c4-2kk9g\" (UID: \"d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d\") " pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.261865 642162 reconciler.go:342] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6hcw\" (UniqueName: \"kubernetes.io/projected/d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d-kube-api-access-s6hcw\") pod \"kubesail-agent-78f6c568c4-2kk9g\" (UID: \"d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d\") " pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.263415 642162 reconciler.go:342] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22k2r\" (UniqueName: \"kubernetes.io/projected/4b24e3b1-a081-4243-8bb7-816c5ec29f31-kube-api-access-22k2r\") pod \"local-path-provisioner-7b7dc8d6f5-7j8kv\" (UID: \"4b24e3b1-a081-4243-8bb7-816c5ec29f31\") " pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.263531 642162 reconciler.go:342] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfe3d994-79c1-4307-bca2-3db0583d9951-tmp-dir\") pod \"metrics-server-668d979685-dt55q\" (UID: \"bfe3d994-79c1-4307-bca2-3db0583d9951\") " pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.263611 642162 reconciler.go:342] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfbzq\" (UniqueName: \"kubernetes.io/projected/bfe3d994-79c1-4307-bca2-3db0583d9951-kube-api-access-hfbzq\") pod \"metrics-server-668d979685-dt55q\" (UID: \"bfe3d994-79c1-4307-bca2-3db0583d9951\") " pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.263684 642162 reconciler.go:342] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2f3fdc72-0488-4b13-8941-a07e8a26fba7-config-volume\") pod \"coredns-b96499967-w74cl\" (UID: \"2f3fdc72-0488-4b13-8941-a07e8a26fba7\") " pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.263758 642162 reconciler.go:342] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f3fdc72-0488-4b13-8941-a07e8a26fba7-custom-config-volume\") pod \"coredns-b96499967-w74cl\" (UID: \"2f3fdc72-0488-4b13-8941-a07e8a26fba7\") " pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.263853 642162 reconciler.go:342] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wxb4\" (UniqueName: \"kubernetes.io/projected/2f3fdc72-0488-4b13-8941-a07e8a26fba7-kube-api-access-2wxb4\") pod \"coredns-b96499967-w74cl\" (UID: \"2f3fdc72-0488-4b13-8941-a07e8a26fba7\") " pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.263924 642162 reconciler.go:342] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-dbus\" (UniqueName: \"kubernetes.io/host-path/d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d-host-dbus\") pod \"kubesail-agent-78f6c568c4-2kk9g\" (UID: \"d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d\") " pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.263993 642162 reconciler.go:342] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pibox-run\" (UniqueName: \"kubernetes.io/host-path/d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d-pibox-run\") pod \"kubesail-agent-78f6c568c4-2kk9g\" (UID: \"d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d\") " pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.264071 642162 reconciler.go:342] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4b24e3b1-a081-4243-8bb7-816c5ec29f31-config-volume\") pod \"local-path-provisioner-7b7dc8d6f5-7j8kv\" (UID: \"4b24e3b1-a081-4243-8bb7-816c5ec29f31\") " pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.264108 642162 reconciler.go:159] "Reconciler: start to sync state" | |
| Nov 27 12:48:47 tanuki k3s[642162]: time="2022-11-27T12:48:47-08:00" level=info msg="Cluster dns configmap already exists" | |
| Nov 27 12:48:47 tanuki k3s[642162]: time="2022-11-27T12:48:47-08:00" level=info msg="Labels and annotations have been set successfully on node: tanuki" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.514371 642162 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io | |
| Nov 27 12:48:47 tanuki k3s[642162]: time="2022-11-27T12:48:47-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:48:47 tanuki k3s[642162]: I1127 12:48:47.591972 642162 controller.go:611] quota admission added evaluator for: addons.k3s.cattle.io | |
| Nov 27 12:48:47 tanuki k3s[642162]: time="2022-11-27T12:48:47-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:48:47 tanuki k3s[642162]: time="2022-11-27T12:48:47-08:00" level=info msg="Starting /v1, Kind=Node controller" | |
| Nov 27 12:48:47 tanuki k3s[642162]: time="2022-11-27T12:48:47-08:00" level=info msg="Starting /v1, Kind=ConfigMap controller" | |
| Nov 27 12:48:47 tanuki k3s[642162]: time="2022-11-27T12:48:47-08:00" level=info msg="Starting /v1, Kind=ServiceAccount controller" | |
| Nov 27 12:48:47 tanuki k3s[642162]: time="2022-11-27T12:48:47-08:00" level=info msg="Starting /v1, Kind=Pod controller" | |
| Nov 27 12:48:47 tanuki k3s[642162]: time="2022-11-27T12:48:47-08:00" level=info msg="Starting /v1, Kind=Service controller" | |
| Nov 27 12:48:47 tanuki k3s[642162]: E1127 12:48:47.732198 642162 memcache.go:206] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:48:47 tanuki k3s[642162]: time="2022-11-27T12:48:47-08:00" level=info msg="Starting /v1, Kind=Endpoints controller" | |
| Nov 27 12:48:47 tanuki k3s[642162]: time="2022-11-27T12:48:47-08:00" level=info msg="Starting /v1, Kind=Secret controller" | |
| Nov 27 12:48:47 tanuki k3s[642162]: time="2022-11-27T12:48:47-08:00" level=info msg="Updating TLS secret for kube-system/k3s-serving (count: 16): map[listener.cattle.io/cn-10.1.1.103:10.1.1.103 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-192.168.107.204:192.168.107.204 listener.cattle.io/cn-192.168.107.206:192.168.107.206 listener.cattle.io/cn-192.168.2.169:192.168.2.169 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fd8e_f003_ab81_10_60f3_8e6b_9160_5-e0701b:fd8e:f003:ab81:10:60f3:8e6b:9160:5f48 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-pibox:pibox listener.cattle.io/cn-tanuki:tanuki listener.cattle.io/cn-tanuki.jaraco.use1.k8g8.com:tanuki.jaraco.use1.k8g8.com listener.cattle.io/fingerprint:SHA1=7636C05BCC69153960AB30687E267828FDDCC427]" | |
| Nov 27 12:48:47 tanuki k3s[642162]: E1127 12:48:47.811706 642162 memcache.go:104] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:48:47 tanuki k3s[642162]: time="2022-11-27T12:48:47-08:00" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" | |
| Nov 27 12:48:47 tanuki k3s[642162]: time="2022-11-27T12:48:47-08:00" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" | |
| Nov 27 12:48:47 tanuki k3s[642162]: E1127 12:48:47.925543 642162 memcache.go:206] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:48:47 tanuki k3s[642162]: E1127 12:48:47.944562 642162 memcache.go:104] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:48:47 tanuki k3s[642162]: time="2022-11-27T12:48:47-08:00" level=info msg="Starting apps/v1, Kind=DaemonSet controller" | |
| Nov 27 12:48:47 tanuki k3s[642162]: time="2022-11-27T12:48:47-08:00" level=info msg="Starting apps/v1, Kind=Deployment controller" | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.051791 642162 memcache.go:206] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.107056 642162 memcache.go:104] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:48:48 tanuki k3s[642162]: time="2022-11-27T12:48:48-08:00" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.111939 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bdca41e96949cc8a747cd69b318573d99f1d601ef9c4e9af479a5157caaf0b92\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.112588 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bdca41e96949cc8a747cd69b318573d99f1d601ef9c4e9af479a5157caaf0b92\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.112978 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bdca41e96949cc8a747cd69b318573d99f1d601ef9c4e9af479a5157caaf0b92\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.113343 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"bdca41e96949cc8a747cd69b318573d99f1d601ef9c4e9af479a5157caaf0b92\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:48:48 tanuki k3s[642162]: I1127 12:48:48.125520 642162 controller.go:611] quota admission added evaluator for: deployments.apps | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.217937 642162 memcache.go:206] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:48:48 tanuki k3s[642162]: I1127 12:48:48.248108 642162 serving.go:355] Generated self-signed cert in-memory | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.354714 642162 memcache.go:104] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:48:48 tanuki k3s[642162]: time="2022-11-27T12:48:48-08:00" level=info msg="Starting batch/v1, Kind=Job controller" | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.384554 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7bfd47888e909c6d0ad4d5b2f590688e9eac0138a88dbd4b4ec9320afa6b7055\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.384675 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7bfd47888e909c6d0ad4d5b2f590688e9eac0138a88dbd4b4ec9320afa6b7055\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.384734 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7bfd47888e909c6d0ad4d5b2f590688e9eac0138a88dbd4b4ec9320afa6b7055\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.384876 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"7bfd47888e909c6d0ad4d5b2f590688e9eac0138a88dbd4b4ec9320afa6b7055\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:48:48 tanuki k3s[642162]: time="2022-11-27T12:48:48-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:48:48 tanuki k3s[642162]: time="2022-11-27T12:48:48-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.495850 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c8a214fec5d131a1cdbcc874905180347e03cedeb29935a48c304b704bac3cae\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.496004 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c8a214fec5d131a1cdbcc874905180347e03cedeb29935a48c304b704bac3cae\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.496068 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c8a214fec5d131a1cdbcc874905180347e03cedeb29935a48c304b704bac3cae\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.496216 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"c8a214fec5d131a1cdbcc874905180347e03cedeb29935a48c304b704bac3cae\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:48:48 tanuki k3s[642162]: time="2022-11-27T12:48:48-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:48:48 tanuki k3s[642162]: time="2022-11-27T12:48:48-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.642942 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"03da79630c580e5d516afa7b06fc33d1490aa636f03ccefd003b99c12dd7f968\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.643076 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"03da79630c580e5d516afa7b06fc33d1490aa636f03ccefd003b99c12dd7f968\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.643149 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"03da79630c580e5d516afa7b06fc33d1490aa636f03ccefd003b99c12dd7f968\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:48:48 tanuki k3s[642162]: E1127 12:48:48.643294 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"03da79630c580e5d516afa7b06fc33d1490aa636f03ccefd003b99c12dd7f968\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:48:48 tanuki k3s[642162]: time="2022-11-27T12:48:48-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:48:48 tanuki k3s[642162]: time="2022-11-27T12:48:48-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:48:48 tanuki k3s[642162]: time="2022-11-27T12:48:48-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:48:48 tanuki k3s[642162]: time="2022-11-27T12:48:48-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:48:48 tanuki k3s[642162]: time="2022-11-27T12:48:48-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:48:48 tanuki k3s[642162]: time="2022-11-27T12:48:48-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:48:48 tanuki k3s[642162]: time="2022-11-27T12:48:48-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:48:48 tanuki k3s[642162]: I1127 12:48:48.845973 642162 serving.go:355] Generated self-signed cert in-memory | |
| Nov 27 12:48:48 tanuki k3s[642162]: time="2022-11-27T12:48:48-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:48:48 tanuki k3s[642162]: time="2022-11-27T12:48:48-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:48:48 tanuki k3s[642162]: time="2022-11-27T12:48:48-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:48:49 tanuki k3s[642162]: time="2022-11-27T12:48:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:48:49 tanuki k3s[642162]: time="2022-11-27T12:48:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:48:49 tanuki k3s[642162]: time="2022-11-27T12:48:49-08:00" level=info msg="Running kube-proxy --cluster-cidr=172.31.10.0/24 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=tanuki --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.040633 642162 server.go:231] "Warning, all flags other than --config, --write-config-to, and --cleanup are deprecated, please begin using a config file ASAP" | |
| Nov 27 12:48:49 tanuki k3s[642162]: time="2022-11-27T12:48:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:48:49 tanuki k3s[642162]: time="2022-11-27T12:48:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.238796 642162 node.go:163] Successfully retrieved node IP: 192.168.107.204 | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.238905 642162 server_others.go:138] "Detected node IP" address="192.168.107.204" | |
| Nov 27 12:48:49 tanuki k3s[642162]: time="2022-11-27T12:48:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.302668 642162 server_others.go:206] "Using iptables Proxier" | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.303136 642162 server_others.go:213] "kube-proxy running in dual-stack mode" ipFamily=IPv4 | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.303365 642162 server_others.go:214] "Creating dualStackProxier for iptables" | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.303567 642162 server_others.go:501] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6" | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.303787 642162 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259" | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.304350 642162 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259" | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.305355 642162 server.go:661] "Version info" version="v1.24.4+k3s1" | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.305747 642162 server.go:663] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.314884 642162 config.go:317] "Starting service config controller" | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.315311 642162 shared_informer.go:255] Waiting for caches to sync for service config | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.315584 642162 config.go:226] "Starting endpoint slice config controller" | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.315797 642162 shared_informer.go:255] Waiting for caches to sync for endpoint slice config | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.317839 642162 config.go:444] "Starting node config controller" | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.318322 642162 shared_informer.go:255] Waiting for caches to sync for node config | |
| Nov 27 12:48:49 tanuki k3s[642162]: time="2022-11-27T12:48:49-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.341722 642162 controller.go:611] quota admission added evaluator for: events.events.k8s.io | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.422321 642162 shared_informer.go:262] Caches are synced for service config | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.422430 642162 shared_informer.go:262] Caches are synced for endpoint slice config | |
| Nov 27 12:48:49 tanuki k3s[642162]: I1127 12:48:49.426198 642162 shared_informer.go:262] Caches are synced for node config | |
| Nov 27 12:48:50 tanuki k3s[642162]: I1127 12:48:50.198456 642162 serving.go:355] Generated self-signed cert in-memory | |
| Nov 27 12:48:50 tanuki k3s[642162]: I1127 12:48:50.995457 642162 controllermanager.go:180] Version: v1.24.4+k3s1 | |
| Nov 27 12:48:50 tanuki k3s[642162]: I1127 12:48:50.995530 642162 controllermanager.go:182] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.004509 642162 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.004909 642162 shared_informer.go:255] Waiting for caches to sync for RequestHeaderAuthRequestController | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.005163 642162 secure_serving.go:210] Serving securely on 127.0.0.1:10257 | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.005464 642162 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.005685 642162 shared_informer.go:255] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.005951 642162 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.006240 642162 shared_informer.go:255] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.006633 642162 tlsconfig.go:240] "Starting DynamicServingCertificateController" | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.106075 642162 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.106088 642162 shared_informer.go:262] Caches are synced for RequestHeaderAuthRequestController | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.106778 642162 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.465101 642162 server.go:147] "Starting Kubernetes Scheduler" version="v1.24.4+k3s1" | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.466355 642162 server.go:149] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.476777 642162 secure_serving.go:210] Serving securely on 127.0.0.1:10259 | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.477361 642162 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.478493 642162 shared_informer.go:255] Waiting for caches to sync for RequestHeaderAuthRequestController | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.477414 642162 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.487217 642162 shared_informer.go:255] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.477448 642162 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.489354 642162 shared_informer.go:255] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.477578 642162 tlsconfig.go:240] "Starting DynamicServingCertificateController" | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.579492 642162 shared_informer.go:262] Caches are synced for RequestHeaderAuthRequestController | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.588590 642162 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file | |
| Nov 27 12:48:51 tanuki k3s[642162]: I1127 12:48:51.592819 642162 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file | |
| Nov 27 12:48:52 tanuki k3s[642162]: I1127 12:48:52.325973 642162 controllermanager.go:143] Version: v1.24.4+k3s1 | |
| Nov 27 12:48:52 tanuki k3s[642162]: I1127 12:48:52.335241 642162 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController | |
| Nov 27 12:48:52 tanuki k3s[642162]: I1127 12:48:52.335298 642162 shared_informer.go:255] Waiting for caches to sync for RequestHeaderAuthRequestController | |
| Nov 27 12:48:52 tanuki k3s[642162]: I1127 12:48:52.335380 642162 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" | |
| Nov 27 12:48:52 tanuki k3s[642162]: I1127 12:48:52.335409 642162 shared_informer.go:255] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file | |
| Nov 27 12:48:52 tanuki k3s[642162]: I1127 12:48:52.335499 642162 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" | |
| Nov 27 12:48:52 tanuki k3s[642162]: I1127 12:48:52.335526 642162 shared_informer.go:255] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file | |
| Nov 27 12:48:52 tanuki k3s[642162]: I1127 12:48:52.335806 642162 secure_serving.go:210] Serving securely on 127.0.0.1:10258 | |
| Nov 27 12:48:52 tanuki k3s[642162]: I1127 12:48:52.337217 642162 tlsconfig.go:240] "Starting DynamicServingCertificateController" | |
| Nov 27 12:48:52 tanuki k3s[642162]: I1127 12:48:52.426715 642162 request.go:601] Waited for 1.045186799s due to client-side throttling, not priority and fairness, request: GET:https://127.0.0.1:6444/apis/storage.k8s.io/v1beta1 | |
| Nov 27 12:48:52 tanuki k3s[642162]: I1127 12:48:52.435782 642162 shared_informer.go:262] Caches are synced for RequestHeaderAuthRequestController | |
| Nov 27 12:48:52 tanuki k3s[642162]: I1127 12:48:52.435796 642162 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file | |
| Nov 27 12:48:52 tanuki k3s[642162]: I1127 12:48:52.436142 642162 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file | |
| Nov 27 12:48:53 tanuki k3s[642162]: E1127 12:48:53.029925 642162 controllermanager.go:467] unable to get all supported resources from server: unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.031771 642162 shared_informer.go:255] Waiting for caches to sync for tokens | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.049163 642162 controllermanager.go:593] Started "serviceaccount" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.049435 642162 serviceaccounts_controller.go:117] Starting service account controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.049477 642162 shared_informer.go:255] Waiting for caches to sync for service account | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.058388 642162 controllermanager.go:593] Started "csrcleaner" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.059360 642162 cleaner.go:82] Starting CSR cleaner controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.068997 642162 controllermanager.go:593] Started "ttl" | |
| Nov 27 12:48:53 tanuki k3s[642162]: W1127 12:48:53.069054 642162 controllermanager.go:558] "route" is disabled | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.069095 642162 ttl_controller.go:121] Starting TTL controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.069121 642162 shared_informer.go:255] Waiting for caches to sync for TTL | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.077231 642162 controllermanager.go:593] Started "persistentvolume-expander" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.077288 642162 expand_controller.go:341] Starting expand controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.077316 642162 shared_informer.go:255] Waiting for caches to sync for expand | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.086187 642162 controllermanager.go:593] Started "replicationcontroller" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.086301 642162 replica_set.go:205] Starting replicationcontroller controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.086331 642162 shared_informer.go:255] Waiting for caches to sync for ReplicationController | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.095438 642162 controllermanager.go:593] Started "statefulset" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.095509 642162 stateful_set.go:147] Starting stateful set controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.096585 642162 shared_informer.go:255] Waiting for caches to sync for stateful set | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.106002 642162 controllermanager.go:593] Started "ephemeral-volume" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.106352 642162 controller.go:170] Starting ephemeral volume controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.106932 642162 shared_informer.go:255] Waiting for caches to sync for ephemeral | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.116860 642162 controllermanager.go:593] Started "endpointslice" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.116938 642162 endpointslice_controller.go:257] Starting endpoint slice controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.117837 642162 shared_informer.go:255] Waiting for caches to sync for endpoint_slice | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.127766 642162 controllermanager.go:593] Started "daemonset" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.128359 642162 daemon_controller.go:284] Starting daemon sets controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.128815 642162 shared_informer.go:255] Waiting for caches to sync for daemon sets | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.134954 642162 shared_informer.go:262] Caches are synced for tokens | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.138226 642162 controllermanager.go:593] Started "job" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.138865 642162 job_controller.go:184] Starting job controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.139617 642162 shared_informer.go:255] Waiting for caches to sync for job | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.156516 642162 controllermanager.go:593] Started "disruption" | |
| Nov 27 12:48:53 tanuki k3s[642162]: W1127 12:48:53.157166 642162 controllermanager.go:558] "bootstrapsigner" is disabled | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.156571 642162 disruption.go:363] Starting disruption controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.158549 642162 shared_informer.go:255] Waiting for caches to sync for disruption | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.167962 642162 controllermanager.go:593] Started "pv-protection" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.170318 642162 pv_protection_controller.go:79] Starting PV protection controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.170374 642162 shared_informer.go:255] Waiting for caches to sync for PV protection | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.177914 642162 controllermanager.go:593] Started "podgc" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.177994 642162 gc_controller.go:92] Starting GC controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.178025 642162 shared_informer.go:255] Waiting for caches to sync for GC | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.186252 642162 controllermanager.go:593] Started "deployment" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.186366 642162 deployment_controller.go:153] "Starting controller" controller="deployment" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.186404 642162 shared_informer.go:255] Waiting for caches to sync for deployment | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.195577 642162 controllermanager.go:593] Started "replicaset" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.195647 642162 replica_set.go:205] Starting replicaset controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.195835 642162 shared_informer.go:255] Waiting for caches to sync for ReplicaSet | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.227174 642162 controllermanager.go:593] Started "horizontalpodautoscaling" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.227283 642162 horizontal.go:168] Starting HPA controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.227310 642162 shared_informer.go:255] Waiting for caches to sync for HPA | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.235233 642162 controllermanager.go:593] Started "csrapproving" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.235894 642162 certificate_controller.go:119] Starting certificate controller "csrapproving" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.236447 642162 shared_informer.go:255] Waiting for caches to sync for certificate-csrapproving | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.244150 642162 controllermanager.go:593] Started "attachdetach" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.244230 642162 attach_detach_controller.go:328] Starting attach detach controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.244799 642162 shared_informer.go:255] Waiting for caches to sync for attach detach | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.253216 642162 controllermanager.go:593] Started "pvc-protection" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.253304 642162 pvc_protection_controller.go:103] "Starting PVC protection controller" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.253842 642162 shared_informer.go:255] Waiting for caches to sync for PVC protection | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.262701 642162 controllermanager.go:593] Started "root-ca-cert-publisher" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.262802 642162 publisher.go:107] Starting root CA certificate configmap publisher | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.263385 642162 shared_informer.go:255] Waiting for caches to sync for crt configmap | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.272276 642162 controllermanager.go:593] Started "endpointslicemirroring" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.272358 642162 endpointslicemirroring_controller.go:212] Starting EndpointSliceMirroring controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.272390 642162 shared_informer.go:255] Waiting for caches to sync for endpoint_slice_mirroring | |
| Nov 27 12:48:53 tanuki k3s[642162]: E1127 12:48:53.360980 642162 resource_quota_controller.go:162] initial discovery check failure, continuing and counting on future sync update: unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.361201 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for statefulsets.apps | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.361305 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for leases.coordination.k8s.io | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.361431 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for helmchartconfigs.helm.cattle.io | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.361585 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for limitranges | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.361667 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for events.events.k8s.io | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.361727 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for horizontalpodautoscalers.autoscaling | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.361813 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for ingresses.networking.k8s.io | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.361882 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for endpointslices.discovery.k8s.io | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.361945 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for controllerrevisions.apps | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.362013 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for cronjobs.batch | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.362106 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for addons.k3s.cattle.io | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.362314 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for roles.rbac.authorization.k8s.io | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.362398 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for endpoints | |
| Nov 27 12:48:53 tanuki k3s[642162]: W1127 12:48:53.362450 642162 shared_informer.go:533] resyncPeriod 15h33m58.825689881s is smaller than resyncCheckPeriod 19h0m32.934338663s and the informer has already started. Changing it to 19h0m32.934338663s | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.362613 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for serviceaccounts | |
| Nov 27 12:48:53 tanuki k3s[642162]: W1127 12:48:53.362670 642162 shared_informer.go:533] resyncPeriod 12h58m45.532279476s is smaller than resyncCheckPeriod 19h0m32.934338663s and the informer has already started. Changing it to 19h0m32.934338663s | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.362789 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for replicasets.apps | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.362861 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for daemonsets.apps | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.362941 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for poddisruptionbudgets.policy | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.363035 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for csistoragecapacities.storage.k8s.io | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.363129 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for helmcharts.helm.cattle.io | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.363239 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for deployments.apps | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.363326 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for podtemplates | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.363402 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for jobs.batch | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.363498 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for networkpolicies.networking.k8s.io | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.363579 642162 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for rolebindings.rbac.authorization.k8s.io | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.363666 642162 controllermanager.go:593] Started "resourcequota" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.364324 642162 resource_quota_controller.go:273] Starting resource quota controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.364383 642162 shared_informer.go:255] Waiting for caches to sync for resource quota | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.364445 642162 resource_quota_monitor.go:308] QuotaMonitor running | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.379999 642162 controllermanager.go:593] Started "endpoint" | |
| Nov 27 12:48:53 tanuki k3s[642162]: W1127 12:48:53.380584 642162 controllermanager.go:558] "service" is disabled | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.381544 642162 endpoints_controller.go:178] Starting endpoint controller | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.382049 642162 shared_informer.go:255] Waiting for caches to sync for endpoint | |
| Nov 27 12:48:53 tanuki k3s[642162]: E1127 12:48:53.400560 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.400747 642162 certificate_controller.go:119] Starting certificate controller "csrsigning-kubelet-serving" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.400787 642162 shared_informer.go:255] Waiting for caches to sync for certificate-csrsigning-kubelet-serving | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.400863 642162 dynamic_serving_content.go:132] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.402439 642162 certificate_controller.go:119] Starting certificate controller "csrsigning-kubelet-client" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.402512 642162 shared_informer.go:255] Waiting for caches to sync for certificate-csrsigning-kubelet-client | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.402610 642162 dynamic_serving_content.go:132] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.404238 642162 certificate_controller.go:119] Starting certificate controller "csrsigning-kube-apiserver-client" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.404674 642162 shared_informer.go:255] Waiting for caches to sync for certificate-csrsigning-kube-apiserver-client | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.404706 642162 dynamic_serving_content.go:132] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.404589 642162 certificate_controller.go:119] Starting certificate controller "csrsigning-legacy-unknown" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.405358 642162 shared_informer.go:255] Waiting for caches to sync for certificate-csrsigning-legacy-unknown | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.404632 642162 dynamic_serving_content.go:132] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.404546 642162 controllermanager.go:593] Started "csrsigning" | |
| Nov 27 12:48:53 tanuki k3s[642162]: W1127 12:48:53.407531 642162 controllermanager.go:558] "tokencleaner" is disabled | |
| Nov 27 12:48:53 tanuki k3s[642162]: I1127 12:48:53.415864 642162 node_ipam_controller.go:91] Sending events to api server. | |
| Nov 27 12:48:54 tanuki k3s[642162]: E1127 12:48:54.359807 642162 controllermanager.go:463] unable to get all supported resources from server: unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:48:54 tanuki k3s[642162]: I1127 12:48:54.360681 642162 node_controller.go:118] Sending events to api server. | |
| Nov 27 12:48:54 tanuki k3s[642162]: I1127 12:48:54.360933 642162 controllermanager.go:291] Started "cloud-node" | |
| Nov 27 12:48:54 tanuki k3s[642162]: I1127 12:48:54.360999 642162 node_controller.go:157] Waiting for informer caches to sync | |
| Nov 27 12:48:54 tanuki k3s[642162]: I1127 12:48:54.361644 642162 node_lifecycle_controller.go:77] Sending events to api server | |
| Nov 27 12:48:54 tanuki k3s[642162]: I1127 12:48:54.361775 642162 controllermanager.go:291] Started "cloud-node-lifecycle" | |
| Nov 27 12:49:02 tanuki k3s[642162]: E1127 12:49:02.494570 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b8e695fdfc5f5226bb3063d26278dbb41e79b248fe82750f68f859f2b5e94b6c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:02 tanuki k3s[642162]: E1127 12:49:02.494765 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b8e695fdfc5f5226bb3063d26278dbb41e79b248fe82750f68f859f2b5e94b6c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:49:02 tanuki k3s[642162]: E1127 12:49:02.494870 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b8e695fdfc5f5226bb3063d26278dbb41e79b248fe82750f68f859f2b5e94b6c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:49:02 tanuki k3s[642162]: E1127 12:49:02.495077 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"b8e695fdfc5f5226bb3063d26278dbb41e79b248fe82750f68f859f2b5e94b6c\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:49:02 tanuki k3s[642162]: E1127 12:49:02.567218 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"15c162d098de580deb9751b0e90d8fc0e5a0ca3ad1fb643e5f799f249a20e999\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:02 tanuki k3s[642162]: E1127 12:49:02.567357 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"15c162d098de580deb9751b0e90d8fc0e5a0ca3ad1fb643e5f799f249a20e999\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:49:02 tanuki k3s[642162]: E1127 12:49:02.567421 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"15c162d098de580deb9751b0e90d8fc0e5a0ca3ad1fb643e5f799f249a20e999\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:49:02 tanuki k3s[642162]: E1127 12:49:02.567579 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"15c162d098de580deb9751b0e90d8fc0e5a0ca3ad1fb643e5f799f249a20e999\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:49:03 tanuki k3s[642162]: E1127 12:49:03.506031 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c55434ad7b75358f932b93beac5e28de62285edc7f6264389d0071f4b82ef2e6\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:03 tanuki k3s[642162]: E1127 12:49:03.506214 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c55434ad7b75358f932b93beac5e28de62285edc7f6264389d0071f4b82ef2e6\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:49:03 tanuki k3s[642162]: E1127 12:49:03.506286 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c55434ad7b75358f932b93beac5e28de62285edc7f6264389d0071f4b82ef2e6\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:49:03 tanuki k3s[642162]: E1127 12:49:03.506446 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"c55434ad7b75358f932b93beac5e28de62285edc7f6264389d0071f4b82ef2e6\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.558754 642162 range_allocator.go:83] Sending events to api server. | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.559113 642162 range_allocator.go:117] No Secondary Service CIDR provided. Skipping filtering out secondary service addresses. | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.559230 642162 controllermanager.go:593] Started "nodeipam" | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.559384 642162 node_ipam_controller.go:154] Starting ipam controller | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.559422 642162 shared_informer.go:255] Waiting for caches to sync for node | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.567243 642162 node_lifecycle_controller.go:377] Sending events to api server. | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.567679 642162 taint_manager.go:163] "Sending events to api server" | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.567835 642162 node_lifecycle_controller.go:505] Controller will reconcile labels. | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.567905 642162 controllermanager.go:593] Started "nodelifecycle" | |
| Nov 27 12:49:03 tanuki k3s[642162]: W1127 12:49:03.567936 642162 controllermanager.go:558] "cloud-node-lifecycle" is disabled | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.567986 642162 node_lifecycle_controller.go:539] Starting node controller | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.568014 642162 shared_informer.go:255] Waiting for caches to sync for taint | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.576485 642162 controllermanager.go:593] Started "persistentvolume-binder" | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.576592 642162 pv_controller_base.go:311] Starting persistent volume controller | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.576621 642162 shared_informer.go:255] Waiting for caches to sync for persistent volume | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.584646 642162 controllermanager.go:593] Started "ttl-after-finished" | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.585042 642162 ttlafterfinished_controller.go:109] Starting TTL after finished controller | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.585296 642162 shared_informer.go:255] Waiting for caches to sync for TTL after finished | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.608455 642162 controllermanager.go:593] Started "garbagecollector" | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.609018 642162 garbagecollector.go:149] Starting garbage collector controller | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.609057 642162 shared_informer.go:255] Waiting for caches to sync for garbage collector | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.609565 642162 graph_builder.go:289] GraphBuilder running | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.618043 642162 controllermanager.go:593] Started "cronjob" | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.618185 642162 cronjob_controllerv2.go:135] "Starting cronjob controller v2" | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.618229 642162 shared_informer.go:255] Waiting for caches to sync for cronjob | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.629072 642162 controllermanager.go:593] Started "clusterrole-aggregation" | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.629119 642162 clusterroleaggregation_controller.go:194] Starting ClusterRoleAggregator | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.629147 642162 shared_informer.go:255] Waiting for caches to sync for ClusterRoleAggregator | |
| Nov 27 12:49:03 tanuki k3s[642162]: W1127 12:49:03.682316 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:49:03 tanuki k3s[642162]: E1127 12:49:03.701900 642162 namespaced_resources_deleter.go:161] unable to get all supported resources from server: unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.702197 642162 controllermanager.go:593] Started "namespace" | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.702611 642162 namespace_controller.go:200] Starting namespace controller | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.702656 642162 shared_informer.go:255] Waiting for caches to sync for namespace | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.733582 642162 shared_informer.go:255] Waiting for caches to sync for resource quota | |
| Nov 27 12:49:03 tanuki k3s[642162]: W1127 12:49:03.743221 642162 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="pibox" does not exist | |
| Nov 27 12:49:03 tanuki k3s[642162]: W1127 12:49:03.747421 642162 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="tanuki" does not exist | |
| Nov 27 12:49:03 tanuki k3s[642162]: E1127 12:49:03.747584 642162 controller_utils.go:244] Error while processing Node Add: failed to allocate cidr from cluster cidr at idx:0: CIDR allocation failed; there are no remaining CIDRs left to allocate in the accepted range | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.748911 642162 event.go:294] "Event occurred" object="tanuki" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="CIDRNotAvailable" message="Node tanuki status is now: CIDRNotAvailable" | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.759720 642162 shared_informer.go:262] Caches are synced for node | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.759806 642162 range_allocator.go:173] Starting range CIDR allocator | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.759826 642162 shared_informer.go:255] Waiting for caches to sync for cidrallocator | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.759854 642162 shared_informer.go:262] Caches are synced for cidrallocator | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.769993 642162 shared_informer.go:262] Caches are synced for TTL | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.786565 642162 shared_informer.go:262] Caches are synced for TTL after finished | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.796219 642162 shared_informer.go:262] Caches are synced for ReplicaSet | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.797684 642162 shared_informer.go:262] Caches are synced for stateful set | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.802630 642162 shared_informer.go:262] Caches are synced for certificate-csrsigning-kubelet-client | |
| Nov 27 12:49:03 tanuki k3s[642162]: E1127 12:49:03.805523 642162 memcache.go:206] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.806410 642162 shared_informer.go:262] Caches are synced for certificate-csrsigning-kube-apiserver-client | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.807085 642162 shared_informer.go:262] Caches are synced for ephemeral | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.811447 642162 shared_informer.go:262] Caches are synced for certificate-csrsigning-kubelet-serving | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.811610 642162 shared_informer.go:262] Caches are synced for certificate-csrsigning-legacy-unknown | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.820172 642162 shared_informer.go:262] Caches are synced for endpoint_slice | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.827960 642162 shared_informer.go:262] Caches are synced for HPA | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.820192 642162 shared_informer.go:262] Caches are synced for cronjob | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.830235 642162 shared_informer.go:262] Caches are synced for ClusterRoleAggregator | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.837776 642162 shared_informer.go:262] Caches are synced for certificate-csrapproving | |
| Nov 27 12:49:03 tanuki k3s[642162]: E1127 12:49:03.840276 642162 memcache.go:104] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.840394 642162 shared_informer.go:262] Caches are synced for job | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.844909 642162 shared_informer.go:262] Caches are synced for attach detach | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.847120 642162 shared_informer.go:255] Waiting for caches to sync for garbage collector | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.854276 642162 shared_informer.go:262] Caches are synced for PVC protection | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.859061 642162 shared_informer.go:262] Caches are synced for disruption | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.859127 642162 disruption.go:371] Sending events to api server. | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.864231 642162 shared_informer.go:262] Caches are synced for crt configmap | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.868777 642162 shared_informer.go:262] Caches are synced for taint | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.869460 642162 node_lifecycle_controller.go:1399] Initializing eviction metric for zone: | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.869659 642162 event.go:294] "Event occurred" object="pibox" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node pibox event: Registered Node pibox in Controller" | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.869499 642162 taint_manager.go:187] "Starting NoExecuteTaintManager" | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.870585 642162 shared_informer.go:262] Caches are synced for PV protection | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.872506 642162 shared_informer.go:262] Caches are synced for endpoint_slice_mirroring | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.876732 642162 shared_informer.go:262] Caches are synced for persistent volume | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.878011 642162 shared_informer.go:262] Caches are synced for expand | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.878565 642162 shared_informer.go:262] Caches are synced for GC | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.882735 642162 shared_informer.go:262] Caches are synced for endpoint | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.886860 642162 shared_informer.go:262] Caches are synced for deployment | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.886859 642162 shared_informer.go:262] Caches are synced for ReplicationController | |
| Nov 27 12:49:03 tanuki k3s[642162]: W1127 12:49:03.899770 642162 node_lifecycle_controller.go:1014] Missing timestamp for Node pibox. Assuming now as a timestamp. | |
| Nov 27 12:49:03 tanuki k3s[642162]: W1127 12:49:03.899899 642162 node_lifecycle_controller.go:1014] Missing timestamp for Node tanuki. Assuming now as a timestamp. | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.899977 642162 node_lifecycle_controller.go:1215] Controller detected that zone is now in state Normal. | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.901051 642162 event.go:294] "Event occurred" object="tanuki" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node tanuki event: Registered Node tanuki in Controller" | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.901656 642162 event.go:294] "Event occurred" object="kube-system/coredns-b96499967-g5jlc" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod kube-system/coredns-b96499967-g5jlc" | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.901994 642162 event.go:294] "Event occurred" object="kube-system/local-path-provisioner-7b7dc8d6f5-n5m8p" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod kube-system/local-path-provisioner-7b7dc8d6f5-n5m8p" | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.902295 642162 event.go:294] "Event occurred" object="kubesail-agent/kubesail-agent-78f6c568c4-559v2" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod kubesail-agent/kubesail-agent-78f6c568c4-559v2" | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.902550 642162 event.go:294] "Event occurred" object="kube-system/metrics-server-668d979685-bqp28" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod kube-system/metrics-server-668d979685-bqp28" | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.929453 642162 shared_informer.go:262] Caches are synced for daemon sets | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.934328 642162 shared_informer.go:262] Caches are synced for resource quota | |
| Nov 27 12:49:03 tanuki k3s[642162]: I1127 12:49:03.969178 642162 shared_informer.go:262] Caches are synced for resource quota | |
| Nov 27 12:49:04 tanuki k3s[642162]: I1127 12:49:04.002858 642162 shared_informer.go:262] Caches are synced for namespace | |
| Nov 27 12:49:04 tanuki k3s[642162]: I1127 12:49:04.049624 642162 shared_informer.go:262] Caches are synced for service account | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:49:04 tanuki k3s[642162]: I1127 12:49:04.447934 642162 shared_informer.go:262] Caches are synced for garbage collector | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:49:04 tanuki k3s[642162]: I1127 12:49:04.509336 642162 shared_informer.go:262] Caches are synced for garbage collector | |
| Nov 27 12:49:04 tanuki k3s[642162]: I1127 12:49:04.510754 642162 garbagecollector.go:158] Garbage collector: all resource monitors have synced. Proceeding to collect garbage | |
| Nov 27 12:49:04 tanuki k3s[642162]: E1127 12:49:04.541616 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a90fe828289f05b4906ae790c5e76cedbb4ea927bfb46b68046dd34824a8c6df\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:04 tanuki k3s[642162]: E1127 12:49:04.541764 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a90fe828289f05b4906ae790c5e76cedbb4ea927bfb46b68046dd34824a8c6df\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:49:04 tanuki k3s[642162]: E1127 12:49:04.541830 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a90fe828289f05b4906ae790c5e76cedbb4ea927bfb46b68046dd34824a8c6df\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:49:04 tanuki k3s[642162]: E1127 12:49:04.541976 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a90fe828289f05b4906ae790c5e76cedbb4ea927bfb46b68046dd34824a8c6df\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:49:04 tanuki k3s[642162]: time="2022-11-27T12:49:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:49:05 tanuki k3s[642162]: time="2022-11-27T12:49:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:49:05 tanuki k3s[642162]: time="2022-11-27T12:49:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:49:05 tanuki k3s[642162]: time="2022-11-27T12:49:05-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:49:15 tanuki k3s[642162]: E1127 12:49:15.471819 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4aa5de3ddfc38d934c46527e20e48c0c223937c8928f14d1003b836bf7c9eb06\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:15 tanuki k3s[642162]: E1127 12:49:15.471981 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4aa5de3ddfc38d934c46527e20e48c0c223937c8928f14d1003b836bf7c9eb06\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:49:15 tanuki k3s[642162]: E1127 12:49:15.472047 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4aa5de3ddfc38d934c46527e20e48c0c223937c8928f14d1003b836bf7c9eb06\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:49:15 tanuki k3s[642162]: E1127 12:49:15.472200 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"4aa5de3ddfc38d934c46527e20e48c0c223937c8928f14d1003b836bf7c9eb06\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:49:15 tanuki k3s[642162]: E1127 12:49:15.475830 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b6b529961871aa42f8b2f20cc039956be0c6443bce86cd2f4c2a28f9bdb699e2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:15 tanuki k3s[642162]: E1127 12:49:15.475974 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b6b529961871aa42f8b2f20cc039956be0c6443bce86cd2f4c2a28f9bdb699e2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:49:15 tanuki k3s[642162]: E1127 12:49:15.476039 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b6b529961871aa42f8b2f20cc039956be0c6443bce86cd2f4c2a28f9bdb699e2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:49:15 tanuki k3s[642162]: E1127 12:49:15.476199 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"b6b529961871aa42f8b2f20cc039956be0c6443bce86cd2f4c2a28f9bdb699e2\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:49:16 tanuki k3s[642162]: E1127 12:49:16.507458 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"80f5f159df2f39f73ed917c51633e353e651840640f393618cf7851281351042\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:16 tanuki k3s[642162]: E1127 12:49:16.507597 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"80f5f159df2f39f73ed917c51633e353e651840640f393618cf7851281351042\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:49:16 tanuki k3s[642162]: E1127 12:49:16.507673 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"80f5f159df2f39f73ed917c51633e353e651840640f393618cf7851281351042\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:49:16 tanuki k3s[642162]: E1127 12:49:16.507816 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"80f5f159df2f39f73ed917c51633e353e651840640f393618cf7851281351042\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:49:17 tanuki k3s[642162]: E1127 12:49:17.499307 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7eb525e6fd97b1e0e124d4230a47d095ce783ff5fa636ac4258c68ce892ba2c9\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:17 tanuki k3s[642162]: E1127 12:49:17.499437 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7eb525e6fd97b1e0e124d4230a47d095ce783ff5fa636ac4258c68ce892ba2c9\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:49:17 tanuki k3s[642162]: E1127 12:49:17.499498 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7eb525e6fd97b1e0e124d4230a47d095ce783ff5fa636ac4258c68ce892ba2c9\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:49:17 tanuki k3s[642162]: E1127 12:49:17.499642 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"7eb525e6fd97b1e0e124d4230a47d095ce783ff5fa636ac4258c68ce892ba2c9\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:49:20 tanuki k3s[642162]: time="2022-11-27T12:49:20-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:49:26 tanuki k3s[642162]: E1127 12:49:26.454784 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0cbbe93717687a97d109591f46ddd9c82fea8718166fa01905d25dadf0b4cefb\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:26 tanuki k3s[642162]: E1127 12:49:26.456038 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0cbbe93717687a97d109591f46ddd9c82fea8718166fa01905d25dadf0b4cefb\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:49:26 tanuki k3s[642162]: E1127 12:49:26.458921 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0cbbe93717687a97d109591f46ddd9c82fea8718166fa01905d25dadf0b4cefb\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:49:26 tanuki k3s[642162]: E1127 12:49:26.459412 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"0cbbe93717687a97d109591f46ddd9c82fea8718166fa01905d25dadf0b4cefb\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:49:27 tanuki k3s[642162]: E1127 12:49:27.457758 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f020aaefa9788442a898299dbbb57a4dfe156a764305e5ca138e98ce54bd2016\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:27 tanuki k3s[642162]: E1127 12:49:27.459043 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f020aaefa9788442a898299dbbb57a4dfe156a764305e5ca138e98ce54bd2016\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:49:27 tanuki k3s[642162]: E1127 12:49:27.459370 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f020aaefa9788442a898299dbbb57a4dfe156a764305e5ca138e98ce54bd2016\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:49:27 tanuki k3s[642162]: E1127 12:49:27.459980 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"f020aaefa9788442a898299dbbb57a4dfe156a764305e5ca138e98ce54bd2016\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:49:28 tanuki k3s[642162]: E1127 12:49:28.529348 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"44d49c48e5de56e2940dc555a2022e7a2e41e8704455890463a8c247c228e5a9\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:28 tanuki k3s[642162]: E1127 12:49:28.529495 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"44d49c48e5de56e2940dc555a2022e7a2e41e8704455890463a8c247c228e5a9\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:49:28 tanuki k3s[642162]: E1127 12:49:28.529558 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"44d49c48e5de56e2940dc555a2022e7a2e41e8704455890463a8c247c228e5a9\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:49:28 tanuki k3s[642162]: E1127 12:49:28.529706 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"44d49c48e5de56e2940dc555a2022e7a2e41e8704455890463a8c247c228e5a9\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:49:30 tanuki k3s[642162]: E1127 12:49:30.533686 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2f93b2473a1d1210a4a3d91416cd1d16701f3d9edc20e3a4db04b6c92b5ea9c2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:30 tanuki k3s[642162]: E1127 12:49:30.535127 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2f93b2473a1d1210a4a3d91416cd1d16701f3d9edc20e3a4db04b6c92b5ea9c2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:49:30 tanuki k3s[642162]: E1127 12:49:30.535472 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2f93b2473a1d1210a4a3d91416cd1d16701f3d9edc20e3a4db04b6c92b5ea9c2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:49:30 tanuki k3s[642162]: E1127 12:49:30.535801 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"2f93b2473a1d1210a4a3d91416cd1d16701f3d9edc20e3a4db04b6c92b5ea9c2\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:49:34 tanuki k3s[642162]: E1127 12:49:34.047036 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:49:34 tanuki k3s[642162]: W1127 12:49:34.492485 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:49:35 tanuki k3s[642162]: time="2022-11-27T12:49:35-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:49:35 tanuki k3s[642162]: time="2022-11-27T12:49:35-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:49:35 tanuki k3s[642162]: time="2022-11-27T12:49:35-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:49:36 tanuki k3s[642162]: time="2022-11-27T12:49:36-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:49:38 tanuki k3s[642162]: E1127 12:49:38.453521 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"30e9c18fbc9b15fa32f15952abbc834516398a7156e50f2836ad9c32857c5aa0\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:38 tanuki k3s[642162]: E1127 12:49:38.453665 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"30e9c18fbc9b15fa32f15952abbc834516398a7156e50f2836ad9c32857c5aa0\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:49:38 tanuki k3s[642162]: E1127 12:49:38.453733 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"30e9c18fbc9b15fa32f15952abbc834516398a7156e50f2836ad9c32857c5aa0\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:49:38 tanuki k3s[642162]: E1127 12:49:38.453889 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"30e9c18fbc9b15fa32f15952abbc834516398a7156e50f2836ad9c32857c5aa0\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:49:41 tanuki k3s[642162]: E1127 12:49:41.500363 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5a9c73bd5064bfa92fa70ecaf7f59d40c89963fa7dcbc719064a360fcabe47d8\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:41 tanuki k3s[642162]: E1127 12:49:41.500586 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5a9c73bd5064bfa92fa70ecaf7f59d40c89963fa7dcbc719064a360fcabe47d8\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:49:41 tanuki k3s[642162]: E1127 12:49:41.500709 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5a9c73bd5064bfa92fa70ecaf7f59d40c89963fa7dcbc719064a360fcabe47d8\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:49:41 tanuki k3s[642162]: E1127 12:49:41.500986 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"5a9c73bd5064bfa92fa70ecaf7f59d40c89963fa7dcbc719064a360fcabe47d8\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:49:42 tanuki k3s[642162]: E1127 12:49:42.535078 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c74f2b9349e220dbb3e22c666a40e69521f796a311912fd3783f7bd5f84c4fa7\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:42 tanuki k3s[642162]: E1127 12:49:42.535207 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c74f2b9349e220dbb3e22c666a40e69521f796a311912fd3783f7bd5f84c4fa7\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:49:42 tanuki k3s[642162]: E1127 12:49:42.535267 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c74f2b9349e220dbb3e22c666a40e69521f796a311912fd3783f7bd5f84c4fa7\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:49:42 tanuki k3s[642162]: E1127 12:49:42.535398 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"c74f2b9349e220dbb3e22c666a40e69521f796a311912fd3783f7bd5f84c4fa7\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:49:44 tanuki k3s[642162]: E1127 12:49:44.502413 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2e9b8e994bdc0a627c0642f9dfd31e634eb1dd14d84dd8cb55846e1ca7f08d97\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:44 tanuki k3s[642162]: E1127 12:49:44.502528 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2e9b8e994bdc0a627c0642f9dfd31e634eb1dd14d84dd8cb55846e1ca7f08d97\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:49:44 tanuki k3s[642162]: E1127 12:49:44.502585 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2e9b8e994bdc0a627c0642f9dfd31e634eb1dd14d84dd8cb55846e1ca7f08d97\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:49:44 tanuki k3s[642162]: E1127 12:49:44.502712 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"2e9b8e994bdc0a627c0642f9dfd31e634eb1dd14d84dd8cb55846e1ca7f08d97\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:49:45 tanuki k3s[642162]: W1127 12:49:45.373274 642162 handler_proxy.go:102] no RequestInfo found in the context | |
| Nov 27 12:49:45 tanuki k3s[642162]: E1127 12:49:45.373359 642162 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService | |
| Nov 27 12:49:45 tanuki k3s[642162]: I1127 12:49:45.373387 642162 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue. | |
| Nov 27 12:49:45 tanuki k3s[642162]: W1127 12:49:45.375192 642162 handler_proxy.go:102] no RequestInfo found in the context | |
| Nov 27 12:49:45 tanuki k3s[642162]: E1127 12:49:45.375516 642162 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable | |
| Nov 27 12:49:45 tanuki k3s[642162]: , Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]] | |
| Nov 27 12:49:45 tanuki k3s[642162]: I1127 12:49:45.375560 642162 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue. | |
| Nov 27 12:49:51 tanuki k3s[642162]: time="2022-11-27T12:49:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:49:51 tanuki k3s[642162]: E1127 12:49:51.507454 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"22f5ea7aecd4d4a48b6157b99fd5ea4a1e58548e003424b32d16d96a27c8f476\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:51 tanuki k3s[642162]: E1127 12:49:51.507601 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"22f5ea7aecd4d4a48b6157b99fd5ea4a1e58548e003424b32d16d96a27c8f476\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:49:51 tanuki k3s[642162]: E1127 12:49:51.507665 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"22f5ea7aecd4d4a48b6157b99fd5ea4a1e58548e003424b32d16d96a27c8f476\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:49:51 tanuki k3s[642162]: E1127 12:49:51.507798 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"22f5ea7aecd4d4a48b6157b99fd5ea4a1e58548e003424b32d16d96a27c8f476\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:49:51 tanuki k3s[642162]: time="2022-11-27T12:49:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:49:51 tanuki k3s[642162]: time="2022-11-27T12:49:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:49:51 tanuki k3s[642162]: time="2022-11-27T12:49:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:49:51 tanuki k3s[642162]: time="2022-11-27T12:49:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:49:51 tanuki k3s[642162]: time="2022-11-27T12:49:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:49:51 tanuki k3s[642162]: time="2022-11-27T12:49:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:49:51 tanuki k3s[642162]: time="2022-11-27T12:49:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:49:51 tanuki k3s[642162]: time="2022-11-27T12:49:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:49:51 tanuki k3s[642162]: time="2022-11-27T12:49:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:49:51 tanuki k3s[642162]: time="2022-11-27T12:49:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:49:51 tanuki k3s[642162]: time="2022-11-27T12:49:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:49:51 tanuki k3s[642162]: time="2022-11-27T12:49:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:49:51 tanuki k3s[642162]: time="2022-11-27T12:49:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:49:52 tanuki k3s[642162]: time="2022-11-27T12:49:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:49:52 tanuki k3s[642162]: time="2022-11-27T12:49:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:49:52 tanuki k3s[642162]: time="2022-11-27T12:49:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:49:52 tanuki k3s[642162]: time="2022-11-27T12:49:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:49:52 tanuki k3s[642162]: time="2022-11-27T12:49:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:49:52 tanuki k3s[642162]: time="2022-11-27T12:49:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:49:52 tanuki k3s[642162]: time="2022-11-27T12:49:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:49:52 tanuki k3s[642162]: time="2022-11-27T12:49:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:49:52 tanuki k3s[642162]: time="2022-11-27T12:49:52-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:49:53 tanuki k3s[642162]: E1127 12:49:53.503666 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e0cd18b58ef47d798df4f3714bc511b5c9e9d735fb741e0f3fd7bf686fe30cea\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:53 tanuki k3s[642162]: E1127 12:49:53.503794 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e0cd18b58ef47d798df4f3714bc511b5c9e9d735fb741e0f3fd7bf686fe30cea\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:49:53 tanuki k3s[642162]: E1127 12:49:53.503851 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e0cd18b58ef47d798df4f3714bc511b5c9e9d735fb741e0f3fd7bf686fe30cea\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:49:53 tanuki k3s[642162]: E1127 12:49:53.504002 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e0cd18b58ef47d798df4f3714bc511b5c9e9d735fb741e0f3fd7bf686fe30cea\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:49:55 tanuki k3s[642162]: E1127 12:49:55.502568 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ef6d33cbc6e862214230a035286642b91a47a7c810c9247f28f26fe482a4e30e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:55 tanuki k3s[642162]: E1127 12:49:55.502714 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ef6d33cbc6e862214230a035286642b91a47a7c810c9247f28f26fe482a4e30e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:49:55 tanuki k3s[642162]: E1127 12:49:55.502784 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ef6d33cbc6e862214230a035286642b91a47a7c810c9247f28f26fe482a4e30e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:49:55 tanuki k3s[642162]: E1127 12:49:55.502920 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"ef6d33cbc6e862214230a035286642b91a47a7c810c9247f28f26fe482a4e30e\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:49:57 tanuki k3s[642162]: E1127 12:49:57.452340 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1809123d2e82dd6dcc13a21ee916994640cc43cfed683bd7b69bf91f888510f0\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:49:57 tanuki k3s[642162]: E1127 12:49:57.452469 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1809123d2e82dd6dcc13a21ee916994640cc43cfed683bd7b69bf91f888510f0\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:49:57 tanuki k3s[642162]: E1127 12:49:57.452533 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1809123d2e82dd6dcc13a21ee916994640cc43cfed683bd7b69bf91f888510f0\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:49:57 tanuki k3s[642162]: E1127 12:49:57.452658 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"1809123d2e82dd6dcc13a21ee916994640cc43cfed683bd7b69bf91f888510f0\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:50:04 tanuki k3s[642162]: E1127 12:50:04.198884 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:50:04 tanuki k3s[642162]: W1127 12:50:04.539971 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:50:05 tanuki k3s[642162]: E1127 12:50:05.447871 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e4e9e2e81536130270a8ae0a4398ea7bbb21616f0ff3f525051b3e5881f3ff91\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:50:05 tanuki k3s[642162]: E1127 12:50:05.448011 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e4e9e2e81536130270a8ae0a4398ea7bbb21616f0ff3f525051b3e5881f3ff91\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:50:05 tanuki k3s[642162]: E1127 12:50:05.448076 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e4e9e2e81536130270a8ae0a4398ea7bbb21616f0ff3f525051b3e5881f3ff91\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:50:05 tanuki k3s[642162]: E1127 12:50:05.448202 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e4e9e2e81536130270a8ae0a4398ea7bbb21616f0ff3f525051b3e5881f3ff91\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:50:06 tanuki k3s[642162]: E1127 12:50:06.456215 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6c10626cef30efe976396d03917e0df8ee0946f0ae7d41f6b72ce9904c53fec5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:50:06 tanuki k3s[642162]: E1127 12:50:06.456334 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6c10626cef30efe976396d03917e0df8ee0946f0ae7d41f6b72ce9904c53fec5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:50:06 tanuki k3s[642162]: E1127 12:50:06.456392 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6c10626cef30efe976396d03917e0df8ee0946f0ae7d41f6b72ce9904c53fec5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:50:06 tanuki k3s[642162]: E1127 12:50:06.456515 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"6c10626cef30efe976396d03917e0df8ee0946f0ae7d41f6b72ce9904c53fec5\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:50:06 tanuki k3s[642162]: E1127 12:50:06.526493 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"31ba29bfc084d183b734e14dc2b7d1cffd73bc6ea041a12ec45d4712d04b93c9\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:50:06 tanuki k3s[642162]: E1127 12:50:06.527485 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"31ba29bfc084d183b734e14dc2b7d1cffd73bc6ea041a12ec45d4712d04b93c9\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:50:06 tanuki k3s[642162]: E1127 12:50:06.527587 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"31ba29bfc084d183b734e14dc2b7d1cffd73bc6ea041a12ec45d4712d04b93c9\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:50:06 tanuki k3s[642162]: E1127 12:50:06.527744 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"31ba29bfc084d183b734e14dc2b7d1cffd73bc6ea041a12ec45d4712d04b93c9\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:50:07 tanuki k3s[642162]: time="2022-11-27T12:50:07-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:50:11 tanuki k3s[642162]: E1127 12:50:11.496945 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1bc4f8770ecae61665fc87703808cc90bd23339bc1d4d4000606ea112e162bfe\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:50:11 tanuki k3s[642162]: E1127 12:50:11.497089 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1bc4f8770ecae61665fc87703808cc90bd23339bc1d4d4000606ea112e162bfe\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:50:11 tanuki k3s[642162]: E1127 12:50:11.497152 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1bc4f8770ecae61665fc87703808cc90bd23339bc1d4d4000606ea112e162bfe\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:50:11 tanuki k3s[642162]: E1127 12:50:11.497282 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"1bc4f8770ecae61665fc87703808cc90bd23339bc1d4d4000606ea112e162bfe\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:50:20 tanuki k3s[642162]: E1127 12:50:20.458546 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5e9457cfe5035a43e94644543e1f39c4f6abe83e5cd5e5fbb680ff3c84552ca5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:50:20 tanuki k3s[642162]: E1127 12:50:20.458679 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5e9457cfe5035a43e94644543e1f39c4f6abe83e5cd5e5fbb680ff3c84552ca5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:50:20 tanuki k3s[642162]: E1127 12:50:20.458738 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5e9457cfe5035a43e94644543e1f39c4f6abe83e5cd5e5fbb680ff3c84552ca5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:50:20 tanuki k3s[642162]: E1127 12:50:20.458867 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"5e9457cfe5035a43e94644543e1f39c4f6abe83e5cd5e5fbb680ff3c84552ca5\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:50:20 tanuki k3s[642162]: E1127 12:50:20.535430 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e180e9a54aa3f8730efcc1feaadabe205e26394e805dee635f2380df3106cb24\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:50:20 tanuki k3s[642162]: E1127 12:50:20.535627 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e180e9a54aa3f8730efcc1feaadabe205e26394e805dee635f2380df3106cb24\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:50:20 tanuki k3s[642162]: E1127 12:50:20.535700 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e180e9a54aa3f8730efcc1feaadabe205e26394e805dee635f2380df3106cb24\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:50:20 tanuki k3s[642162]: E1127 12:50:20.535855 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e180e9a54aa3f8730efcc1feaadabe205e26394e805dee635f2380df3106cb24\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:50:21 tanuki k3s[642162]: E1127 12:50:21.498513 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2e711f0ddf7a2ff254e8e0716c124fa48f799ee038cf6c185ed49cf3508fadfd\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:50:21 tanuki k3s[642162]: E1127 12:50:21.498674 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2e711f0ddf7a2ff254e8e0716c124fa48f799ee038cf6c185ed49cf3508fadfd\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:50:21 tanuki k3s[642162]: E1127 12:50:21.498737 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2e711f0ddf7a2ff254e8e0716c124fa48f799ee038cf6c185ed49cf3508fadfd\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:50:21 tanuki k3s[642162]: E1127 12:50:21.498892 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"2e711f0ddf7a2ff254e8e0716c124fa48f799ee038cf6c185ed49cf3508fadfd\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:50:22 tanuki k3s[642162]: time="2022-11-27T12:50:22-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:50:22 tanuki k3s[642162]: time="2022-11-27T12:50:22-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:50:22 tanuki k3s[642162]: time="2022-11-27T12:50:22-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:50:23 tanuki k3s[642162]: time="2022-11-27T12:50:23-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:50:26 tanuki k3s[642162]: E1127 12:50:26.454018 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8c4b627b243d4e33f8f56411c7fab8ebd51ddd803ce86fba1f090f0a12e02126\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:50:26 tanuki k3s[642162]: E1127 12:50:26.454731 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8c4b627b243d4e33f8f56411c7fab8ebd51ddd803ce86fba1f090f0a12e02126\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:50:26 tanuki k3s[642162]: E1127 12:50:26.454819 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8c4b627b243d4e33f8f56411c7fab8ebd51ddd803ce86fba1f090f0a12e02126\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:50:26 tanuki k3s[642162]: E1127 12:50:26.454965 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"8c4b627b243d4e33f8f56411c7fab8ebd51ddd803ce86fba1f090f0a12e02126\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:50:32 tanuki k3s[642162]: E1127 12:50:32.501265 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ff6e94ce6a6e160afe0ceee3b994a47e4d77a86738174238255174372298d2be\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:50:32 tanuki k3s[642162]: E1127 12:50:32.502361 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ff6e94ce6a6e160afe0ceee3b994a47e4d77a86738174238255174372298d2be\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:50:32 tanuki k3s[642162]: E1127 12:50:32.502455 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ff6e94ce6a6e160afe0ceee3b994a47e4d77a86738174238255174372298d2be\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:50:32 tanuki k3s[642162]: E1127 12:50:32.502609 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"ff6e94ce6a6e160afe0ceee3b994a47e4d77a86738174238255174372298d2be\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:50:34 tanuki k3s[642162]: E1127 12:50:34.329847 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:50:34 tanuki k3s[642162]: E1127 12:50:34.505953 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"46b4707da669cbe653e89baf3815412da1207a02943adf318e881966b6befce5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:50:34 tanuki k3s[642162]: E1127 12:50:34.506089 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"46b4707da669cbe653e89baf3815412da1207a02943adf318e881966b6befce5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:50:34 tanuki k3s[642162]: E1127 12:50:34.507174 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"46b4707da669cbe653e89baf3815412da1207a02943adf318e881966b6befce5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:50:34 tanuki k3s[642162]: E1127 12:50:34.507365 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"46b4707da669cbe653e89baf3815412da1207a02943adf318e881966b6befce5\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:50:34 tanuki k3s[642162]: W1127 12:50:34.588555 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:50:36 tanuki k3s[642162]: E1127 12:50:36.457072 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"618e8574e93e2801b37fcb38aad00bd03424017cf9858e9c01e96991db9e7de1\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:50:36 tanuki k3s[642162]: E1127 12:50:36.458735 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"618e8574e93e2801b37fcb38aad00bd03424017cf9858e9c01e96991db9e7de1\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:50:36 tanuki k3s[642162]: E1127 12:50:36.458854 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"618e8574e93e2801b37fcb38aad00bd03424017cf9858e9c01e96991db9e7de1\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:50:36 tanuki k3s[642162]: E1127 12:50:36.459031 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"618e8574e93e2801b37fcb38aad00bd03424017cf9858e9c01e96991db9e7de1\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:50:38 tanuki k3s[642162]: E1127 12:50:38.455457 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fe28141e8abd8894e27d0e06dbd3ce4e6e34ed01a560ef43552e26428a09c09f\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:50:38 tanuki k3s[642162]: E1127 12:50:38.455594 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fe28141e8abd8894e27d0e06dbd3ce4e6e34ed01a560ef43552e26428a09c09f\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:50:38 tanuki k3s[642162]: E1127 12:50:38.455658 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fe28141e8abd8894e27d0e06dbd3ce4e6e34ed01a560ef43552e26428a09c09f\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:50:38 tanuki k3s[642162]: E1127 12:50:38.455799 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"fe28141e8abd8894e27d0e06dbd3ce4e6e34ed01a560ef43552e26428a09c09f\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:50:38 tanuki k3s[642162]: time="2022-11-27T12:50:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:50:39 tanuki k3s[642162]: time="2022-11-27T12:50:39-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:50:39 tanuki k3s[642162]: time="2022-11-27T12:50:39-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:50:39 tanuki k3s[642162]: time="2022-11-27T12:50:39-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:50:39 tanuki k3s[642162]: time="2022-11-27T12:50:39-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:50:46 tanuki k3s[642162]: E1127 12:50:46.481526 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"672fafbd12411324403685e11ec54fc69331e304956edf31138da863daadbfa8\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:50:46 tanuki k3s[642162]: E1127 12:50:46.482630 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"672fafbd12411324403685e11ec54fc69331e304956edf31138da863daadbfa8\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:50:46 tanuki k3s[642162]: E1127 12:50:46.482722 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"672fafbd12411324403685e11ec54fc69331e304956edf31138da863daadbfa8\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:50:46 tanuki k3s[642162]: E1127 12:50:46.482888 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"672fafbd12411324403685e11ec54fc69331e304956edf31138da863daadbfa8\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:50:47 tanuki k3s[642162]: E1127 12:50:47.484599 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e77780f3cdac85bda0cc2f677a1957f47966c4e0492d4e586276d1cbe17ef12c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:50:47 tanuki k3s[642162]: E1127 12:50:47.484739 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e77780f3cdac85bda0cc2f677a1957f47966c4e0492d4e586276d1cbe17ef12c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:50:47 tanuki k3s[642162]: E1127 12:50:47.484805 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e77780f3cdac85bda0cc2f677a1957f47966c4e0492d4e586276d1cbe17ef12c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:50:47 tanuki k3s[642162]: E1127 12:50:47.484949 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e77780f3cdac85bda0cc2f677a1957f47966c4e0492d4e586276d1cbe17ef12c\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:50:49 tanuki k3s[642162]: E1127 12:50:49.503806 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"09e1de55a58aa2a42a62f35addbf3dd81da70c624804983316bb30409cfcc101\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:50:49 tanuki k3s[642162]: E1127 12:50:49.503959 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"09e1de55a58aa2a42a62f35addbf3dd81da70c624804983316bb30409cfcc101\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:50:49 tanuki k3s[642162]: E1127 12:50:49.504028 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"09e1de55a58aa2a42a62f35addbf3dd81da70c624804983316bb30409cfcc101\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:50:49 tanuki k3s[642162]: E1127 12:50:49.504158 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"09e1de55a58aa2a42a62f35addbf3dd81da70c624804983316bb30409cfcc101\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:50:50 tanuki k3s[642162]: E1127 12:50:50.458518 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ac48ef62b90858120c70be2c90a25bbce9b513711f965af2632334722dec1ca1\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:50:50 tanuki k3s[642162]: E1127 12:50:50.458653 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ac48ef62b90858120c70be2c90a25bbce9b513711f965af2632334722dec1ca1\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:50:50 tanuki k3s[642162]: E1127 12:50:50.458719 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ac48ef62b90858120c70be2c90a25bbce9b513711f965af2632334722dec1ca1\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:50:50 tanuki k3s[642162]: E1127 12:50:50.458841 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"ac48ef62b90858120c70be2c90a25bbce9b513711f965af2632334722dec1ca1\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:50:54 tanuki k3s[642162]: time="2022-11-27T12:50:54-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:50:58 tanuki k3s[642162]: E1127 12:50:58.491036 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a9a4c0e4a1c4793defa42310a6799780608f0f4776deb33a4977adebf1bfc1c7\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:50:58 tanuki k3s[642162]: E1127 12:50:58.491172 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a9a4c0e4a1c4793defa42310a6799780608f0f4776deb33a4977adebf1bfc1c7\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:50:58 tanuki k3s[642162]: E1127 12:50:58.491236 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a9a4c0e4a1c4793defa42310a6799780608f0f4776deb33a4977adebf1bfc1c7\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:50:58 tanuki k3s[642162]: E1127 12:50:58.491377 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a9a4c0e4a1c4793defa42310a6799780608f0f4776deb33a4977adebf1bfc1c7\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:51:00 tanuki k3s[642162]: E1127 12:51:00.455366 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"05933398d2f2bd3d29b00e48865a9809c06a250c7331e11bbc2e694efb4b3b95\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:00 tanuki k3s[642162]: E1127 12:51:00.456653 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"05933398d2f2bd3d29b00e48865a9809c06a250c7331e11bbc2e694efb4b3b95\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:51:00 tanuki k3s[642162]: E1127 12:51:00.457035 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"05933398d2f2bd3d29b00e48865a9809c06a250c7331e11bbc2e694efb4b3b95\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:51:00 tanuki k3s[642162]: E1127 12:51:00.458058 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"05933398d2f2bd3d29b00e48865a9809c06a250c7331e11bbc2e694efb4b3b95\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:51:01 tanuki k3s[642162]: E1127 12:51:01.517525 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ebc2972e881deaf0cd8fae08e493cd50e8695437c85e3bb5792a205544632834\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:01 tanuki k3s[642162]: E1127 12:51:01.518389 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ebc2972e881deaf0cd8fae08e493cd50e8695437c85e3bb5792a205544632834\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:51:01 tanuki k3s[642162]: E1127 12:51:01.518489 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ebc2972e881deaf0cd8fae08e493cd50e8695437c85e3bb5792a205544632834\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:51:01 tanuki k3s[642162]: E1127 12:51:01.518686 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"ebc2972e881deaf0cd8fae08e493cd50e8695437c85e3bb5792a205544632834\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:51:03 tanuki k3s[642162]: E1127 12:51:03.532356 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"35a0c9e9f039f04bcbee2f2e2c6c8f2c9ad7bea2d5c15801eb37eedd73eb062d\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:03 tanuki k3s[642162]: E1127 12:51:03.532601 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"35a0c9e9f039f04bcbee2f2e2c6c8f2c9ad7bea2d5c15801eb37eedd73eb062d\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:51:03 tanuki k3s[642162]: E1127 12:51:03.532728 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"35a0c9e9f039f04bcbee2f2e2c6c8f2c9ad7bea2d5c15801eb37eedd73eb062d\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:51:03 tanuki k3s[642162]: E1127 12:51:03.533007 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"35a0c9e9f039f04bcbee2f2e2c6c8f2c9ad7bea2d5c15801eb37eedd73eb062d\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:51:04 tanuki k3s[642162]: E1127 12:51:04.385623 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:51:04 tanuki k3s[642162]: W1127 12:51:04.631675 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:51:09 tanuki k3s[642162]: time="2022-11-27T12:51:09-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:51:09 tanuki k3s[642162]: time="2022-11-27T12:51:09-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:51:09 tanuki k3s[642162]: time="2022-11-27T12:51:09-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:51:10 tanuki k3s[642162]: time="2022-11-27T12:51:10-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:51:12 tanuki k3s[642162]: E1127 12:51:12.459199 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7ec1b3685ee6ef2341ffc289d8f95681de3b116017e4cdb62f18f5d9ff19edfd\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:12 tanuki k3s[642162]: E1127 12:51:12.459351 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7ec1b3685ee6ef2341ffc289d8f95681de3b116017e4cdb62f18f5d9ff19edfd\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:51:12 tanuki k3s[642162]: E1127 12:51:12.459417 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7ec1b3685ee6ef2341ffc289d8f95681de3b116017e4cdb62f18f5d9ff19edfd\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:51:12 tanuki k3s[642162]: E1127 12:51:12.459557 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"7ec1b3685ee6ef2341ffc289d8f95681de3b116017e4cdb62f18f5d9ff19edfd\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:51:13 tanuki k3s[642162]: E1127 12:51:13.451550 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3ff5daf16c02bb0e6f0eb3426344eaf18146ba3c2e06e69cfe2968dd6c979aca\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:13 tanuki k3s[642162]: E1127 12:51:13.451685 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3ff5daf16c02bb0e6f0eb3426344eaf18146ba3c2e06e69cfe2968dd6c979aca\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:51:13 tanuki k3s[642162]: E1127 12:51:13.451744 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3ff5daf16c02bb0e6f0eb3426344eaf18146ba3c2e06e69cfe2968dd6c979aca\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:51:13 tanuki k3s[642162]: E1127 12:51:13.451879 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"3ff5daf16c02bb0e6f0eb3426344eaf18146ba3c2e06e69cfe2968dd6c979aca\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:51:13 tanuki k3s[642162]: E1127 12:51:13.521471 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f29a5143abb528de849392215bd43f8943fa11b583b42aa96671f144a79d7273\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:13 tanuki k3s[642162]: E1127 12:51:13.521619 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f29a5143abb528de849392215bd43f8943fa11b583b42aa96671f144a79d7273\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:51:13 tanuki k3s[642162]: E1127 12:51:13.521692 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f29a5143abb528de849392215bd43f8943fa11b583b42aa96671f144a79d7273\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:51:13 tanuki k3s[642162]: E1127 12:51:13.521842 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"f29a5143abb528de849392215bd43f8943fa11b583b42aa96671f144a79d7273\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:51:18 tanuki k3s[642162]: E1127 12:51:18.510540 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"eb1b183777a0ac6208856fdcb00a584c7692e3fbc54f6eb8386f9bac0ffa3d07\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:18 tanuki k3s[642162]: E1127 12:51:18.510675 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"eb1b183777a0ac6208856fdcb00a584c7692e3fbc54f6eb8386f9bac0ffa3d07\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:51:18 tanuki k3s[642162]: E1127 12:51:18.510748 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"eb1b183777a0ac6208856fdcb00a584c7692e3fbc54f6eb8386f9bac0ffa3d07\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:51:18 tanuki k3s[642162]: E1127 12:51:18.510891 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"eb1b183777a0ac6208856fdcb00a584c7692e3fbc54f6eb8386f9bac0ffa3d07\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:51:24 tanuki k3s[642162]: E1127 12:51:24.554853 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"84ad9d5825c5a4d1d49676bd87b4acc0b7fb6e742909e9c0ea5d1614e9910c6d\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:24 tanuki k3s[642162]: E1127 12:51:24.555058 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"84ad9d5825c5a4d1d49676bd87b4acc0b7fb6e742909e9c0ea5d1614e9910c6d\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:51:24 tanuki k3s[642162]: E1127 12:51:24.555162 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"84ad9d5825c5a4d1d49676bd87b4acc0b7fb6e742909e9c0ea5d1614e9910c6d\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:51:24 tanuki k3s[642162]: E1127 12:51:24.555362 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"84ad9d5825c5a4d1d49676bd87b4acc0b7fb6e742909e9c0ea5d1614e9910c6d\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:51:25 tanuki k3s[642162]: E1127 12:51:25.523225 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7f6fd56b88dd68fe590ef2d0cc64a47413ceb471425c0994b3a55cc0f65d06ee\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:25 tanuki k3s[642162]: E1127 12:51:25.523945 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7f6fd56b88dd68fe590ef2d0cc64a47413ceb471425c0994b3a55cc0f65d06ee\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:51:25 tanuki k3s[642162]: E1127 12:51:25.524464 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7f6fd56b88dd68fe590ef2d0cc64a47413ceb471425c0994b3a55cc0f65d06ee\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:51:25 tanuki k3s[642162]: E1127 12:51:25.525041 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"7f6fd56b88dd68fe590ef2d0cc64a47413ceb471425c0994b3a55cc0f65d06ee\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:51:25 tanuki k3s[642162]: time="2022-11-27T12:51:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:51:26 tanuki k3s[642162]: time="2022-11-27T12:51:26-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:51:26 tanuki k3s[642162]: time="2022-11-27T12:51:26-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:51:26 tanuki k3s[642162]: time="2022-11-27T12:51:26-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:51:26 tanuki k3s[642162]: time="2022-11-27T12:51:26-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:51:27 tanuki k3s[642162]: E1127 12:51:27.452007 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0bff8ed3d2b2a0ed4ad9367a838ae275473b1447b1ccd3405c0848c2d0471af4\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:27 tanuki k3s[642162]: E1127 12:51:27.452137 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0bff8ed3d2b2a0ed4ad9367a838ae275473b1447b1ccd3405c0848c2d0471af4\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:51:27 tanuki k3s[642162]: E1127 12:51:27.452206 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0bff8ed3d2b2a0ed4ad9367a838ae275473b1447b1ccd3405c0848c2d0471af4\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:51:27 tanuki k3s[642162]: E1127 12:51:27.452350 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"0bff8ed3d2b2a0ed4ad9367a838ae275473b1447b1ccd3405c0848c2d0471af4\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:51:31 tanuki k3s[642162]: E1127 12:51:31.452830 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fad18bcf6c8b3f0a0eae7175a103f35ae29a6914886b1d5040043051805e0a69\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:31 tanuki k3s[642162]: E1127 12:51:31.452962 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fad18bcf6c8b3f0a0eae7175a103f35ae29a6914886b1d5040043051805e0a69\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:51:31 tanuki k3s[642162]: E1127 12:51:31.453027 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fad18bcf6c8b3f0a0eae7175a103f35ae29a6914886b1d5040043051805e0a69\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:51:31 tanuki k3s[642162]: E1127 12:51:31.453178 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"fad18bcf6c8b3f0a0eae7175a103f35ae29a6914886b1d5040043051805e0a69\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:51:34 tanuki k3s[642162]: E1127 12:51:34.434157 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:51:34 tanuki k3s[642162]: W1127 12:51:34.676771 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:51:37 tanuki k3s[642162]: E1127 12:51:37.514871 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"46266e560abca685dbe460480cf14f5736979098d428c0e8d87b902f6b3d4b85\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:37 tanuki k3s[642162]: E1127 12:51:37.515076 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"46266e560abca685dbe460480cf14f5736979098d428c0e8d87b902f6b3d4b85\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:51:37 tanuki k3s[642162]: E1127 12:51:37.515183 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"46266e560abca685dbe460480cf14f5736979098d428c0e8d87b902f6b3d4b85\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:51:37 tanuki k3s[642162]: E1127 12:51:37.515392 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"46266e560abca685dbe460480cf14f5736979098d428c0e8d87b902f6b3d4b85\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:51:37 tanuki k3s[642162]: E1127 12:51:37.555059 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"80da5440585edc5df00a5cceee9f2ef004da1d554497349dd3df1772d4ccb100\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:37 tanuki k3s[642162]: E1127 12:51:37.555204 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"80da5440585edc5df00a5cceee9f2ef004da1d554497349dd3df1772d4ccb100\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:51:37 tanuki k3s[642162]: E1127 12:51:37.555268 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"80da5440585edc5df00a5cceee9f2ef004da1d554497349dd3df1772d4ccb100\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:51:37 tanuki k3s[642162]: E1127 12:51:37.555449 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"80da5440585edc5df00a5cceee9f2ef004da1d554497349dd3df1772d4ccb100\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:51:40 tanuki k3s[642162]: E1127 12:51:40.504930 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0ba55cb8f65a9c8267d110b1ce60157a4c43643cf95b21a72ba40a8fae7c47e4\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:40 tanuki k3s[642162]: E1127 12:51:40.505086 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0ba55cb8f65a9c8267d110b1ce60157a4c43643cf95b21a72ba40a8fae7c47e4\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:51:40 tanuki k3s[642162]: E1127 12:51:40.505152 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0ba55cb8f65a9c8267d110b1ce60157a4c43643cf95b21a72ba40a8fae7c47e4\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:51:40 tanuki k3s[642162]: E1127 12:51:40.505313 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"0ba55cb8f65a9c8267d110b1ce60157a4c43643cf95b21a72ba40a8fae7c47e4\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:51:41 tanuki k3s[642162]: time="2022-11-27T12:51:41-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:51:42 tanuki k3s[642162]: E1127 12:51:42.455436 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"eadcf05a58da886cf7469a7ce5e40be712663cd5285c9ebd34c4ffd4a029df5c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:42 tanuki k3s[642162]: E1127 12:51:42.455577 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"eadcf05a58da886cf7469a7ce5e40be712663cd5285c9ebd34c4ffd4a029df5c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:51:42 tanuki k3s[642162]: E1127 12:51:42.455641 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"eadcf05a58da886cf7469a7ce5e40be712663cd5285c9ebd34c4ffd4a029df5c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:51:42 tanuki k3s[642162]: E1127 12:51:42.455802 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"eadcf05a58da886cf7469a7ce5e40be712663cd5285c9ebd34c4ffd4a029df5c\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:51:44 tanuki k3s[642162]: E1127 12:51:44.321126 642162 repair.go:250] the cluster IP [IPv4]:10.43.0.1 for service kubernetes/default is not within the service CIDR 172.31.11.0/24; please recreate | |
| Nov 27 12:51:44 tanuki k3s[642162]: E1127 12:51:44.321329 642162 repair.go:250] the cluster IP [IPv4]:10.43.0.10 for service kube-dns/kube-system is not within the service CIDR 172.31.11.0/24; please recreate | |
| Nov 27 12:51:44 tanuki k3s[642162]: E1127 12:51:44.322498 642162 repair.go:250] the cluster IP [IPv4]:10.43.198.136 for service metrics-server/kube-system is not within the service CIDR 172.31.11.0/24; please recreate | |
| Nov 27 12:51:45 tanuki k3s[642162]: W1127 12:51:45.374288 642162 handler_proxy.go:102] no RequestInfo found in the context | |
| Nov 27 12:51:45 tanuki k3s[642162]: E1127 12:51:45.375031 642162 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService | |
| Nov 27 12:51:45 tanuki k3s[642162]: I1127 12:51:45.375117 642162 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue. | |
| Nov 27 12:51:45 tanuki k3s[642162]: W1127 12:51:45.377063 642162 handler_proxy.go:102] no RequestInfo found in the context | |
| Nov 27 12:51:45 tanuki k3s[642162]: E1127 12:51:45.377354 642162 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable | |
| Nov 27 12:51:45 tanuki k3s[642162]: , Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]] | |
| Nov 27 12:51:45 tanuki k3s[642162]: I1127 12:51:45.377603 642162 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue. | |
| Nov 27 12:51:51 tanuki k3s[642162]: E1127 12:51:51.514249 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"332aee5848b198a69b2ac7b9e7766b19ba388c6af034b75cf6d87702cb5fbcab\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:51 tanuki k3s[642162]: E1127 12:51:51.514379 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"332aee5848b198a69b2ac7b9e7766b19ba388c6af034b75cf6d87702cb5fbcab\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:51:51 tanuki k3s[642162]: E1127 12:51:51.514439 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"332aee5848b198a69b2ac7b9e7766b19ba388c6af034b75cf6d87702cb5fbcab\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:51:51 tanuki k3s[642162]: E1127 12:51:51.514576 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"332aee5848b198a69b2ac7b9e7766b19ba388c6af034b75cf6d87702cb5fbcab\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:51:52 tanuki k3s[642162]: E1127 12:51:52.504587 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6f7234e4941ab7a79e5e32d6187f9ba097dc09ade6db24abe0c31c8c7667b20f\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:52 tanuki k3s[642162]: E1127 12:51:52.505367 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6f7234e4941ab7a79e5e32d6187f9ba097dc09ade6db24abe0c31c8c7667b20f\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:51:52 tanuki k3s[642162]: E1127 12:51:52.505755 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6f7234e4941ab7a79e5e32d6187f9ba097dc09ade6db24abe0c31c8c7667b20f\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:51:52 tanuki k3s[642162]: E1127 12:51:52.506283 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"6f7234e4941ab7a79e5e32d6187f9ba097dc09ade6db24abe0c31c8c7667b20f\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:51:54 tanuki k3s[642162]: E1127 12:51:54.463659 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fcf9646427a66ff084d246170d2f1e9b821c8a278b4e6b797a78e259d95a5208\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:54 tanuki k3s[642162]: E1127 12:51:54.463800 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fcf9646427a66ff084d246170d2f1e9b821c8a278b4e6b797a78e259d95a5208\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:51:54 tanuki k3s[642162]: E1127 12:51:54.463858 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fcf9646427a66ff084d246170d2f1e9b821c8a278b4e6b797a78e259d95a5208\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:51:54 tanuki k3s[642162]: E1127 12:51:54.464004 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"fcf9646427a66ff084d246170d2f1e9b821c8a278b4e6b797a78e259d95a5208\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:51:55 tanuki k3s[642162]: E1127 12:51:55.452300 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c66fc3c7dc88a439e202687bf018ce968db240766c0fc0a0dae3ebac72dca5a3\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:51:55 tanuki k3s[642162]: E1127 12:51:55.452426 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c66fc3c7dc88a439e202687bf018ce968db240766c0fc0a0dae3ebac72dca5a3\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:51:55 tanuki k3s[642162]: E1127 12:51:55.452489 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c66fc3c7dc88a439e202687bf018ce968db240766c0fc0a0dae3ebac72dca5a3\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:51:55 tanuki k3s[642162]: E1127 12:51:55.452614 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"c66fc3c7dc88a439e202687bf018ce968db240766c0fc0a0dae3ebac72dca5a3\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:51:56 tanuki k3s[642162]: time="2022-11-27T12:51:56-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:51:56 tanuki k3s[642162]: time="2022-11-27T12:51:56-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:51:56 tanuki k3s[642162]: time="2022-11-27T12:51:56-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:51:57 tanuki k3s[642162]: time="2022-11-27T12:51:57-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:52:03 tanuki k3s[642162]: E1127 12:52:03.463614 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4529b90cfc62ad40cd69bdccc185581acf0274673d1e211cebad2a13e9ad1354\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:03 tanuki k3s[642162]: E1127 12:52:03.463757 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4529b90cfc62ad40cd69bdccc185581acf0274673d1e211cebad2a13e9ad1354\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:52:03 tanuki k3s[642162]: E1127 12:52:03.463815 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4529b90cfc62ad40cd69bdccc185581acf0274673d1e211cebad2a13e9ad1354\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:52:03 tanuki k3s[642162]: E1127 12:52:03.463943 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"4529b90cfc62ad40cd69bdccc185581acf0274673d1e211cebad2a13e9ad1354\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:52:03 tanuki k3s[642162]: E1127 12:52:03.528095 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"170149ee0d6cf886490b904c999b05de20813f00d85638dcd5bcde136b12fed5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:03 tanuki k3s[642162]: E1127 12:52:03.528232 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"170149ee0d6cf886490b904c999b05de20813f00d85638dcd5bcde136b12fed5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:52:03 tanuki k3s[642162]: E1127 12:52:03.528299 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"170149ee0d6cf886490b904c999b05de20813f00d85638dcd5bcde136b12fed5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:52:03 tanuki k3s[642162]: E1127 12:52:03.528434 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"170149ee0d6cf886490b904c999b05de20813f00d85638dcd5bcde136b12fed5\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:52:04 tanuki k3s[642162]: E1127 12:52:04.471070 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:52:04 tanuki k3s[642162]: W1127 12:52:04.723323 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:52:06 tanuki k3s[642162]: E1127 12:52:06.551191 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d8169dfe0928d4888004f9c9fac086e447df9f1d2d1d69e6dfb428e2780fbf71\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:06 tanuki k3s[642162]: E1127 12:52:06.551338 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d8169dfe0928d4888004f9c9fac086e447df9f1d2d1d69e6dfb428e2780fbf71\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:52:06 tanuki k3s[642162]: E1127 12:52:06.551409 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d8169dfe0928d4888004f9c9fac086e447df9f1d2d1d69e6dfb428e2780fbf71\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:52:06 tanuki k3s[642162]: E1127 12:52:06.551537 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"d8169dfe0928d4888004f9c9fac086e447df9f1d2d1d69e6dfb428e2780fbf71\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:52:06 tanuki k3s[642162]: E1127 12:52:06.570286 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"13dc51421a92a1a958dd986dbdeb4252270e4297202a1e0a6bc698c828fcf3b4\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:06 tanuki k3s[642162]: E1127 12:52:06.571131 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"13dc51421a92a1a958dd986dbdeb4252270e4297202a1e0a6bc698c828fcf3b4\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:52:06 tanuki k3s[642162]: E1127 12:52:06.571762 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"13dc51421a92a1a958dd986dbdeb4252270e4297202a1e0a6bc698c828fcf3b4\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:52:06 tanuki k3s[642162]: E1127 12:52:06.572701 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"13dc51421a92a1a958dd986dbdeb4252270e4297202a1e0a6bc698c828fcf3b4\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:52:12 tanuki k3s[642162]: time="2022-11-27T12:52:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:52:12 tanuki k3s[642162]: time="2022-11-27T12:52:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:52:12 tanuki k3s[642162]: time="2022-11-27T12:52:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:52:12 tanuki k3s[642162]: time="2022-11-27T12:52:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:52:12 tanuki k3s[642162]: time="2022-11-27T12:52:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:52:12 tanuki k3s[642162]: time="2022-11-27T12:52:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:52:12 tanuki k3s[642162]: time="2022-11-27T12:52:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:52:12 tanuki k3s[642162]: time="2022-11-27T12:52:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:52:12 tanuki k3s[642162]: time="2022-11-27T12:52:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:52:12 tanuki k3s[642162]: time="2022-11-27T12:52:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:52:12 tanuki k3s[642162]: time="2022-11-27T12:52:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:52:12 tanuki k3s[642162]: time="2022-11-27T12:52:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:52:12 tanuki k3s[642162]: time="2022-11-27T12:52:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:52:12 tanuki k3s[642162]: time="2022-11-27T12:52:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:52:12 tanuki k3s[642162]: time="2022-11-27T12:52:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:52:13 tanuki k3s[642162]: time="2022-11-27T12:52:13-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:52:13 tanuki k3s[642162]: time="2022-11-27T12:52:13-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:52:13 tanuki k3s[642162]: time="2022-11-27T12:52:13-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:52:13 tanuki k3s[642162]: time="2022-11-27T12:52:13-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:52:13 tanuki k3s[642162]: time="2022-11-27T12:52:13-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:52:13 tanuki k3s[642162]: time="2022-11-27T12:52:13-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:52:13 tanuki k3s[642162]: time="2022-11-27T12:52:13-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:52:13 tanuki k3s[642162]: time="2022-11-27T12:52:13-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:52:14 tanuki k3s[642162]: E1127 12:52:14.460239 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a7df5a36ba48d1a6e0769c3ed0e6d4018a9efae266b5da1110509938087a4e93\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:14 tanuki k3s[642162]: E1127 12:52:14.462323 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a7df5a36ba48d1a6e0769c3ed0e6d4018a9efae266b5da1110509938087a4e93\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:52:14 tanuki k3s[642162]: E1127 12:52:14.462430 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a7df5a36ba48d1a6e0769c3ed0e6d4018a9efae266b5da1110509938087a4e93\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:52:14 tanuki k3s[642162]: E1127 12:52:14.462624 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a7df5a36ba48d1a6e0769c3ed0e6d4018a9efae266b5da1110509938087a4e93\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:52:16 tanuki k3s[642162]: E1127 12:52:16.506538 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c3bedfae10eeec41ec3941bc8a3f0efd5d8227f0583181c005088398b6f239ab\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:16 tanuki k3s[642162]: E1127 12:52:16.508633 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c3bedfae10eeec41ec3941bc8a3f0efd5d8227f0583181c005088398b6f239ab\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:52:16 tanuki k3s[642162]: E1127 12:52:16.508724 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c3bedfae10eeec41ec3941bc8a3f0efd5d8227f0583181c005088398b6f239ab\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:52:16 tanuki k3s[642162]: E1127 12:52:16.508883 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"c3bedfae10eeec41ec3941bc8a3f0efd5d8227f0583181c005088398b6f239ab\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:52:20 tanuki k3s[642162]: E1127 12:52:20.567459 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2663d8b81f17a97419600707950b0f8320338cca391f430ed982e99681028471\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:20 tanuki k3s[642162]: E1127 12:52:20.567656 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2663d8b81f17a97419600707950b0f8320338cca391f430ed982e99681028471\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:52:20 tanuki k3s[642162]: E1127 12:52:20.567765 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2663d8b81f17a97419600707950b0f8320338cca391f430ed982e99681028471\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:52:20 tanuki k3s[642162]: E1127 12:52:20.567996 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"2663d8b81f17a97419600707950b0f8320338cca391f430ed982e99681028471\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:52:20 tanuki k3s[642162]: E1127 12:52:20.580200 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"95b79b21f607d96684442305ca0a8e211ff86b61a80e3a1caa82103539dc39b4\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:20 tanuki k3s[642162]: E1127 12:52:20.580339 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"95b79b21f607d96684442305ca0a8e211ff86b61a80e3a1caa82103539dc39b4\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:52:20 tanuki k3s[642162]: E1127 12:52:20.580400 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"95b79b21f607d96684442305ca0a8e211ff86b61a80e3a1caa82103539dc39b4\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:52:20 tanuki k3s[642162]: E1127 12:52:20.580540 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"95b79b21f607d96684442305ca0a8e211ff86b61a80e3a1caa82103539dc39b4\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:52:28 tanuki k3s[642162]: time="2022-11-27T12:52:28-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:52:29 tanuki k3s[642162]: E1127 12:52:29.451304 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"dd186adff45aee5922d82d3bd15e3f9237fc0b9de132b03b124247c32b76a7eb\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:29 tanuki k3s[642162]: E1127 12:52:29.451442 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"dd186adff45aee5922d82d3bd15e3f9237fc0b9de132b03b124247c32b76a7eb\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:52:29 tanuki k3s[642162]: E1127 12:52:29.451510 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"dd186adff45aee5922d82d3bd15e3f9237fc0b9de132b03b124247c32b76a7eb\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:52:29 tanuki k3s[642162]: E1127 12:52:29.451638 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"dd186adff45aee5922d82d3bd15e3f9237fc0b9de132b03b124247c32b76a7eb\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:52:30 tanuki k3s[642162]: E1127 12:52:30.506423 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7e65799f18b2897f2091739a6336277d9cfa904274849d043c6c722994a051aa\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:30 tanuki k3s[642162]: E1127 12:52:30.507519 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7e65799f18b2897f2091739a6336277d9cfa904274849d043c6c722994a051aa\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:52:30 tanuki k3s[642162]: E1127 12:52:30.507783 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7e65799f18b2897f2091739a6336277d9cfa904274849d043c6c722994a051aa\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:52:30 tanuki k3s[642162]: E1127 12:52:30.508087 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"7e65799f18b2897f2091739a6336277d9cfa904274849d043c6c722994a051aa\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:52:33 tanuki k3s[642162]: E1127 12:52:33.506516 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"17bf003917c26628760b8d235e8b36f81c3e6d4df716fe8e668689fff03d99ad\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:33 tanuki k3s[642162]: E1127 12:52:33.507764 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"17bf003917c26628760b8d235e8b36f81c3e6d4df716fe8e668689fff03d99ad\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:52:33 tanuki k3s[642162]: E1127 12:52:33.508173 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"17bf003917c26628760b8d235e8b36f81c3e6d4df716fe8e668689fff03d99ad\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:52:33 tanuki k3s[642162]: E1127 12:52:33.508576 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"17bf003917c26628760b8d235e8b36f81c3e6d4df716fe8e668689fff03d99ad\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:52:34 tanuki k3s[642162]: E1127 12:52:34.461871 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9666f73085ee65860aeeef49a50ba625d4da99a804795e579ddcd15ef5770383\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:34 tanuki k3s[642162]: E1127 12:52:34.462375 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9666f73085ee65860aeeef49a50ba625d4da99a804795e579ddcd15ef5770383\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:52:34 tanuki k3s[642162]: E1127 12:52:34.462715 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9666f73085ee65860aeeef49a50ba625d4da99a804795e579ddcd15ef5770383\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:52:34 tanuki k3s[642162]: E1127 12:52:34.463109 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"9666f73085ee65860aeeef49a50ba625d4da99a804795e579ddcd15ef5770383\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:52:34 tanuki k3s[642162]: E1127 12:52:34.505051 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:52:34 tanuki k3s[642162]: W1127 12:52:34.768210 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:52:43 tanuki k3s[642162]: E1127 12:52:43.504283 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6e7691afb3f01b336d1da70493f4014b08b2ff3b55c61529ae3637ff5f1d86ae\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:43 tanuki k3s[642162]: E1127 12:52:43.506687 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6e7691afb3f01b336d1da70493f4014b08b2ff3b55c61529ae3637ff5f1d86ae\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:52:43 tanuki k3s[642162]: E1127 12:52:43.507169 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6e7691afb3f01b336d1da70493f4014b08b2ff3b55c61529ae3637ff5f1d86ae\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:52:43 tanuki k3s[642162]: E1127 12:52:43.507666 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"6e7691afb3f01b336d1da70493f4014b08b2ff3b55c61529ae3637ff5f1d86ae\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:52:43 tanuki k3s[642162]: time="2022-11-27T12:52:43-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:52:43 tanuki k3s[642162]: time="2022-11-27T12:52:43-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:52:43 tanuki k3s[642162]: time="2022-11-27T12:52:43-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:52:43 tanuki k3s[642162]: time="2022-11-27T12:52:43-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:52:43 tanuki k3s[642162]: time="2022-11-27T12:52:43-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:52:44 tanuki k3s[642162]: time="2022-11-27T12:52:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:52:44 tanuki k3s[642162]: time="2022-11-27T12:52:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:52:44 tanuki k3s[642162]: time="2022-11-27T12:52:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:52:44 tanuki k3s[642162]: time="2022-11-27T12:52:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:52:44 tanuki k3s[642162]: time="2022-11-27T12:52:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:52:44 tanuki k3s[642162]: time="2022-11-27T12:52:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:52:44 tanuki k3s[642162]: time="2022-11-27T12:52:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:52:44 tanuki k3s[642162]: time="2022-11-27T12:52:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:52:44 tanuki k3s[642162]: time="2022-11-27T12:52:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:52:44 tanuki k3s[642162]: time="2022-11-27T12:52:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:52:44 tanuki k3s[642162]: time="2022-11-27T12:52:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:52:44 tanuki k3s[642162]: time="2022-11-27T12:52:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:52:44 tanuki k3s[642162]: time="2022-11-27T12:52:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:52:44 tanuki k3s[642162]: time="2022-11-27T12:52:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:52:44 tanuki k3s[642162]: time="2022-11-27T12:52:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:52:44 tanuki k3s[642162]: time="2022-11-27T12:52:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:52:44 tanuki k3s[642162]: time="2022-11-27T12:52:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:52:44 tanuki k3s[642162]: time="2022-11-27T12:52:44-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:52:44 tanuki k3s[642162]: E1127 12:52:44.511325 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1d7164bbe0b4f5569247e17bb84670149dff5ade59035b0428e032fec46e06df\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:44 tanuki k3s[642162]: E1127 12:52:44.511463 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1d7164bbe0b4f5569247e17bb84670149dff5ade59035b0428e032fec46e06df\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:52:44 tanuki k3s[642162]: E1127 12:52:44.511531 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1d7164bbe0b4f5569247e17bb84670149dff5ade59035b0428e032fec46e06df\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:52:44 tanuki k3s[642162]: E1127 12:52:44.511657 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"1d7164bbe0b4f5569247e17bb84670149dff5ade59035b0428e032fec46e06df\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:52:46 tanuki k3s[642162]: E1127 12:52:46.491789 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1e241bc8b608e3795eded724b9da949990dd3b19c8e29ad6ddc6064c158a9caf\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:46 tanuki k3s[642162]: E1127 12:52:46.491933 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1e241bc8b608e3795eded724b9da949990dd3b19c8e29ad6ddc6064c158a9caf\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:52:46 tanuki k3s[642162]: E1127 12:52:46.492002 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1e241bc8b608e3795eded724b9da949990dd3b19c8e29ad6ddc6064c158a9caf\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:52:46 tanuki k3s[642162]: E1127 12:52:46.492133 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"1e241bc8b608e3795eded724b9da949990dd3b19c8e29ad6ddc6064c158a9caf\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:52:46 tanuki k3s[642162]: E1127 12:52:46.500202 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e78c313a4ad7611ebdc2af1ed2ee46ddd73fd67110ee9ab752fae8bc4eff3cdb\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:46 tanuki k3s[642162]: E1127 12:52:46.500344 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e78c313a4ad7611ebdc2af1ed2ee46ddd73fd67110ee9ab752fae8bc4eff3cdb\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:52:46 tanuki k3s[642162]: E1127 12:52:46.500411 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e78c313a4ad7611ebdc2af1ed2ee46ddd73fd67110ee9ab752fae8bc4eff3cdb\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:52:46 tanuki k3s[642162]: E1127 12:52:46.500551 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e78c313a4ad7611ebdc2af1ed2ee46ddd73fd67110ee9ab752fae8bc4eff3cdb\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:52:54 tanuki k3s[642162]: E1127 12:52:54.480997 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6fad46dbc8359799b6a7e18dc8d6a1c88bbc1f055353e7db3fdd1a6eb134f8fb\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:54 tanuki k3s[642162]: E1127 12:52:54.481153 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6fad46dbc8359799b6a7e18dc8d6a1c88bbc1f055353e7db3fdd1a6eb134f8fb\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:52:54 tanuki k3s[642162]: E1127 12:52:54.481227 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6fad46dbc8359799b6a7e18dc8d6a1c88bbc1f055353e7db3fdd1a6eb134f8fb\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:52:54 tanuki k3s[642162]: E1127 12:52:54.481376 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"6fad46dbc8359799b6a7e18dc8d6a1c88bbc1f055353e7db3fdd1a6eb134f8fb\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:52:58 tanuki k3s[642162]: E1127 12:52:58.602725 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"84b5df9f5de8365498fee024763237fbbc90aab0fef1fb65098732181d5190d7\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:58 tanuki k3s[642162]: E1127 12:52:58.602897 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"84b5df9f5de8365498fee024763237fbbc90aab0fef1fb65098732181d5190d7\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:52:58 tanuki k3s[642162]: E1127 12:52:58.602996 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"84b5df9f5de8365498fee024763237fbbc90aab0fef1fb65098732181d5190d7\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:52:58 tanuki k3s[642162]: E1127 12:52:58.603169 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"84b5df9f5de8365498fee024763237fbbc90aab0fef1fb65098732181d5190d7\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:52:58 tanuki k3s[642162]: E1127 12:52:58.656370 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a16ce9651cbe0979ae0b89d077e86890acb2e722eb365adaf32934730bbdc7ef\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:58 tanuki k3s[642162]: E1127 12:52:58.657338 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a16ce9651cbe0979ae0b89d077e86890acb2e722eb365adaf32934730bbdc7ef\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:52:58 tanuki k3s[642162]: E1127 12:52:58.657957 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a16ce9651cbe0979ae0b89d077e86890acb2e722eb365adaf32934730bbdc7ef\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:52:58 tanuki k3s[642162]: E1127 12:52:58.658914 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a16ce9651cbe0979ae0b89d077e86890acb2e722eb365adaf32934730bbdc7ef\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:52:58 tanuki k3s[642162]: E1127 12:52:58.667200 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2c6248d227d521e15e47666af3c02708e30d99323f84d08f2d2afc0e8059e276\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:52:58 tanuki k3s[642162]: E1127 12:52:58.668006 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2c6248d227d521e15e47666af3c02708e30d99323f84d08f2d2afc0e8059e276\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:52:58 tanuki k3s[642162]: E1127 12:52:58.668659 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2c6248d227d521e15e47666af3c02708e30d99323f84d08f2d2afc0e8059e276\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:52:58 tanuki k3s[642162]: E1127 12:52:58.669311 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"2c6248d227d521e15e47666af3c02708e30d99323f84d08f2d2afc0e8059e276\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:52:59 tanuki k3s[642162]: time="2022-11-27T12:52:59-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:53:04 tanuki k3s[642162]: E1127 12:53:04.530920 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:53:04 tanuki k3s[642162]: W1127 12:53:04.812493 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:53:06 tanuki k3s[642162]: E1127 12:53:06.499189 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"80dc842c2625a1418fdf1706f96970e805d210a61e11fc11b62a9dbea04a2bb4\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:53:06 tanuki k3s[642162]: E1127 12:53:06.499317 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"80dc842c2625a1418fdf1706f96970e805d210a61e11fc11b62a9dbea04a2bb4\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:53:06 tanuki k3s[642162]: E1127 12:53:06.499377 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"80dc842c2625a1418fdf1706f96970e805d210a61e11fc11b62a9dbea04a2bb4\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:53:06 tanuki k3s[642162]: E1127 12:53:06.499516 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"80dc842c2625a1418fdf1706f96970e805d210a61e11fc11b62a9dbea04a2bb4\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:53:11 tanuki k3s[642162]: E1127 12:53:11.585315 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"56911f657c5b0e01ebf35d4080b0fb2cfe012c7e19ec06167a44d6265bd7e84c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:53:11 tanuki k3s[642162]: E1127 12:53:11.585451 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"56911f657c5b0e01ebf35d4080b0fb2cfe012c7e19ec06167a44d6265bd7e84c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:53:11 tanuki k3s[642162]: E1127 12:53:11.585522 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"56911f657c5b0e01ebf35d4080b0fb2cfe012c7e19ec06167a44d6265bd7e84c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:53:11 tanuki k3s[642162]: E1127 12:53:11.585645 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"56911f657c5b0e01ebf35d4080b0fb2cfe012c7e19ec06167a44d6265bd7e84c\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:53:11 tanuki k3s[642162]: E1127 12:53:11.593007 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"18de75606f3f864285e00acc8685f57d33bc271b174d42cdef89c886b3407d34\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:53:11 tanuki k3s[642162]: E1127 12:53:11.593137 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"18de75606f3f864285e00acc8685f57d33bc271b174d42cdef89c886b3407d34\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:53:11 tanuki k3s[642162]: E1127 12:53:11.593194 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"18de75606f3f864285e00acc8685f57d33bc271b174d42cdef89c886b3407d34\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:53:11 tanuki k3s[642162]: E1127 12:53:11.593315 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"18de75606f3f864285e00acc8685f57d33bc271b174d42cdef89c886b3407d34\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:53:12 tanuki k3s[642162]: E1127 12:53:12.454826 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"440c2c98dca67272b3f25eddff9e8f2be210278f3026dd58356ec101c4910556\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:53:12 tanuki k3s[642162]: E1127 12:53:12.454971 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"440c2c98dca67272b3f25eddff9e8f2be210278f3026dd58356ec101c4910556\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:53:12 tanuki k3s[642162]: E1127 12:53:12.455041 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"440c2c98dca67272b3f25eddff9e8f2be210278f3026dd58356ec101c4910556\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:53:12 tanuki k3s[642162]: E1127 12:53:12.455178 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"440c2c98dca67272b3f25eddff9e8f2be210278f3026dd58356ec101c4910556\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:53:15 tanuki k3s[642162]: time="2022-11-27T12:53:15-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:53:19 tanuki k3s[642162]: E1127 12:53:19.524554 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c90ae95694eef0f4e840329eefb6cbcccd4a7ee5c00b1951666f9485b306f7d8\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:53:19 tanuki k3s[642162]: E1127 12:53:19.524737 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c90ae95694eef0f4e840329eefb6cbcccd4a7ee5c00b1951666f9485b306f7d8\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:53:19 tanuki k3s[642162]: E1127 12:53:19.524841 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c90ae95694eef0f4e840329eefb6cbcccd4a7ee5c00b1951666f9485b306f7d8\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:53:19 tanuki k3s[642162]: E1127 12:53:19.525050 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"c90ae95694eef0f4e840329eefb6cbcccd4a7ee5c00b1951666f9485b306f7d8\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:53:23 tanuki k3s[642162]: E1127 12:53:23.518597 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"699ad74e278f389b4a0c4699333f01e6a51a46c03254dcbdf7c96d983e013798\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:53:23 tanuki k3s[642162]: E1127 12:53:23.518747 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"699ad74e278f389b4a0c4699333f01e6a51a46c03254dcbdf7c96d983e013798\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:53:23 tanuki k3s[642162]: E1127 12:53:23.518808 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"699ad74e278f389b4a0c4699333f01e6a51a46c03254dcbdf7c96d983e013798\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:53:23 tanuki k3s[642162]: E1127 12:53:23.518943 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"699ad74e278f389b4a0c4699333f01e6a51a46c03254dcbdf7c96d983e013798\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:53:23 tanuki k3s[642162]: E1127 12:53:23.528134 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"dfe5716511493f3d2bba1964986c3921a324bd35a99afc8bad19b766d6492bc5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:53:23 tanuki k3s[642162]: E1127 12:53:23.528807 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"dfe5716511493f3d2bba1964986c3921a324bd35a99afc8bad19b766d6492bc5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:53:23 tanuki k3s[642162]: E1127 12:53:23.529199 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"dfe5716511493f3d2bba1964986c3921a324bd35a99afc8bad19b766d6492bc5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:53:23 tanuki k3s[642162]: E1127 12:53:23.529668 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"dfe5716511493f3d2bba1964986c3921a324bd35a99afc8bad19b766d6492bc5\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:53:24 tanuki k3s[642162]: E1127 12:53:24.456923 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bdeb0d352ee1813581927a7a302c540999e8df55626b5196abdaead6fa434743\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:53:24 tanuki k3s[642162]: E1127 12:53:24.457070 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bdeb0d352ee1813581927a7a302c540999e8df55626b5196abdaead6fa434743\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:53:24 tanuki k3s[642162]: E1127 12:53:24.457141 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bdeb0d352ee1813581927a7a302c540999e8df55626b5196abdaead6fa434743\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:53:24 tanuki k3s[642162]: E1127 12:53:24.457286 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"bdeb0d352ee1813581927a7a302c540999e8df55626b5196abdaead6fa434743\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:53:30 tanuki k3s[642162]: time="2022-11-27T12:53:30-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:53:30 tanuki k3s[642162]: time="2022-11-27T12:53:30-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:53:30 tanuki k3s[642162]: time="2022-11-27T12:53:30-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:53:30 tanuki k3s[642162]: time="2022-11-27T12:53:30-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:53:30 tanuki k3s[642162]: time="2022-11-27T12:53:30-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:53:31 tanuki k3s[642162]: time="2022-11-27T12:53:31-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:53:31 tanuki k3s[642162]: time="2022-11-27T12:53:31-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:53:31 tanuki k3s[642162]: time="2022-11-27T12:53:31-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:53:31 tanuki k3s[642162]: time="2022-11-27T12:53:31-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:53:31 tanuki k3s[642162]: time="2022-11-27T12:53:31-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:53:31 tanuki k3s[642162]: time="2022-11-27T12:53:31-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:53:31 tanuki k3s[642162]: time="2022-11-27T12:53:31-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:53:31 tanuki k3s[642162]: time="2022-11-27T12:53:31-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:53:31 tanuki k3s[642162]: time="2022-11-27T12:53:31-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:53:31 tanuki k3s[642162]: time="2022-11-27T12:53:31-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:53:31 tanuki k3s[642162]: time="2022-11-27T12:53:31-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:53:31 tanuki k3s[642162]: time="2022-11-27T12:53:31-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:53:31 tanuki k3s[642162]: time="2022-11-27T12:53:31-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:53:31 tanuki k3s[642162]: time="2022-11-27T12:53:31-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:53:31 tanuki k3s[642162]: time="2022-11-27T12:53:31-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:53:31 tanuki k3s[642162]: time="2022-11-27T12:53:31-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:53:31 tanuki k3s[642162]: time="2022-11-27T12:53:31-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:53:31 tanuki k3s[642162]: time="2022-11-27T12:53:31-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:53:34 tanuki k3s[642162]: E1127 12:53:34.519575 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5ea571c1c9922932db4882e11f9147dc2e37a208a00cd9b1c1f7333ef3426bef\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:53:34 tanuki k3s[642162]: E1127 12:53:34.519707 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5ea571c1c9922932db4882e11f9147dc2e37a208a00cd9b1c1f7333ef3426bef\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:53:34 tanuki k3s[642162]: E1127 12:53:34.519773 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5ea571c1c9922932db4882e11f9147dc2e37a208a00cd9b1c1f7333ef3426bef\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:53:34 tanuki k3s[642162]: E1127 12:53:34.519901 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"5ea571c1c9922932db4882e11f9147dc2e37a208a00cd9b1c1f7333ef3426bef\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:53:34 tanuki k3s[642162]: E1127 12:53:34.636306 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:53:34 tanuki k3s[642162]: W1127 12:53:34.895876 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:53:36 tanuki k3s[642162]: E1127 12:53:36.546901 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"dfcaf55573ff85abd8b8ba79ee1360e1983706b571ea6d1790de15f6cc28e328\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:53:36 tanuki k3s[642162]: E1127 12:53:36.547095 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"dfcaf55573ff85abd8b8ba79ee1360e1983706b571ea6d1790de15f6cc28e328\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:53:36 tanuki k3s[642162]: E1127 12:53:36.547188 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"dfcaf55573ff85abd8b8ba79ee1360e1983706b571ea6d1790de15f6cc28e328\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:53:36 tanuki k3s[642162]: E1127 12:53:36.547361 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"dfcaf55573ff85abd8b8ba79ee1360e1983706b571ea6d1790de15f6cc28e328\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:53:37 tanuki k3s[642162]: E1127 12:53:37.486801 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0406f733c696fe1248ed0e94c5c9baa7a70a4dab7c2e0c7aca798081540ede81\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:53:37 tanuki k3s[642162]: E1127 12:53:37.486971 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0406f733c696fe1248ed0e94c5c9baa7a70a4dab7c2e0c7aca798081540ede81\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:53:37 tanuki k3s[642162]: E1127 12:53:37.487056 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0406f733c696fe1248ed0e94c5c9baa7a70a4dab7c2e0c7aca798081540ede81\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:53:37 tanuki k3s[642162]: E1127 12:53:37.487278 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"0406f733c696fe1248ed0e94c5c9baa7a70a4dab7c2e0c7aca798081540ede81\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:53:38 tanuki k3s[642162]: E1127 12:53:38.458746 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5444c63283192c76985887b38022994075dea0367afff172e8aa3cc72bc45bc2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:53:38 tanuki k3s[642162]: E1127 12:53:38.458882 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5444c63283192c76985887b38022994075dea0367afff172e8aa3cc72bc45bc2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:53:38 tanuki k3s[642162]: E1127 12:53:38.458942 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5444c63283192c76985887b38022994075dea0367afff172e8aa3cc72bc45bc2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:53:38 tanuki k3s[642162]: E1127 12:53:38.459075 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"5444c63283192c76985887b38022994075dea0367afff172e8aa3cc72bc45bc2\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:53:38 tanuki k3s[642162]: time="2022-11-27T12:53:38-08:00" level=info msg="Slow SQL (started: 2022-11-27 12:53:37.429034425 -0800 PST m=+300.699628573) (total time: 1.129970713s): PRAGMA wal_checkpoint(FULL) : [[]]" | |
| Nov 27 12:53:38 tanuki k3s[642162]: time="2022-11-27T12:53:38-08:00" level=info msg="Slow SQL (started: 2022-11-27 12:53:37.520207977 -0800 PST m=+300.790802051) (total time: 1.142883784s): INSERT INTO kine(name, created, deleted, create_revision, prev_revision, lease, value, old_value) values(?, ?, ?, ?, ?, ?, ?, ?) : [[/registry/events/kube-system/metrics-server-668d979685-dt55q.172b8c3601e69960 0 0 963703 963880 3660 [107 56 115 0 10 11 10 2 118 49 18 5 69 118 101 110 116 18 175 6 10 204 2 10 48 109 101 116 114 105 99 115 45 115 101 114 118 101 114 45 54 54 56 100 57 55 57 54 56 53 45 100 116 53 53 113 46 49 55 50 98 56 99 51 54 48 49 101 54 57 57 54 48 18 0 26 11 107 117 98 101 45 115 121 115 116 101 109 34 0 42 36 48 53 101 54 57 53 97 100 45 55 98 53 100 45 52 55 56 53 45 57 56 48 52 45 57 51 97 102 102 54 98 53 97 54 55 48 50 0 56 0 66 8 8 170 155 143 156 6 16 0 122 0 138 1 207 1 10 3 107 51 115 18 6 85 112 100 97 116 101 26 2 118 49 34 8 8 170 155 143 156 6 16 0 50 8 70 105 101 108 100 115 86 49 58 165 1 10 162 1 123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125 66 0 18 103 10 3 80 111 100 18 11 107 117 98 101 45 115 121 115 116 101 109 26 31 109 101 116 114 105 99 115 45 115 101 114 118 101 114 45 54 54 56 100 57 55 57 54 56 53 45 100 116 53 53 113 34 36 98 102 101 51 100 57 57 52 45 55 57 99 49 45 52 51 48 55 45 98 99 97 50 45 51 100 98 48 53 56 51 100 57 57 53 49 42 2 118 49 50 6 57 52 56 55 55 48 58 0 26 22 70 97 105 108 101 100 67 114 101 97 116 101 80 111 100 83 97 110 100 66 111 120 34 162 2 40 99 111 109 98 105 110 101 100 32 102 114 111 109 32 115 105 109 105 108 97 114 32 101 118 101 110 116 115 41 58 32 70 97 105 108 101 100 32 116 111 32 99 114 101 97 116 101 32 112 111 100 32 115 97 110 100 98 111 120 58 32 114 112 99 32 101 114 114 111 114 58 32 99 111 100 101 32 61 32 85 110 107 110 111 119 110 32 100 101 115 99 32 61 32 102 97 105 108 101 100 32 116 111 32 115 101 116 117 112 32 110 101 116 119 111 114 107 32 102 111 114 32 115 97 110 100 98 111 120 32 34 48 52 48 54 102 55 51 51 99 54 57 54 102 101 49 50 52 56 101 100 48 101 57 52 99 53 99 57 98 97 97 55 97 55 48 97 52 100 97 98 55 99 50 101 48 99 55 97 99 97 55 57 56 48 56 49 53 52 48 101 100 101 56 49 34 58 32 112 108 117 103 105 110 32 116 121 112 101 61 34 102 108 97 110 110 101 108 34 32 102 97 105 108 101 100 32 40 97 100 100 41 58 32 111 112 101 110 32 47 114 117 110 47 102 108 97 110 110 101 108 47 115 117 98 110 101 116 46 101 110 118 58 32 110 111 32 115 117 99 104 32 102 105 108 101 32 111 114 32 100 105 114 101 99 116 111 114 121 42 17 10 7 107 117 98 101 108 101 116 18 6 116 97 110 117 107 105 50 8 8 170 155 143 156 6 16 0 58 8 8 209 156 143 156 6 16 0 64 14 74 7 87 97 114 110 105 110 103 82 0 98 0 114 0 122 0 26 0 34 0] [107 56 115 0 10 11 10 2 118 49 18 5 69 118 101 110 116 18 175 6 10 204 2 10 48 109 101 116 114 105 99 115 45 115 101 114 118 101 114 45 54 54 56 100 57 55 57 54 56 53 45 100 116 53 53 113 46 49 55 50 98 56 99 51 54 48 49 101 54 57 57 54 48 18 0 26 11 107 117 98 101 45 115 121 115 116 101 109 34 0 42 36 48 53 101 54 57 53 97 100 45 55 98 53 100 45 52 55 56 53 45 57 56 48 52 45 57 51 97 102 102 54 98 53 97 54 55 48 50 0 56 0 66 8 8 170 155 143 156 6 16 0 122 0 138 1 207 1 10 3 107 51 115 18 6 85 112 100 97 116 101 26 2 118 49 34 8 8 170 155 143 156 6 16 0 50 8 70 105 101 108 100 115 86 49 58 165 1 10 162 1 123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125 66 0 18 103 10 3 80 111 100 18 11 107 117 98 101 45 115 121 115 116 101 109 26 31 109 101 116 114 105 99 115 45 115 101 114 118 101 114 45 54 54 56 100 57 55 57 54 56 53 45 100 116 53 53 113 34 36 98 102 101 51 100 57 57 52 45 55 57 99 49 45 52 51 48 55 45 98 99 97 50 45 51 100 98 48 53 56 51 100 57 57 53 49 42 2 118 49 50 6 57 52 56 55 55 48 58 0 26 22 70 97 105 108 101 100 67 114 101 97 116 101 80 111 100 83 97 110 100 66 111 120 34 162 2 40 99 111 109 98 105 110 101 100 32 102 114 111 109 32 115 105 109 105 108 97 114 32 101 118 101 110 116 115 41 58 32 70 97 105 108 101 100 32 116 111 32 99 114 101 97 116 101 32 112 111 100 32 115 97 110 100 98 111 120 58 32 114 112 99 32 101 114 114 111 114 58 32 99 111 100 101 32 61 32 85 110 107 110 111 119 110 32 100 101 115 99 32 61 32 102 97 105 108 101 100 32 116 111 32 115 101 116 117 112 32 110 101 116 119 111 114 107 32 102 111 114 32 115 97 110 100 98 111 120 32 34 54 57 57 97 100 55 52 101 50 55 56 102 51 56 57 98 52 97 48 99 52 54 57 57 51 51 51 102 48 49 101 54 97 53 49 97 52 54 99 48 51 50 53 52 100 99 98 100 102 55 99 57 54 100 57 56 51 101 48 49 51 55 57 56 34 58 32 112 108 117 103 105 110 32 116 121 112 101 61 34 102 108 97 110 110 101 108 34 32 102 97 105 108 101 100 32 40 97 100 100 41 58 32 111 112 101 110 32 47 114 117 110 47 102 108 97 110 110 101 108 47 115 117 98 110 101 116 46 101 110 118 58 32 110 111 32 115 117 99 104 32 102 105 108 101 32 111 114 32 100 105 114 101 99 116 111 114 121 42 17 10 7 107 117 98 101 108 101 116 18 6 116 97 110 117 107 105 50 8 8 170 155 143 156 6 16 0 58 8 8 195 156 143 156 6 16 0 64 13 74 7 87 97 114 110 105 110 103 82 0 98 0 114 0 122 0 26 0 34 0]]]" | |
| Nov 27 12:53:38 tanuki k3s[642162]: I1127 12:53:38.665454 642162 trace.go:205] Trace[1063558623]: "GuaranteedUpdate etcd3" type:*core.Event (27-Nov-2022 12:53:37.508) (total time: 1156ms): | |
| Nov 27 12:53:38 tanuki k3s[642162]: Trace[1063558623]: ---"Transaction committed" 1149ms (12:53:38.665) | |
| Nov 27 12:53:38 tanuki k3s[642162]: Trace[1063558623]: [1.156691091s] [1.156691091s] END | |
| Nov 27 12:53:38 tanuki k3s[642162]: I1127 12:53:38.666033 642162 trace.go:205] Trace[47313132]: "Patch" url:/api/v1/namespaces/kube-system/events/metrics-server-668d979685-dt55q.172b8c3601e69960,user-agent:k3s/v1.24.4+k3s1 (linux/arm64) kubernetes/c3f830e,audit-id:2e76a9c5-c7a5-4160-9ec4-76e42fbbab6f,client:127.0.0.1,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (27-Nov-2022 12:53:37.508) (total time: 1157ms): | |
| Nov 27 12:53:38 tanuki k3s[642162]: Trace[47313132]: ---"Object stored in database" 1150ms (12:53:38.665) | |
| Nov 27 12:53:38 tanuki k3s[642162]: Trace[47313132]: [1.157537621s] [1.157537621s] END | |
| Nov 27 12:53:45 tanuki k3s[642162]: W1127 12:53:45.094560 642162 handler_proxy.go:102] no RequestInfo found in the context | |
| Nov 27 12:53:45 tanuki k3s[642162]: E1127 12:53:45.094728 642162 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable | |
| Nov 27 12:53:45 tanuki k3s[642162]: , Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]] | |
| Nov 27 12:53:45 tanuki k3s[642162]: I1127 12:53:45.094764 642162 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue. | |
| Nov 27 12:53:45 tanuki k3s[642162]: W1127 12:53:45.094924 642162 handler_proxy.go:102] no RequestInfo found in the context | |
| Nov 27 12:53:45 tanuki k3s[642162]: E1127 12:53:45.095037 642162 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService | |
| Nov 27 12:53:45 tanuki k3s[642162]: I1127 12:53:45.096190 642162 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue. | |
| Nov 27 12:53:45 tanuki k3s[642162]: E1127 12:53:45.503618 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"36eba8dd862d7838e75490008282ad32594dc66e86ad51502d3407aeb5382e6a\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:53:45 tanuki k3s[642162]: E1127 12:53:45.503786 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"36eba8dd862d7838e75490008282ad32594dc66e86ad51502d3407aeb5382e6a\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:53:45 tanuki k3s[642162]: E1127 12:53:45.503851 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"36eba8dd862d7838e75490008282ad32594dc66e86ad51502d3407aeb5382e6a\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:53:45 tanuki k3s[642162]: E1127 12:53:45.504020 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"36eba8dd862d7838e75490008282ad32594dc66e86ad51502d3407aeb5382e6a\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:53:46 tanuki k3s[642162]: W1127 12:53:46.354114 642162 sysinfo.go:203] Nodes topology is not available, providing CPU topology | |
| Nov 27 12:53:46 tanuki k3s[642162]: W1127 12:53:46.357024 642162 machine.go:65] Cannot read vendor id correctly, set empty. | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:53:46 tanuki k3s[642162]: time="2022-11-27T12:53:46-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:53:47 tanuki k3s[642162]: E1127 12:53:47.488317 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9a91d0d78a19a95e4f11575047f804a2150d65a64c33faedd009963313286ecd\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:53:47 tanuki k3s[642162]: E1127 12:53:47.488426 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9a91d0d78a19a95e4f11575047f804a2150d65a64c33faedd009963313286ecd\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:53:47 tanuki k3s[642162]: E1127 12:53:47.488485 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9a91d0d78a19a95e4f11575047f804a2150d65a64c33faedd009963313286ecd\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:53:47 tanuki k3s[642162]: E1127 12:53:47.488606 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"9a91d0d78a19a95e4f11575047f804a2150d65a64c33faedd009963313286ecd\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:53:52 tanuki k3s[642162]: E1127 12:53:52.475194 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a1f4848ed6f986c480db11498d81778b545b49fd18f0f23d6c393e8226e7ca15\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:53:52 tanuki k3s[642162]: E1127 12:53:52.475343 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a1f4848ed6f986c480db11498d81778b545b49fd18f0f23d6c393e8226e7ca15\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:53:52 tanuki k3s[642162]: E1127 12:53:52.475417 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a1f4848ed6f986c480db11498d81778b545b49fd18f0f23d6c393e8226e7ca15\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:53:52 tanuki k3s[642162]: E1127 12:53:52.475559 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a1f4848ed6f986c480db11498d81778b545b49fd18f0f23d6c393e8226e7ca15\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:53:52 tanuki k3s[642162]: E1127 12:53:52.486310 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"78f4b2478d4c1d40a72a049f1f8ed1a308bed1fa442807af740a47accbf2fa30\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:53:52 tanuki k3s[642162]: E1127 12:53:52.486440 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"78f4b2478d4c1d40a72a049f1f8ed1a308bed1fa442807af740a47accbf2fa30\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:53:52 tanuki k3s[642162]: E1127 12:53:52.486497 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"78f4b2478d4c1d40a72a049f1f8ed1a308bed1fa442807af740a47accbf2fa30\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:53:52 tanuki k3s[642162]: E1127 12:53:52.486654 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"78f4b2478d4c1d40a72a049f1f8ed1a308bed1fa442807af740a47accbf2fa30\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:53:57 tanuki k3s[642162]: E1127 12:53:57.499482 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9ca7077672216a1c36b70700efe6b0783d9137528d9279a8aea139752689aebf\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:53:57 tanuki k3s[642162]: E1127 12:53:57.499645 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9ca7077672216a1c36b70700efe6b0783d9137528d9279a8aea139752689aebf\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:53:57 tanuki k3s[642162]: E1127 12:53:57.499721 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9ca7077672216a1c36b70700efe6b0783d9137528d9279a8aea139752689aebf\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:53:57 tanuki k3s[642162]: E1127 12:53:57.499868 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"9ca7077672216a1c36b70700efe6b0783d9137528d9279a8aea139752689aebf\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:53:58 tanuki k3s[642162]: E1127 12:53:58.505271 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3fdd26b9da6280ef91f74e7b168de236c9c2b73ef7304fbc8351289ca7357007\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:53:58 tanuki k3s[642162]: E1127 12:53:58.505408 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3fdd26b9da6280ef91f74e7b168de236c9c2b73ef7304fbc8351289ca7357007\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:53:58 tanuki k3s[642162]: E1127 12:53:58.505471 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3fdd26b9da6280ef91f74e7b168de236c9c2b73ef7304fbc8351289ca7357007\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:53:58 tanuki k3s[642162]: E1127 12:53:58.505625 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"3fdd26b9da6280ef91f74e7b168de236c9c2b73ef7304fbc8351289ca7357007\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:54:01 tanuki k3s[642162]: time="2022-11-27T12:54:01-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:54:02 tanuki k3s[642162]: time="2022-11-27T12:54:02-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:54:04 tanuki k3s[642162]: I1127 12:54:04.036371 642162 taint_manager.go:106] "NoExecuteTaintManager is deleting pod" pod="kube-system/metrics-server-668d979685-bqp28" | |
| Nov 27 12:54:04 tanuki k3s[642162]: I1127 12:54:04.036371 642162 taint_manager.go:106] "NoExecuteTaintManager is deleting pod" pod="kube-system/local-path-provisioner-7b7dc8d6f5-n5m8p" | |
| Nov 27 12:54:04 tanuki k3s[642162]: I1127 12:54:04.036371 642162 taint_manager.go:106] "NoExecuteTaintManager is deleting pod" pod="kubesail-agent/kubesail-agent-78f6c568c4-559v2" | |
| Nov 27 12:54:04 tanuki k3s[642162]: I1127 12:54:04.037824 642162 event.go:294] "Event occurred" object="kube-system/metrics-server-668d979685-bqp28" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Marking for deletion Pod kube-system/metrics-server-668d979685-bqp28" | |
| Nov 27 12:54:04 tanuki k3s[642162]: I1127 12:54:04.037895 642162 event.go:294] "Event occurred" object="kube-system/local-path-provisioner-7b7dc8d6f5-n5m8p" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Marking for deletion Pod kube-system/local-path-provisioner-7b7dc8d6f5-n5m8p" | |
| Nov 27 12:54:04 tanuki k3s[642162]: I1127 12:54:04.036417 642162 taint_manager.go:106] "NoExecuteTaintManager is deleting pod" pod="kube-system/coredns-b96499967-g5jlc" | |
| Nov 27 12:54:04 tanuki k3s[642162]: I1127 12:54:04.038080 642162 event.go:294] "Event occurred" object="kubesail-agent/kubesail-agent-78f6c568c4-559v2" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Marking for deletion Pod kubesail-agent/kubesail-agent-78f6c568c4-559v2" | |
| Nov 27 12:54:04 tanuki k3s[642162]: I1127 12:54:04.038182 642162 event.go:294] "Event occurred" object="kube-system/coredns-b96499967-g5jlc" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Marking for deletion Pod kube-system/coredns-b96499967-g5jlc" | |
| Nov 27 12:54:04 tanuki k3s[642162]: E1127 12:54:04.476244 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f0197f34c69dff798d7311e7169e41b2f95418ca608e39f501dbe8d6e9128bbd\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:54:04 tanuki k3s[642162]: E1127 12:54:04.476402 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f0197f34c69dff798d7311e7169e41b2f95418ca608e39f501dbe8d6e9128bbd\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:54:04 tanuki k3s[642162]: E1127 12:54:04.476476 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f0197f34c69dff798d7311e7169e41b2f95418ca608e39f501dbe8d6e9128bbd\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:54:04 tanuki k3s[642162]: E1127 12:54:04.476639 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"f0197f34c69dff798d7311e7169e41b2f95418ca608e39f501dbe8d6e9128bbd\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:54:04 tanuki k3s[642162]: E1127 12:54:04.489360 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"be34498f426ee64c658b38203558035d4f4e0f58fb15274cd3fcbdfd6473a09e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:54:04 tanuki k3s[642162]: E1127 12:54:04.489502 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"be34498f426ee64c658b38203558035d4f4e0f58fb15274cd3fcbdfd6473a09e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:54:04 tanuki k3s[642162]: E1127 12:54:04.489564 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"be34498f426ee64c658b38203558035d4f4e0f58fb15274cd3fcbdfd6473a09e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:54:04 tanuki k3s[642162]: E1127 12:54:04.489707 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"be34498f426ee64c658b38203558035d4f4e0f58fb15274cd3fcbdfd6473a09e\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:54:04 tanuki k3s[642162]: E1127 12:54:04.662392 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:54:04 tanuki k3s[642162]: W1127 12:54:04.941221 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:54:05 tanuki k3s[642162]: E1127 12:54:05.271055 642162 controller_utils.go:256] Error while processing Node Add/Delete: failed to allocate cidr from cluster cidr at idx:0: CIDR allocation failed; there are no remaining CIDRs left to allocate in the accepted range | |
| Nov 27 12:54:05 tanuki k3s[642162]: I1127 12:54:05.271445 642162 event.go:294] "Event occurred" object="tanuki" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="CIDRNotAvailable" message="Node tanuki status is now: CIDRNotAvailable" | |
| Nov 27 12:54:10 tanuki k3s[642162]: E1127 12:54:10.489874 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5edb14a109c69cabd59907b1b738f5c4f4fb23dc2fc34d0c9f674fc6747d9734\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:54:10 tanuki k3s[642162]: E1127 12:54:10.490007 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5edb14a109c69cabd59907b1b738f5c4f4fb23dc2fc34d0c9f674fc6747d9734\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:54:10 tanuki k3s[642162]: E1127 12:54:10.490070 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5edb14a109c69cabd59907b1b738f5c4f4fb23dc2fc34d0c9f674fc6747d9734\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:54:10 tanuki k3s[642162]: E1127 12:54:10.490244 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"5edb14a109c69cabd59907b1b738f5c4f4fb23dc2fc34d0c9f674fc6747d9734\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:54:12 tanuki k3s[642162]: E1127 12:54:12.501327 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2b4af59b1fe52a103982b76ee5736e6040d5aa52a423071f55eae075458fb978\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:54:12 tanuki k3s[642162]: E1127 12:54:12.502436 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2b4af59b1fe52a103982b76ee5736e6040d5aa52a423071f55eae075458fb978\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:54:12 tanuki k3s[642162]: E1127 12:54:12.502526 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2b4af59b1fe52a103982b76ee5736e6040d5aa52a423071f55eae075458fb978\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:54:12 tanuki k3s[642162]: E1127 12:54:12.502668 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"2b4af59b1fe52a103982b76ee5736e6040d5aa52a423071f55eae075458fb978\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:54:17 tanuki k3s[642162]: E1127 12:54:17.510794 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ab127860657a9cafc4e682176ed78451f9e1aa45798b9018559bbc7883b02f53\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:54:17 tanuki k3s[642162]: E1127 12:54:17.510945 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ab127860657a9cafc4e682176ed78451f9e1aa45798b9018559bbc7883b02f53\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:54:17 tanuki k3s[642162]: E1127 12:54:17.511005 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ab127860657a9cafc4e682176ed78451f9e1aa45798b9018559bbc7883b02f53\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:54:17 tanuki k3s[642162]: E1127 12:54:17.511155 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"ab127860657a9cafc4e682176ed78451f9e1aa45798b9018559bbc7883b02f53\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:54:17 tanuki k3s[642162]: time="2022-11-27T12:54:17-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:54:17 tanuki k3s[642162]: time="2022-11-27T12:54:17-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:54:17 tanuki k3s[642162]: time="2022-11-27T12:54:17-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:54:18 tanuki k3s[642162]: time="2022-11-27T12:54:18-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:54:18 tanuki k3s[642162]: E1127 12:54:18.512707 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"386d36cb156ec9894f63e6a949626e81ad7d58b46620b5fcd9c94eba01b89621\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:54:18 tanuki k3s[642162]: E1127 12:54:18.512931 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"386d36cb156ec9894f63e6a949626e81ad7d58b46620b5fcd9c94eba01b89621\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:54:18 tanuki k3s[642162]: E1127 12:54:18.512992 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"386d36cb156ec9894f63e6a949626e81ad7d58b46620b5fcd9c94eba01b89621\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:54:18 tanuki k3s[642162]: E1127 12:54:18.513124 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"386d36cb156ec9894f63e6a949626e81ad7d58b46620b5fcd9c94eba01b89621\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:54:25 tanuki k3s[642162]: E1127 12:54:25.451575 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3293a2be983baed363875a5ecb9b3b4b41617388e728cb31ac001fb8556c62fe\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:54:25 tanuki k3s[642162]: E1127 12:54:25.451710 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3293a2be983baed363875a5ecb9b3b4b41617388e728cb31ac001fb8556c62fe\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:54:25 tanuki k3s[642162]: E1127 12:54:25.451775 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3293a2be983baed363875a5ecb9b3b4b41617388e728cb31ac001fb8556c62fe\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:54:25 tanuki k3s[642162]: E1127 12:54:25.451904 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"3293a2be983baed363875a5ecb9b3b4b41617388e728cb31ac001fb8556c62fe\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:54:25 tanuki k3s[642162]: E1127 12:54:25.536908 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bf5974fa22619abe9671f0f9eb0329115ec6f327617f51fa885901784f3b3b76\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:54:25 tanuki k3s[642162]: E1127 12:54:25.537044 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bf5974fa22619abe9671f0f9eb0329115ec6f327617f51fa885901784f3b3b76\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:54:25 tanuki k3s[642162]: E1127 12:54:25.537108 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bf5974fa22619abe9671f0f9eb0329115ec6f327617f51fa885901784f3b3b76\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:54:25 tanuki k3s[642162]: E1127 12:54:25.537244 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"bf5974fa22619abe9671f0f9eb0329115ec6f327617f51fa885901784f3b3b76\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:54:31 tanuki k3s[642162]: E1127 12:54:31.496970 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0245dceb1a29b2c2254d65e4f7a474129996b25df92ee17aaba34b95a86bba91\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:54:31 tanuki k3s[642162]: E1127 12:54:31.498420 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0245dceb1a29b2c2254d65e4f7a474129996b25df92ee17aaba34b95a86bba91\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:54:31 tanuki k3s[642162]: E1127 12:54:31.498518 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0245dceb1a29b2c2254d65e4f7a474129996b25df92ee17aaba34b95a86bba91\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:54:31 tanuki k3s[642162]: E1127 12:54:31.498671 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"0245dceb1a29b2c2254d65e4f7a474129996b25df92ee17aaba34b95a86bba91\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: E1127 12:54:33.457572 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"79aa85d61b208a26de8fe5ab5c57e2203e7ce7da832227cab8d79d3c93eb135d\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:54:33 tanuki k3s[642162]: E1127 12:54:33.457704 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"79aa85d61b208a26de8fe5ab5c57e2203e7ce7da832227cab8d79d3c93eb135d\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:54:33 tanuki k3s[642162]: E1127 12:54:33.457767 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"79aa85d61b208a26de8fe5ab5c57e2203e7ce7da832227cab8d79d3c93eb135d\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:54:33 tanuki k3s[642162]: E1127 12:54:33.457897 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"79aa85d61b208a26de8fe5ab5c57e2203e7ce7da832227cab8d79d3c93eb135d\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:54:33 tanuki k3s[642162]: time="2022-11-27T12:54:33-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:54:34 tanuki k3s[642162]: time="2022-11-27T12:54:34-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:54:34 tanuki k3s[642162]: time="2022-11-27T12:54:34-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:54:34 tanuki k3s[642162]: E1127 12:54:34.699185 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:54:34 tanuki k3s[642162]: W1127 12:54:34.986992 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:54:36 tanuki k3s[642162]: E1127 12:54:36.455294 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e0df346a526b815c8fa4e9106e9c9c91d4bfa471cf65531d2d7be2142e3faf2e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:54:36 tanuki k3s[642162]: E1127 12:54:36.455421 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e0df346a526b815c8fa4e9106e9c9c91d4bfa471cf65531d2d7be2142e3faf2e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:54:36 tanuki k3s[642162]: E1127 12:54:36.455479 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e0df346a526b815c8fa4e9106e9c9c91d4bfa471cf65531d2d7be2142e3faf2e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:54:36 tanuki k3s[642162]: E1127 12:54:36.455606 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e0df346a526b815c8fa4e9106e9c9c91d4bfa471cf65531d2d7be2142e3faf2e\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:54:40 tanuki k3s[642162]: E1127 12:54:40.500116 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e6955d57d29010b69dfcbae7fddff76b2ee0f6c0ef38306c1060e18b65ea360b\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:54:40 tanuki k3s[642162]: E1127 12:54:40.501471 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e6955d57d29010b69dfcbae7fddff76b2ee0f6c0ef38306c1060e18b65ea360b\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:54:40 tanuki k3s[642162]: E1127 12:54:40.501865 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e6955d57d29010b69dfcbae7fddff76b2ee0f6c0ef38306c1060e18b65ea360b\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:54:40 tanuki k3s[642162]: E1127 12:54:40.502332 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e6955d57d29010b69dfcbae7fddff76b2ee0f6c0ef38306c1060e18b65ea360b\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:54:44 tanuki k3s[642162]: E1127 12:54:44.342037 642162 repair.go:250] the cluster IP [IPv4]:10.43.0.1 for service kubernetes/default is not within the service CIDR 172.31.11.0/24; please recreate | |
| Nov 27 12:54:44 tanuki k3s[642162]: E1127 12:54:44.342143 642162 repair.go:250] the cluster IP [IPv4]:10.43.0.10 for service kube-dns/kube-system is not within the service CIDR 172.31.11.0/24; please recreate | |
| Nov 27 12:54:44 tanuki k3s[642162]: E1127 12:54:44.344084 642162 repair.go:250] the cluster IP [IPv4]:10.43.198.136 for service metrics-server/kube-system is not within the service CIDR 172.31.11.0/24; please recreate | |
| Nov 27 12:54:45 tanuki k3s[642162]: W1127 12:54:45.095903 642162 handler_proxy.go:102] no RequestInfo found in the context | |
| Nov 27 12:54:45 tanuki k3s[642162]: E1127 12:54:45.096072 642162 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable | |
| Nov 27 12:54:45 tanuki k3s[642162]: , Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]] | |
| Nov 27 12:54:45 tanuki k3s[642162]: I1127 12:54:45.096116 642162 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue. | |
| Nov 27 12:54:45 tanuki k3s[642162]: W1127 12:54:45.097147 642162 handler_proxy.go:102] no RequestInfo found in the context | |
| Nov 27 12:54:45 tanuki k3s[642162]: E1127 12:54:45.097410 642162 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService | |
| Nov 27 12:54:45 tanuki k3s[642162]: I1127 12:54:45.097600 642162 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue. | |
| Nov 27 12:54:45 tanuki k3s[642162]: E1127 12:54:45.499989 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8146112ddae0a84b16dd25208e8baf5c0e202ab92580513227bf960508f4f09e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:54:45 tanuki k3s[642162]: E1127 12:54:45.500115 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8146112ddae0a84b16dd25208e8baf5c0e202ab92580513227bf960508f4f09e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:54:45 tanuki k3s[642162]: E1127 12:54:45.500182 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8146112ddae0a84b16dd25208e8baf5c0e202ab92580513227bf960508f4f09e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:54:45 tanuki k3s[642162]: E1127 12:54:45.500320 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"8146112ddae0a84b16dd25208e8baf5c0e202ab92580513227bf960508f4f09e\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:54:47 tanuki k3s[642162]: E1127 12:54:47.487175 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"79ad9042ef2b00f4d07371338d06154e9d6447d4436b6c59c2e1750b7dd3e1be\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:54:47 tanuki k3s[642162]: E1127 12:54:47.487323 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"79ad9042ef2b00f4d07371338d06154e9d6447d4436b6c59c2e1750b7dd3e1be\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:54:47 tanuki k3s[642162]: E1127 12:54:47.487392 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"79ad9042ef2b00f4d07371338d06154e9d6447d4436b6c59c2e1750b7dd3e1be\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:54:47 tanuki k3s[642162]: E1127 12:54:47.487547 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"79ad9042ef2b00f4d07371338d06154e9d6447d4436b6c59c2e1750b7dd3e1be\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:54:48 tanuki k3s[642162]: E1127 12:54:48.457129 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"975646cca2cb69bd892f1cea8882de7d99b642e4355290b2a9809ab954c6b3af\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:54:48 tanuki k3s[642162]: E1127 12:54:48.457276 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"975646cca2cb69bd892f1cea8882de7d99b642e4355290b2a9809ab954c6b3af\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:54:48 tanuki k3s[642162]: E1127 12:54:48.457368 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"975646cca2cb69bd892f1cea8882de7d99b642e4355290b2a9809ab954c6b3af\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:54:48 tanuki k3s[642162]: E1127 12:54:48.457517 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"975646cca2cb69bd892f1cea8882de7d99b642e4355290b2a9809ab954c6b3af\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:54:49 tanuki k3s[642162]: time="2022-11-27T12:54:49-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:54:54 tanuki k3s[642162]: E1127 12:54:54.565230 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8a2d3f56962ee92e39b767fa720686f558e1be57847ce3f016d94506adfee7b7\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:54:54 tanuki k3s[642162]: E1127 12:54:54.565368 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8a2d3f56962ee92e39b767fa720686f558e1be57847ce3f016d94506adfee7b7\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:54:54 tanuki k3s[642162]: E1127 12:54:54.565431 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8a2d3f56962ee92e39b767fa720686f558e1be57847ce3f016d94506adfee7b7\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:54:54 tanuki k3s[642162]: E1127 12:54:54.565583 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"8a2d3f56962ee92e39b767fa720686f558e1be57847ce3f016d94506adfee7b7\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:54:59 tanuki k3s[642162]: E1127 12:54:59.514545 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"aeff0951bbec96c01993274978d5fa415349536f2a1eaa5094da937db0da8467\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:54:59 tanuki k3s[642162]: E1127 12:54:59.514685 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"aeff0951bbec96c01993274978d5fa415349536f2a1eaa5094da937db0da8467\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:54:59 tanuki k3s[642162]: E1127 12:54:59.514747 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"aeff0951bbec96c01993274978d5fa415349536f2a1eaa5094da937db0da8467\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:54:59 tanuki k3s[642162]: E1127 12:54:59.514893 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"aeff0951bbec96c01993274978d5fa415349536f2a1eaa5094da937db0da8467\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:54:59 tanuki k3s[642162]: E1127 12:54:59.550014 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7d2555269b6d76b752f3e846db12eaef26bc4298b59a6c763dbcc464e6eb530a\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:54:59 tanuki k3s[642162]: E1127 12:54:59.550192 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7d2555269b6d76b752f3e846db12eaef26bc4298b59a6c763dbcc464e6eb530a\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:54:59 tanuki k3s[642162]: E1127 12:54:59.550263 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7d2555269b6d76b752f3e846db12eaef26bc4298b59a6c763dbcc464e6eb530a\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:54:59 tanuki k3s[642162]: E1127 12:54:59.550409 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"7d2555269b6d76b752f3e846db12eaef26bc4298b59a6c763dbcc464e6eb530a\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:55:00 tanuki k3s[642162]: E1127 12:55:00.486551 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4adaed43ae19be84c27699f131bc74403ec5e47769041b8f580c096f84940297\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:55:00 tanuki k3s[642162]: E1127 12:55:00.486685 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4adaed43ae19be84c27699f131bc74403ec5e47769041b8f580c096f84940297\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:55:00 tanuki k3s[642162]: E1127 12:55:00.486751 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4adaed43ae19be84c27699f131bc74403ec5e47769041b8f580c096f84940297\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:55:00 tanuki k3s[642162]: E1127 12:55:00.486875 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"4adaed43ae19be84c27699f131bc74403ec5e47769041b8f580c096f84940297\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:55:04 tanuki k3s[642162]: time="2022-11-27T12:55:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:55:04 tanuki k3s[642162]: E1127 12:55:04.741514 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:55:04 tanuki k3s[642162]: time="2022-11-27T12:55:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:55:04 tanuki k3s[642162]: time="2022-11-27T12:55:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:55:04 tanuki k3s[642162]: time="2022-11-27T12:55:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:55:04 tanuki k3s[642162]: time="2022-11-27T12:55:04-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:55:05 tanuki k3s[642162]: time="2022-11-27T12:55:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:55:05 tanuki k3s[642162]: time="2022-11-27T12:55:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:55:05 tanuki k3s[642162]: time="2022-11-27T12:55:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:55:05 tanuki k3s[642162]: W1127 12:55:05.044573 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:55:05 tanuki k3s[642162]: time="2022-11-27T12:55:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:55:05 tanuki k3s[642162]: time="2022-11-27T12:55:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:55:05 tanuki k3s[642162]: time="2022-11-27T12:55:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:55:05 tanuki k3s[642162]: time="2022-11-27T12:55:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:55:05 tanuki k3s[642162]: time="2022-11-27T12:55:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:55:05 tanuki k3s[642162]: time="2022-11-27T12:55:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:55:05 tanuki k3s[642162]: time="2022-11-27T12:55:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:55:05 tanuki k3s[642162]: time="2022-11-27T12:55:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:55:05 tanuki k3s[642162]: time="2022-11-27T12:55:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:55:05 tanuki k3s[642162]: time="2022-11-27T12:55:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:55:05 tanuki k3s[642162]: time="2022-11-27T12:55:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:55:05 tanuki k3s[642162]: time="2022-11-27T12:55:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:55:05 tanuki k3s[642162]: time="2022-11-27T12:55:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:55:05 tanuki k3s[642162]: time="2022-11-27T12:55:05-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:55:05 tanuki k3s[642162]: time="2022-11-27T12:55:05-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:55:08 tanuki k3s[642162]: E1127 12:55:08.513771 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"00abfa1c4cc995fb6eaaae883bde4cab3e923a54554afc780570f47f9243c39f\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:55:08 tanuki k3s[642162]: E1127 12:55:08.515693 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"00abfa1c4cc995fb6eaaae883bde4cab3e923a54554afc780570f47f9243c39f\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:55:08 tanuki k3s[642162]: E1127 12:55:08.516010 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"00abfa1c4cc995fb6eaaae883bde4cab3e923a54554afc780570f47f9243c39f\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:55:08 tanuki k3s[642162]: E1127 12:55:08.516377 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"00abfa1c4cc995fb6eaaae883bde4cab3e923a54554afc780570f47f9243c39f\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:55:13 tanuki k3s[642162]: E1127 12:55:13.590317 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"eef42c28f7fee23f79a27c7daa02116e2895d9f060e08285ec0ee61421df5c5b\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:55:13 tanuki k3s[642162]: E1127 12:55:13.594562 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"eef42c28f7fee23f79a27c7daa02116e2895d9f060e08285ec0ee61421df5c5b\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:55:13 tanuki k3s[642162]: E1127 12:55:13.594722 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"eef42c28f7fee23f79a27c7daa02116e2895d9f060e08285ec0ee61421df5c5b\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:55:13 tanuki k3s[642162]: E1127 12:55:13.594976 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"eef42c28f7fee23f79a27c7daa02116e2895d9f060e08285ec0ee61421df5c5b\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:55:13 tanuki k3s[642162]: E1127 12:55:13.607031 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a6fc7e78568d4e7ca41e8d2d2607d455381d010e133f5c6000af29ad7741b951\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:55:13 tanuki k3s[642162]: E1127 12:55:13.607223 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a6fc7e78568d4e7ca41e8d2d2607d455381d010e133f5c6000af29ad7741b951\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:55:13 tanuki k3s[642162]: E1127 12:55:13.607328 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a6fc7e78568d4e7ca41e8d2d2607d455381d010e133f5c6000af29ad7741b951\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:55:13 tanuki k3s[642162]: E1127 12:55:13.607525 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a6fc7e78568d4e7ca41e8d2d2607d455381d010e133f5c6000af29ad7741b951\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:55:14 tanuki k3s[642162]: E1127 12:55:14.454586 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bc0ad307d5a61b61ceb3756c21620d81281f3d3697b4960e9430c789a8786001\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:55:14 tanuki k3s[642162]: E1127 12:55:14.454725 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bc0ad307d5a61b61ceb3756c21620d81281f3d3697b4960e9430c789a8786001\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:55:14 tanuki k3s[642162]: E1127 12:55:14.454790 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bc0ad307d5a61b61ceb3756c21620d81281f3d3697b4960e9430c789a8786001\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:55:14 tanuki k3s[642162]: E1127 12:55:14.454944 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"bc0ad307d5a61b61ceb3756c21620d81281f3d3697b4960e9430c789a8786001\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:55:19 tanuki k3s[642162]: E1127 12:55:19.505450 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1411efb6040834b5f36a3db76fa739294ee32f2f0c34330127199b2757dde812\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:55:19 tanuki k3s[642162]: E1127 12:55:19.505594 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1411efb6040834b5f36a3db76fa739294ee32f2f0c34330127199b2757dde812\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:55:19 tanuki k3s[642162]: E1127 12:55:19.505660 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1411efb6040834b5f36a3db76fa739294ee32f2f0c34330127199b2757dde812\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:55:19 tanuki k3s[642162]: E1127 12:55:19.505794 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"1411efb6040834b5f36a3db76fa739294ee32f2f0c34330127199b2757dde812\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:55:20 tanuki k3s[642162]: time="2022-11-27T12:55:20-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:55:27 tanuki k3s[642162]: E1127 12:55:27.506642 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"edf914421357d77afbe8759a7465bc42c509d74343c38452fc00beb1b6c66cc2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:55:27 tanuki k3s[642162]: E1127 12:55:27.506790 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"edf914421357d77afbe8759a7465bc42c509d74343c38452fc00beb1b6c66cc2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:55:27 tanuki k3s[642162]: E1127 12:55:27.506864 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"edf914421357d77afbe8759a7465bc42c509d74343c38452fc00beb1b6c66cc2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:55:27 tanuki k3s[642162]: E1127 12:55:27.506994 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"edf914421357d77afbe8759a7465bc42c509d74343c38452fc00beb1b6c66cc2\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:55:28 tanuki k3s[642162]: E1127 12:55:28.468382 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c74c08e6e2fbb59060c69490eb39a053890f940ff20614289ba6d9c650cb399e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:55:28 tanuki k3s[642162]: E1127 12:55:28.470640 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c74c08e6e2fbb59060c69490eb39a053890f940ff20614289ba6d9c650cb399e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:55:28 tanuki k3s[642162]: E1127 12:55:28.473246 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c74c08e6e2fbb59060c69490eb39a053890f940ff20614289ba6d9c650cb399e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:55:28 tanuki k3s[642162]: E1127 12:55:28.473765 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"c74c08e6e2fbb59060c69490eb39a053890f940ff20614289ba6d9c650cb399e\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:55:28 tanuki k3s[642162]: E1127 12:55:28.483001 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6ad525b662bd92b650a6b53784f978cccf1108c9db63bdfe157f9122b50e025c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:55:28 tanuki k3s[642162]: E1127 12:55:28.483140 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6ad525b662bd92b650a6b53784f978cccf1108c9db63bdfe157f9122b50e025c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:55:28 tanuki k3s[642162]: E1127 12:55:28.483205 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6ad525b662bd92b650a6b53784f978cccf1108c9db63bdfe157f9122b50e025c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:55:28 tanuki k3s[642162]: E1127 12:55:28.483368 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"6ad525b662bd92b650a6b53784f978cccf1108c9db63bdfe157f9122b50e025c\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:55:31 tanuki k3s[642162]: E1127 12:55:31.511867 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b909970988a62a6f1717e9512e770e1f3555c0a780f33e3f269d7be9b81e1ed5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:55:31 tanuki k3s[642162]: E1127 12:55:31.511996 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b909970988a62a6f1717e9512e770e1f3555c0a780f33e3f269d7be9b81e1ed5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:55:31 tanuki k3s[642162]: E1127 12:55:31.512070 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b909970988a62a6f1717e9512e770e1f3555c0a780f33e3f269d7be9b81e1ed5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:55:31 tanuki k3s[642162]: E1127 12:55:31.512200 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"b909970988a62a6f1717e9512e770e1f3555c0a780f33e3f269d7be9b81e1ed5\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:55:34 tanuki k3s[642162]: E1127 12:55:34.771757 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:55:35 tanuki k3s[642162]: W1127 12:55:35.088514 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:55:35 tanuki k3s[642162]: time="2022-11-27T12:55:35-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:55:36 tanuki k3s[642162]: time="2022-11-27T12:55:36-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:55:40 tanuki k3s[642162]: E1127 12:55:40.496591 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"080d711c97ac8898b7d965be802622baa551a040da502ee50d53cf3319acc00a\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:55:40 tanuki k3s[642162]: E1127 12:55:40.496735 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"080d711c97ac8898b7d965be802622baa551a040da502ee50d53cf3319acc00a\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:55:40 tanuki k3s[642162]: E1127 12:55:40.496799 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"080d711c97ac8898b7d965be802622baa551a040da502ee50d53cf3319acc00a\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:55:40 tanuki k3s[642162]: E1127 12:55:40.496956 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"080d711c97ac8898b7d965be802622baa551a040da502ee50d53cf3319acc00a\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:55:42 tanuki k3s[642162]: E1127 12:55:42.555049 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b885c76addb376c402fabb5c71d3242c5400299aee596273c20decfea9b31834\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:55:42 tanuki k3s[642162]: E1127 12:55:42.555224 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b885c76addb376c402fabb5c71d3242c5400299aee596273c20decfea9b31834\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:55:42 tanuki k3s[642162]: E1127 12:55:42.555325 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b885c76addb376c402fabb5c71d3242c5400299aee596273c20decfea9b31834\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:55:42 tanuki k3s[642162]: E1127 12:55:42.555519 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"b885c76addb376c402fabb5c71d3242c5400299aee596273c20decfea9b31834\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:55:43 tanuki k3s[642162]: E1127 12:55:43.531110 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d02eb902691be188de8b4bdbe5340ea46bf9baba0243e19bb01310e558181529\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:55:43 tanuki k3s[642162]: E1127 12:55:43.531248 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d02eb902691be188de8b4bdbe5340ea46bf9baba0243e19bb01310e558181529\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:55:43 tanuki k3s[642162]: E1127 12:55:43.531323 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d02eb902691be188de8b4bdbe5340ea46bf9baba0243e19bb01310e558181529\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:55:43 tanuki k3s[642162]: E1127 12:55:43.531462 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"d02eb902691be188de8b4bdbe5340ea46bf9baba0243e19bb01310e558181529\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:55:43 tanuki k3s[642162]: E1127 12:55:43.542486 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"89038908bdc8882e4e59ff4f393482437dd26de285d2d0f6f8fea9a62decccbe\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:55:43 tanuki k3s[642162]: E1127 12:55:43.542618 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"89038908bdc8882e4e59ff4f393482437dd26de285d2d0f6f8fea9a62decccbe\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:55:43 tanuki k3s[642162]: E1127 12:55:43.542677 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"89038908bdc8882e4e59ff4f393482437dd26de285d2d0f6f8fea9a62decccbe\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:55:43 tanuki k3s[642162]: E1127 12:55:43.542811 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"89038908bdc8882e4e59ff4f393482437dd26de285d2d0f6f8fea9a62decccbe\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:55:51 tanuki k3s[642162]: E1127 12:55:51.482611 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b2b1bb84b5d0109fda06a58255bb8ca763cb7689065c7a3c834010c9cf4400ef\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:55:51 tanuki k3s[642162]: E1127 12:55:51.482752 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b2b1bb84b5d0109fda06a58255bb8ca763cb7689065c7a3c834010c9cf4400ef\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:55:51 tanuki k3s[642162]: E1127 12:55:51.482816 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b2b1bb84b5d0109fda06a58255bb8ca763cb7689065c7a3c834010c9cf4400ef\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:55:51 tanuki k3s[642162]: E1127 12:55:51.482979 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"b2b1bb84b5d0109fda06a58255bb8ca763cb7689065c7a3c834010c9cf4400ef\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:55:51 tanuki k3s[642162]: time="2022-11-27T12:55:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:55:51 tanuki k3s[642162]: time="2022-11-27T12:55:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:55:51 tanuki k3s[642162]: time="2022-11-27T12:55:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:55:51 tanuki k3s[642162]: time="2022-11-27T12:55:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:55:51 tanuki k3s[642162]: time="2022-11-27T12:55:51-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:55:52 tanuki k3s[642162]: time="2022-11-27T12:55:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:55:52 tanuki k3s[642162]: time="2022-11-27T12:55:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:55:52 tanuki k3s[642162]: time="2022-11-27T12:55:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:55:52 tanuki k3s[642162]: time="2022-11-27T12:55:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:55:52 tanuki k3s[642162]: time="2022-11-27T12:55:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:55:52 tanuki k3s[642162]: time="2022-11-27T12:55:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:55:52 tanuki k3s[642162]: time="2022-11-27T12:55:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:55:52 tanuki k3s[642162]: time="2022-11-27T12:55:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:55:52 tanuki k3s[642162]: time="2022-11-27T12:55:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:55:52 tanuki k3s[642162]: time="2022-11-27T12:55:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:55:52 tanuki k3s[642162]: time="2022-11-27T12:55:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:55:52 tanuki k3s[642162]: time="2022-11-27T12:55:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:55:52 tanuki k3s[642162]: time="2022-11-27T12:55:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:55:52 tanuki k3s[642162]: time="2022-11-27T12:55:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:55:52 tanuki k3s[642162]: time="2022-11-27T12:55:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:55:52 tanuki k3s[642162]: time="2022-11-27T12:55:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:55:52 tanuki k3s[642162]: time="2022-11-27T12:55:52-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:55:52 tanuki k3s[642162]: time="2022-11-27T12:55:52-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:55:57 tanuki k3s[642162]: E1127 12:55:57.542703 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2b96b3acd94c2b6184d19ba220f7b2e4681bb53dda43880b611d8d32ebe2597a\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:55:57 tanuki k3s[642162]: E1127 12:55:57.542895 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2b96b3acd94c2b6184d19ba220f7b2e4681bb53dda43880b611d8d32ebe2597a\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:55:57 tanuki k3s[642162]: E1127 12:55:57.542994 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2b96b3acd94c2b6184d19ba220f7b2e4681bb53dda43880b611d8d32ebe2597a\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:55:57 tanuki k3s[642162]: E1127 12:55:57.543186 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"2b96b3acd94c2b6184d19ba220f7b2e4681bb53dda43880b611d8d32ebe2597a\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:55:58 tanuki k3s[642162]: E1127 12:55:58.497435 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"38b1d423e0f9f7bd56ff30abf4f567ddbc9bc3a26da7f624252186229e5fa05e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:55:58 tanuki k3s[642162]: E1127 12:55:58.497559 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"38b1d423e0f9f7bd56ff30abf4f567ddbc9bc3a26da7f624252186229e5fa05e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:55:58 tanuki k3s[642162]: E1127 12:55:58.497952 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"38b1d423e0f9f7bd56ff30abf4f567ddbc9bc3a26da7f624252186229e5fa05e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:55:58 tanuki k3s[642162]: E1127 12:55:58.498323 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"38b1d423e0f9f7bd56ff30abf4f567ddbc9bc3a26da7f624252186229e5fa05e\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:55:59 tanuki k3s[642162]: E1127 12:55:59.457656 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d155f88ee2a19910d9fafbb92154c811907a9816c6d08e2ab696c5fe90710afb\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:55:59 tanuki k3s[642162]: E1127 12:55:59.457802 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d155f88ee2a19910d9fafbb92154c811907a9816c6d08e2ab696c5fe90710afb\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:55:59 tanuki k3s[642162]: E1127 12:55:59.457860 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d155f88ee2a19910d9fafbb92154c811907a9816c6d08e2ab696c5fe90710afb\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:55:59 tanuki k3s[642162]: E1127 12:55:59.457983 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"d155f88ee2a19910d9fafbb92154c811907a9816c6d08e2ab696c5fe90710afb\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:56:03 tanuki k3s[642162]: E1127 12:56:03.505917 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4be2f88e8d8a2af96bdac5c91a43649b1254154894961b58e1f9dc5ed527f0ee\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:56:03 tanuki k3s[642162]: E1127 12:56:03.506046 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4be2f88e8d8a2af96bdac5c91a43649b1254154894961b58e1f9dc5ed527f0ee\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:56:03 tanuki k3s[642162]: E1127 12:56:03.506111 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4be2f88e8d8a2af96bdac5c91a43649b1254154894961b58e1f9dc5ed527f0ee\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:56:03 tanuki k3s[642162]: E1127 12:56:03.506296 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"4be2f88e8d8a2af96bdac5c91a43649b1254154894961b58e1f9dc5ed527f0ee\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:56:04 tanuki k3s[642162]: E1127 12:56:04.832752 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:56:05 tanuki k3s[642162]: W1127 12:56:05.131602 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:56:07 tanuki k3s[642162]: time="2022-11-27T12:56:07-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:56:09 tanuki k3s[642162]: E1127 12:56:09.493656 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"637ddb9a63d72e58745475decc4c51889e75ed996f8887ac5b4ab54199a3f1c4\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:56:09 tanuki k3s[642162]: E1127 12:56:09.493859 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"637ddb9a63d72e58745475decc4c51889e75ed996f8887ac5b4ab54199a3f1c4\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:56:09 tanuki k3s[642162]: E1127 12:56:09.493967 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"637ddb9a63d72e58745475decc4c51889e75ed996f8887ac5b4ab54199a3f1c4\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:56:09 tanuki k3s[642162]: E1127 12:56:09.494313 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"637ddb9a63d72e58745475decc4c51889e75ed996f8887ac5b4ab54199a3f1c4\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:56:11 tanuki k3s[642162]: E1127 12:56:11.501160 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0433f7c252a8c4bf8d680ff989d7180eda1ba94af625d37d1e9886f3e533b3ea\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:56:11 tanuki k3s[642162]: E1127 12:56:11.502390 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0433f7c252a8c4bf8d680ff989d7180eda1ba94af625d37d1e9886f3e533b3ea\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:56:11 tanuki k3s[642162]: E1127 12:56:11.502476 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0433f7c252a8c4bf8d680ff989d7180eda1ba94af625d37d1e9886f3e533b3ea\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:56:11 tanuki k3s[642162]: E1127 12:56:11.502629 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"0433f7c252a8c4bf8d680ff989d7180eda1ba94af625d37d1e9886f3e533b3ea\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:56:14 tanuki k3s[642162]: E1127 12:56:14.500101 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"249c55d90499739845c929b139fae87e969a10764346c1edd8fe267f8ea25707\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:56:14 tanuki k3s[642162]: E1127 12:56:14.500239 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"249c55d90499739845c929b139fae87e969a10764346c1edd8fe267f8ea25707\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:56:14 tanuki k3s[642162]: E1127 12:56:14.500301 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"249c55d90499739845c929b139fae87e969a10764346c1edd8fe267f8ea25707\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:56:14 tanuki k3s[642162]: E1127 12:56:14.500432 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"249c55d90499739845c929b139fae87e969a10764346c1edd8fe267f8ea25707\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:56:15 tanuki k3s[642162]: E1127 12:56:15.495299 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"197468c998529e3b72cdc3b5712bd6576893ecaae1610f16fc0d275c829c5694\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:56:15 tanuki k3s[642162]: E1127 12:56:15.495538 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"197468c998529e3b72cdc3b5712bd6576893ecaae1610f16fc0d275c829c5694\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:56:15 tanuki k3s[642162]: E1127 12:56:15.495670 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"197468c998529e3b72cdc3b5712bd6576893ecaae1610f16fc0d275c829c5694\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:56:15 tanuki k3s[642162]: E1127 12:56:15.495911 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"197468c998529e3b72cdc3b5712bd6576893ecaae1610f16fc0d275c829c5694\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:56:22 tanuki k3s[642162]: time="2022-11-27T12:56:22-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:56:23 tanuki k3s[642162]: time="2022-11-27T12:56:23-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:56:23 tanuki k3s[642162]: E1127 12:56:23.531678 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d6f995867ed4660becfb5a9d6050f29162990ef14d9ba572c32d3c0e4ec9e094\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:56:23 tanuki k3s[642162]: E1127 12:56:23.531927 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d6f995867ed4660becfb5a9d6050f29162990ef14d9ba572c32d3c0e4ec9e094\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:56:23 tanuki k3s[642162]: E1127 12:56:23.532012 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d6f995867ed4660becfb5a9d6050f29162990ef14d9ba572c32d3c0e4ec9e094\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:56:23 tanuki k3s[642162]: E1127 12:56:23.532156 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"d6f995867ed4660becfb5a9d6050f29162990ef14d9ba572c32d3c0e4ec9e094\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:56:24 tanuki k3s[642162]: E1127 12:56:24.511154 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"93a870e0fa35d071bfccf4c738bbc52193a12b74934f5c1d71d61aa6f1267295\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:56:24 tanuki k3s[642162]: E1127 12:56:24.511279 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"93a870e0fa35d071bfccf4c738bbc52193a12b74934f5c1d71d61aa6f1267295\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:56:24 tanuki k3s[642162]: E1127 12:56:24.511343 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"93a870e0fa35d071bfccf4c738bbc52193a12b74934f5c1d71d61aa6f1267295\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:56:24 tanuki k3s[642162]: E1127 12:56:24.511488 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"93a870e0fa35d071bfccf4c738bbc52193a12b74934f5c1d71d61aa6f1267295\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:56:27 tanuki k3s[642162]: E1127 12:56:27.497685 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3656f372bdbb66936d0c445e27d59c4774225183d0a603b2c0c0054e7d650612\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:56:27 tanuki k3s[642162]: E1127 12:56:27.497840 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3656f372bdbb66936d0c445e27d59c4774225183d0a603b2c0c0054e7d650612\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:56:27 tanuki k3s[642162]: E1127 12:56:27.497905 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3656f372bdbb66936d0c445e27d59c4774225183d0a603b2c0c0054e7d650612\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:56:27 tanuki k3s[642162]: E1127 12:56:27.498045 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"3656f372bdbb66936d0c445e27d59c4774225183d0a603b2c0c0054e7d650612\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:56:30 tanuki k3s[642162]: E1127 12:56:30.458092 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"745712d9031661c0c849544e15d45c045bc9c136ab74fe2f13ac8dcd0052a2ec\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:56:30 tanuki k3s[642162]: E1127 12:56:30.458367 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"745712d9031661c0c849544e15d45c045bc9c136ab74fe2f13ac8dcd0052a2ec\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:56:30 tanuki k3s[642162]: E1127 12:56:30.458449 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"745712d9031661c0c849544e15d45c045bc9c136ab74fe2f13ac8dcd0052a2ec\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:56:30 tanuki k3s[642162]: E1127 12:56:30.458601 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"745712d9031661c0c849544e15d45c045bc9c136ab74fe2f13ac8dcd0052a2ec\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:56:34 tanuki k3s[642162]: E1127 12:56:34.877686 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:56:35 tanuki k3s[642162]: W1127 12:56:35.178048 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:56:38 tanuki k3s[642162]: E1127 12:56:38.507091 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e99db61764a65ec5640de1b42c1d4cc9cf4df949a4868bd94c670cbad4ee8b9a\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:56:38 tanuki k3s[642162]: E1127 12:56:38.507239 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e99db61764a65ec5640de1b42c1d4cc9cf4df949a4868bd94c670cbad4ee8b9a\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:56:38 tanuki k3s[642162]: E1127 12:56:38.507302 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e99db61764a65ec5640de1b42c1d4cc9cf4df949a4868bd94c670cbad4ee8b9a\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:56:38 tanuki k3s[642162]: E1127 12:56:38.507433 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e99db61764a65ec5640de1b42c1d4cc9cf4df949a4868bd94c670cbad4ee8b9a\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:56:38 tanuki k3s[642162]: time="2022-11-27T12:56:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:56:38 tanuki k3s[642162]: time="2022-11-27T12:56:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:56:38 tanuki k3s[642162]: time="2022-11-27T12:56:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:56:38 tanuki k3s[642162]: time="2022-11-27T12:56:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:56:38 tanuki k3s[642162]: time="2022-11-27T12:56:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:56:38 tanuki k3s[642162]: time="2022-11-27T12:56:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:56:38 tanuki k3s[642162]: time="2022-11-27T12:56:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:56:38 tanuki k3s[642162]: time="2022-11-27T12:56:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:56:38 tanuki k3s[642162]: time="2022-11-27T12:56:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:56:38 tanuki k3s[642162]: time="2022-11-27T12:56:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:56:38 tanuki k3s[642162]: time="2022-11-27T12:56:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:56:38 tanuki k3s[642162]: time="2022-11-27T12:56:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:56:38 tanuki k3s[642162]: time="2022-11-27T12:56:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:56:38 tanuki k3s[642162]: time="2022-11-27T12:56:38-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:56:39 tanuki k3s[642162]: time="2022-11-27T12:56:39-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:56:39 tanuki k3s[642162]: time="2022-11-27T12:56:39-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:56:39 tanuki k3s[642162]: time="2022-11-27T12:56:39-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:56:39 tanuki k3s[642162]: time="2022-11-27T12:56:39-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:56:39 tanuki k3s[642162]: time="2022-11-27T12:56:39-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:56:39 tanuki k3s[642162]: time="2022-11-27T12:56:39-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:56:39 tanuki k3s[642162]: time="2022-11-27T12:56:39-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:56:39 tanuki k3s[642162]: time="2022-11-27T12:56:39-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:56:39 tanuki k3s[642162]: time="2022-11-27T12:56:39-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:56:39 tanuki k3s[642162]: E1127 12:56:39.559241 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2114c3c3dad5139ee04c5e000014b5d033ba111bd580040c64e40911c74f03c5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:56:39 tanuki k3s[642162]: E1127 12:56:39.559364 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2114c3c3dad5139ee04c5e000014b5d033ba111bd580040c64e40911c74f03c5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:56:39 tanuki k3s[642162]: E1127 12:56:39.559422 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2114c3c3dad5139ee04c5e000014b5d033ba111bd580040c64e40911c74f03c5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:56:39 tanuki k3s[642162]: E1127 12:56:39.559555 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"2114c3c3dad5139ee04c5e000014b5d033ba111bd580040c64e40911c74f03c5\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:56:39 tanuki k3s[642162]: E1127 12:56:39.578073 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a317a38c5e47c37fe275aaba6cf22c97e3726a9cae274caee16286bb38e8b5af\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:56:39 tanuki k3s[642162]: E1127 12:56:39.578304 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a317a38c5e47c37fe275aaba6cf22c97e3726a9cae274caee16286bb38e8b5af\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:56:39 tanuki k3s[642162]: E1127 12:56:39.578372 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a317a38c5e47c37fe275aaba6cf22c97e3726a9cae274caee16286bb38e8b5af\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:56:39 tanuki k3s[642162]: E1127 12:56:39.578526 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a317a38c5e47c37fe275aaba6cf22c97e3726a9cae274caee16286bb38e8b5af\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:56:43 tanuki k3s[642162]: E1127 12:56:43.456908 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fcc1fcc109f5d61d72bb4b1311409192e4caf46e188082de015109cb296714d8\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:56:43 tanuki k3s[642162]: E1127 12:56:43.458631 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fcc1fcc109f5d61d72bb4b1311409192e4caf46e188082de015109cb296714d8\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:56:43 tanuki k3s[642162]: E1127 12:56:43.458714 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fcc1fcc109f5d61d72bb4b1311409192e4caf46e188082de015109cb296714d8\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:56:43 tanuki k3s[642162]: E1127 12:56:43.458852 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"fcc1fcc109f5d61d72bb4b1311409192e4caf46e188082de015109cb296714d8\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:56:45 tanuki k3s[642162]: W1127 12:56:45.097347 642162 handler_proxy.go:102] no RequestInfo found in the context | |
| Nov 27 12:56:45 tanuki k3s[642162]: E1127 12:56:45.097637 642162 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable | |
| Nov 27 12:56:45 tanuki k3s[642162]: , Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]] | |
| Nov 27 12:56:45 tanuki k3s[642162]: I1127 12:56:45.097693 642162 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue. | |
| Nov 27 12:56:45 tanuki k3s[642162]: W1127 12:56:45.097894 642162 handler_proxy.go:102] no RequestInfo found in the context | |
| Nov 27 12:56:45 tanuki k3s[642162]: E1127 12:56:45.097977 642162 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService | |
| Nov 27 12:56:45 tanuki k3s[642162]: I1127 12:56:45.099544 642162 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue. | |
| Nov 27 12:56:50 tanuki k3s[642162]: E1127 12:56:50.499017 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"740f88f581f60bc7620e974adc95eb34df4d7fbd8b096c434fa1547cd9634fed\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:56:50 tanuki k3s[642162]: E1127 12:56:50.499166 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"740f88f581f60bc7620e974adc95eb34df4d7fbd8b096c434fa1547cd9634fed\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:56:50 tanuki k3s[642162]: E1127 12:56:50.499228 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"740f88f581f60bc7620e974adc95eb34df4d7fbd8b096c434fa1547cd9634fed\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:56:50 tanuki k3s[642162]: E1127 12:56:50.499364 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"740f88f581f60bc7620e974adc95eb34df4d7fbd8b096c434fa1547cd9634fed\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:56:50 tanuki k3s[642162]: E1127 12:56:50.557006 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"582685f8a55da94c4d1227ddaab5d2a49c0e43a90c974d898c263f358f4247ed\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:56:50 tanuki k3s[642162]: E1127 12:56:50.557145 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"582685f8a55da94c4d1227ddaab5d2a49c0e43a90c974d898c263f358f4247ed\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:56:50 tanuki k3s[642162]: E1127 12:56:50.557217 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"582685f8a55da94c4d1227ddaab5d2a49c0e43a90c974d898c263f358f4247ed\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:56:50 tanuki k3s[642162]: E1127 12:56:50.557363 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"582685f8a55da94c4d1227ddaab5d2a49c0e43a90c974d898c263f358f4247ed\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:56:51 tanuki k3s[642162]: E1127 12:56:51.484442 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b2ed6a48660b9d1c7d1ceefb5bc3fc9f064ca3695a68a55ea651d039544f7707\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:56:51 tanuki k3s[642162]: E1127 12:56:51.485531 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b2ed6a48660b9d1c7d1ceefb5bc3fc9f064ca3695a68a55ea651d039544f7707\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:56:51 tanuki k3s[642162]: E1127 12:56:51.487280 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b2ed6a48660b9d1c7d1ceefb5bc3fc9f064ca3695a68a55ea651d039544f7707\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:56:51 tanuki k3s[642162]: E1127 12:56:51.488442 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"b2ed6a48660b9d1c7d1ceefb5bc3fc9f064ca3695a68a55ea651d039544f7707\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:56:54 tanuki k3s[642162]: time="2022-11-27T12:56:54-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:56:57 tanuki k3s[642162]: E1127 12:56:57.490819 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"973e3bd493b29d454b1545e0288a45929286cb8a1da8409b1c8e82aeac7558b9\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:56:57 tanuki k3s[642162]: E1127 12:56:57.491015 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"973e3bd493b29d454b1545e0288a45929286cb8a1da8409b1c8e82aeac7558b9\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:56:57 tanuki k3s[642162]: E1127 12:56:57.491131 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"973e3bd493b29d454b1545e0288a45929286cb8a1da8409b1c8e82aeac7558b9\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:56:57 tanuki k3s[642162]: E1127 12:56:57.491363 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"973e3bd493b29d454b1545e0288a45929286cb8a1da8409b1c8e82aeac7558b9\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:57:02 tanuki k3s[642162]: E1127 12:57:02.505533 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"333b96ad8803815b74c22d11a20304187eb506a699540f8692d77815c7c314f2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:02 tanuki k3s[642162]: E1127 12:57:02.509311 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"333b96ad8803815b74c22d11a20304187eb506a699540f8692d77815c7c314f2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:57:02 tanuki k3s[642162]: E1127 12:57:02.509906 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"333b96ad8803815b74c22d11a20304187eb506a699540f8692d77815c7c314f2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:57:02 tanuki k3s[642162]: E1127 12:57:02.510564 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"333b96ad8803815b74c22d11a20304187eb506a699540f8692d77815c7c314f2\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:57:03 tanuki k3s[642162]: E1127 12:57:03.538266 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b60c07c47b8d0678b0142064c2299e05005d322455d55a2829f3cc7594953324\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:03 tanuki k3s[642162]: E1127 12:57:03.541892 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b60c07c47b8d0678b0142064c2299e05005d322455d55a2829f3cc7594953324\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:57:03 tanuki k3s[642162]: E1127 12:57:03.542622 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b60c07c47b8d0678b0142064c2299e05005d322455d55a2829f3cc7594953324\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:57:03 tanuki k3s[642162]: E1127 12:57:03.543261 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"b60c07c47b8d0678b0142064c2299e05005d322455d55a2829f3cc7594953324\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:57:04 tanuki k3s[642162]: E1127 12:57:04.906872 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:57:05 tanuki k3s[642162]: W1127 12:57:05.224580 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:57:06 tanuki k3s[642162]: E1127 12:57:06.458542 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b6e2b19eb1a477005883fea0c1fa21f5bcc349ec9295956d6b9215a601ac3425\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:06 tanuki k3s[642162]: E1127 12:57:06.458692 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b6e2b19eb1a477005883fea0c1fa21f5bcc349ec9295956d6b9215a601ac3425\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:57:06 tanuki k3s[642162]: E1127 12:57:06.458759 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b6e2b19eb1a477005883fea0c1fa21f5bcc349ec9295956d6b9215a601ac3425\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:57:06 tanuki k3s[642162]: E1127 12:57:06.458896 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"b6e2b19eb1a477005883fea0c1fa21f5bcc349ec9295956d6b9215a601ac3425\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:57:08 tanuki k3s[642162]: E1127 12:57:08.456009 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a3919313001d6919739be41c5e0223931986838b5b6914aede74fc09c44dade3\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:08 tanuki k3s[642162]: E1127 12:57:08.456158 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a3919313001d6919739be41c5e0223931986838b5b6914aede74fc09c44dade3\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:57:08 tanuki k3s[642162]: E1127 12:57:08.456223 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a3919313001d6919739be41c5e0223931986838b5b6914aede74fc09c44dade3\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:57:08 tanuki k3s[642162]: E1127 12:57:08.456355 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a3919313001d6919739be41c5e0223931986838b5b6914aede74fc09c44dade3\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:57:09 tanuki k3s[642162]: time="2022-11-27T12:57:09-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:57:09 tanuki k3s[642162]: time="2022-11-27T12:57:09-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:57:09 tanuki k3s[642162]: time="2022-11-27T12:57:09-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:57:10 tanuki k3s[642162]: time="2022-11-27T12:57:10-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:57:16 tanuki k3s[642162]: E1127 12:57:16.538374 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fc53792db79ff196146444c0b8030791b8667496cb4dba7fb51f7f845e989e13\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:16 tanuki k3s[642162]: E1127 12:57:16.538547 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fc53792db79ff196146444c0b8030791b8667496cb4dba7fb51f7f845e989e13\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:57:16 tanuki k3s[642162]: E1127 12:57:16.538634 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fc53792db79ff196146444c0b8030791b8667496cb4dba7fb51f7f845e989e13\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:57:16 tanuki k3s[642162]: E1127 12:57:16.538842 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"fc53792db79ff196146444c0b8030791b8667496cb4dba7fb51f7f845e989e13\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:57:17 tanuki k3s[642162]: E1127 12:57:17.502070 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"25d41391059a8ed6d7771ed1616611ea78f01020a8364550cd0ba3bc4b9625a5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:17 tanuki k3s[642162]: E1127 12:57:17.502474 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"25d41391059a8ed6d7771ed1616611ea78f01020a8364550cd0ba3bc4b9625a5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:57:17 tanuki k3s[642162]: E1127 12:57:17.502547 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"25d41391059a8ed6d7771ed1616611ea78f01020a8364550cd0ba3bc4b9625a5\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:57:17 tanuki k3s[642162]: E1127 12:57:17.502686 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"25d41391059a8ed6d7771ed1616611ea78f01020a8364550cd0ba3bc4b9625a5\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:57:19 tanuki k3s[642162]: E1127 12:57:19.467453 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f9be23c59725cfb33e726058a05eaf79762db7e58df1faefabeb44280aefa97c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:19 tanuki k3s[642162]: E1127 12:57:19.467594 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f9be23c59725cfb33e726058a05eaf79762db7e58df1faefabeb44280aefa97c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:57:19 tanuki k3s[642162]: E1127 12:57:19.467669 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f9be23c59725cfb33e726058a05eaf79762db7e58df1faefabeb44280aefa97c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:57:19 tanuki k3s[642162]: E1127 12:57:19.467813 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"f9be23c59725cfb33e726058a05eaf79762db7e58df1faefabeb44280aefa97c\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:57:19 tanuki k3s[642162]: E1127 12:57:19.479906 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5d882084a1d230074d07d4a67ee87243d1a003d2a3d710bdfa7a496c2da7d136\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:19 tanuki k3s[642162]: E1127 12:57:19.480032 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5d882084a1d230074d07d4a67ee87243d1a003d2a3d710bdfa7a496c2da7d136\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:57:19 tanuki k3s[642162]: E1127 12:57:19.480098 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5d882084a1d230074d07d4a67ee87243d1a003d2a3d710bdfa7a496c2da7d136\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:57:19 tanuki k3s[642162]: E1127 12:57:19.480228 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"5d882084a1d230074d07d4a67ee87243d1a003d2a3d710bdfa7a496c2da7d136\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:57:25 tanuki k3s[642162]: time="2022-11-27T12:57:25-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:57:29 tanuki k3s[642162]: E1127 12:57:29.454530 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0fef5416a6c514211d0dccb784c78d742b825bac8570e9f1a43065023eaa75bc\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:29 tanuki k3s[642162]: E1127 12:57:29.455772 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0fef5416a6c514211d0dccb784c78d742b825bac8570e9f1a43065023eaa75bc\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:57:29 tanuki k3s[642162]: E1127 12:57:29.456073 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0fef5416a6c514211d0dccb784c78d742b825bac8570e9f1a43065023eaa75bc\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:57:29 tanuki k3s[642162]: E1127 12:57:29.456372 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"0fef5416a6c514211d0dccb784c78d742b825bac8570e9f1a43065023eaa75bc\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:57:31 tanuki k3s[642162]: E1127 12:57:31.454537 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b06cad3fa82dcdc08ce1ff625e0fe1736855cc5e8fc54a5648533077b4101493\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:31 tanuki k3s[642162]: E1127 12:57:31.454677 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b06cad3fa82dcdc08ce1ff625e0fe1736855cc5e8fc54a5648533077b4101493\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:57:31 tanuki k3s[642162]: E1127 12:57:31.454744 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b06cad3fa82dcdc08ce1ff625e0fe1736855cc5e8fc54a5648533077b4101493\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:57:31 tanuki k3s[642162]: E1127 12:57:31.455582 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"b06cad3fa82dcdc08ce1ff625e0fe1736855cc5e8fc54a5648533077b4101493\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:57:31 tanuki k3s[642162]: E1127 12:57:31.516889 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c5a0b529c8ac7f7999a1fe8c6263f43ae697f644cc3dced7b759e14e1fe752bd\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:31 tanuki k3s[642162]: E1127 12:57:31.517052 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c5a0b529c8ac7f7999a1fe8c6263f43ae697f644cc3dced7b759e14e1fe752bd\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:57:31 tanuki k3s[642162]: E1127 12:57:31.517113 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c5a0b529c8ac7f7999a1fe8c6263f43ae697f644cc3dced7b759e14e1fe752bd\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:57:31 tanuki k3s[642162]: E1127 12:57:31.517264 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"c5a0b529c8ac7f7999a1fe8c6263f43ae697f644cc3dced7b759e14e1fe752bd\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:57:32 tanuki k3s[642162]: E1127 12:57:32.504699 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5a91132fd62f2cb802096bb2d9107643ff1b9c039061590391643c357ba8047e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:32 tanuki k3s[642162]: E1127 12:57:32.504837 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5a91132fd62f2cb802096bb2d9107643ff1b9c039061590391643c357ba8047e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:57:32 tanuki k3s[642162]: E1127 12:57:32.504902 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5a91132fd62f2cb802096bb2d9107643ff1b9c039061590391643c357ba8047e\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:57:32 tanuki k3s[642162]: E1127 12:57:32.505036 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"5a91132fd62f2cb802096bb2d9107643ff1b9c039061590391643c357ba8047e\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:57:34 tanuki k3s[642162]: E1127 12:57:34.971770 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:57:35 tanuki k3s[642162]: W1127 12:57:35.268553 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:57:40 tanuki k3s[642162]: time="2022-11-27T12:57:40-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:57:41 tanuki k3s[642162]: time="2022-11-27T12:57:41-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:57:42 tanuki k3s[642162]: E1127 12:57:42.472988 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"553b922ad4da93fc21e82d0501edcb46e2ac8e9eabe7b0df902f0afab6d210b2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:42 tanuki k3s[642162]: E1127 12:57:42.473113 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"553b922ad4da93fc21e82d0501edcb46e2ac8e9eabe7b0df902f0afab6d210b2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:57:42 tanuki k3s[642162]: E1127 12:57:42.473169 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"553b922ad4da93fc21e82d0501edcb46e2ac8e9eabe7b0df902f0afab6d210b2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:57:42 tanuki k3s[642162]: E1127 12:57:42.473300 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"553b922ad4da93fc21e82d0501edcb46e2ac8e9eabe7b0df902f0afab6d210b2\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:57:42 tanuki k3s[642162]: E1127 12:57:42.482469 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ba525330ad0246fa4c48a6c4a9071a1cba3ec1647674dee07f7369b72f052cad\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:42 tanuki k3s[642162]: E1127 12:57:42.482620 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ba525330ad0246fa4c48a6c4a9071a1cba3ec1647674dee07f7369b72f052cad\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:57:42 tanuki k3s[642162]: E1127 12:57:42.482692 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ba525330ad0246fa4c48a6c4a9071a1cba3ec1647674dee07f7369b72f052cad\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:57:42 tanuki k3s[642162]: E1127 12:57:42.482836 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"ba525330ad0246fa4c48a6c4a9071a1cba3ec1647674dee07f7369b72f052cad\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:57:44 tanuki k3s[642162]: E1127 12:57:44.365299 642162 repair.go:250] the cluster IP [IPv4]:10.43.0.1 for service kubernetes/default is not within the service CIDR 172.31.11.0/24; please recreate | |
| Nov 27 12:57:44 tanuki k3s[642162]: E1127 12:57:44.365382 642162 repair.go:250] the cluster IP [IPv4]:10.43.0.10 for service kube-dns/kube-system is not within the service CIDR 172.31.11.0/24; please recreate | |
| Nov 27 12:57:44 tanuki k3s[642162]: E1127 12:57:44.366895 642162 repair.go:250] the cluster IP [IPv4]:10.43.198.136 for service metrics-server/kube-system is not within the service CIDR 172.31.11.0/24; please recreate | |
| Nov 27 12:57:44 tanuki k3s[642162]: E1127 12:57:44.459106 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7bee06dae7e2a50245419f09e68911cb9126c9c3725d0ed503239f8ba6582cf1\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:44 tanuki k3s[642162]: E1127 12:57:44.459230 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7bee06dae7e2a50245419f09e68911cb9126c9c3725d0ed503239f8ba6582cf1\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:57:44 tanuki k3s[642162]: E1127 12:57:44.459288 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7bee06dae7e2a50245419f09e68911cb9126c9c3725d0ed503239f8ba6582cf1\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:57:44 tanuki k3s[642162]: E1127 12:57:44.459425 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"7bee06dae7e2a50245419f09e68911cb9126c9c3725d0ed503239f8ba6582cf1\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:57:46 tanuki k3s[642162]: E1127 12:57:46.500646 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"33b8cc9354ad27dac3537e733175b58ad5d91dc2d1704f7690e764a194736506\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:46 tanuki k3s[642162]: E1127 12:57:46.500768 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"33b8cc9354ad27dac3537e733175b58ad5d91dc2d1704f7690e764a194736506\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:57:46 tanuki k3s[642162]: E1127 12:57:46.500862 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"33b8cc9354ad27dac3537e733175b58ad5d91dc2d1704f7690e764a194736506\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:57:46 tanuki k3s[642162]: E1127 12:57:46.500988 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"33b8cc9354ad27dac3537e733175b58ad5d91dc2d1704f7690e764a194736506\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:57:54 tanuki k3s[642162]: E1127 12:57:54.504293 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"91982b288f8cf1494c1cff849e205047749f25fd7ceffb5dc1329366890b1a18\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:54 tanuki k3s[642162]: E1127 12:57:54.504426 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"91982b288f8cf1494c1cff849e205047749f25fd7ceffb5dc1329366890b1a18\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:57:54 tanuki k3s[642162]: E1127 12:57:54.504488 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"91982b288f8cf1494c1cff849e205047749f25fd7ceffb5dc1329366890b1a18\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:57:54 tanuki k3s[642162]: E1127 12:57:54.504635 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"91982b288f8cf1494c1cff849e205047749f25fd7ceffb5dc1329366890b1a18\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:57:56 tanuki k3s[642162]: E1127 12:57:56.467495 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"38cc8e7ca27765a20e13a6bc67f87d1cbf374354813938a635c586814d23f7b0\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:56 tanuki k3s[642162]: E1127 12:57:56.467623 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"38cc8e7ca27765a20e13a6bc67f87d1cbf374354813938a635c586814d23f7b0\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:57:56 tanuki k3s[642162]: E1127 12:57:56.467691 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"38cc8e7ca27765a20e13a6bc67f87d1cbf374354813938a635c586814d23f7b0\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:57:56 tanuki k3s[642162]: E1127 12:57:56.467829 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"38cc8e7ca27765a20e13a6bc67f87d1cbf374354813938a635c586814d23f7b0\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:57:56 tanuki k3s[642162]: time="2022-11-27T12:57:56-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:57:56 tanuki k3s[642162]: time="2022-11-27T12:57:56-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:57:56 tanuki k3s[642162]: time="2022-11-27T12:57:56-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:57:56 tanuki k3s[642162]: time="2022-11-27T12:57:56-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:57:56 tanuki k3s[642162]: time="2022-11-27T12:57:56-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:57:57 tanuki k3s[642162]: time="2022-11-27T12:57:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:57:57 tanuki k3s[642162]: time="2022-11-27T12:57:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:57:57 tanuki k3s[642162]: time="2022-11-27T12:57:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:57:57 tanuki k3s[642162]: time="2022-11-27T12:57:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:57:57 tanuki k3s[642162]: time="2022-11-27T12:57:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:57:57 tanuki k3s[642162]: time="2022-11-27T12:57:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:57:57 tanuki k3s[642162]: time="2022-11-27T12:57:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:57:57 tanuki k3s[642162]: time="2022-11-27T12:57:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:57:57 tanuki k3s[642162]: time="2022-11-27T12:57:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:57:57 tanuki k3s[642162]: time="2022-11-27T12:57:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:57:57 tanuki k3s[642162]: time="2022-11-27T12:57:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:57:57 tanuki k3s[642162]: time="2022-11-27T12:57:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:57:57 tanuki k3s[642162]: time="2022-11-27T12:57:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:57:57 tanuki k3s[642162]: time="2022-11-27T12:57:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:57:57 tanuki k3s[642162]: time="2022-11-27T12:57:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:57:57 tanuki k3s[642162]: time="2022-11-27T12:57:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:57:57 tanuki k3s[642162]: time="2022-11-27T12:57:57-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:57:57 tanuki k3s[642162]: time="2022-11-27T12:57:57-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:57:57 tanuki k3s[642162]: E1127 12:57:57.522426 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"20fb1d82c116317ea68af1d23dc5daef91f4180e4e11b940eef8a45ad476f89b\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:57 tanuki k3s[642162]: E1127 12:57:57.522558 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"20fb1d82c116317ea68af1d23dc5daef91f4180e4e11b940eef8a45ad476f89b\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:57:57 tanuki k3s[642162]: E1127 12:57:57.522622 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"20fb1d82c116317ea68af1d23dc5daef91f4180e4e11b940eef8a45ad476f89b\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:57:57 tanuki k3s[642162]: E1127 12:57:57.522756 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"20fb1d82c116317ea68af1d23dc5daef91f4180e4e11b940eef8a45ad476f89b\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:57:59 tanuki k3s[642162]: E1127 12:57:59.502593 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9ac6ecbdf229756514a41fea609a5f7517f97bd9bfd21d6bda9923cd81a57e73\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:57:59 tanuki k3s[642162]: E1127 12:57:59.502730 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9ac6ecbdf229756514a41fea609a5f7517f97bd9bfd21d6bda9923cd81a57e73\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:57:59 tanuki k3s[642162]: E1127 12:57:59.502794 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9ac6ecbdf229756514a41fea609a5f7517f97bd9bfd21d6bda9923cd81a57e73\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:57:59 tanuki k3s[642162]: E1127 12:57:59.502926 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"9ac6ecbdf229756514a41fea609a5f7517f97bd9bfd21d6bda9923cd81a57e73\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:58:04 tanuki k3s[642162]: E1127 12:58:04.995315 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:58:05 tanuki k3s[642162]: W1127 12:58:05.315669 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:58:05 tanuki k3s[642162]: E1127 12:58:05.505134 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"189c958061f20ddb3c647b50cdb45d5a148cc6ad137ebb5858f214922e23c5e1\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:58:05 tanuki k3s[642162]: E1127 12:58:05.505278 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"189c958061f20ddb3c647b50cdb45d5a148cc6ad137ebb5858f214922e23c5e1\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:58:05 tanuki k3s[642162]: E1127 12:58:05.505344 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"189c958061f20ddb3c647b50cdb45d5a148cc6ad137ebb5858f214922e23c5e1\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:58:05 tanuki k3s[642162]: E1127 12:58:05.505483 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"189c958061f20ddb3c647b50cdb45d5a148cc6ad137ebb5858f214922e23c5e1\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:58:08 tanuki k3s[642162]: E1127 12:58:08.502271 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"41285a47af6e20f5722c9a49c3af480473fedc8838e19ba7cee8fa56138bf3b2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:58:08 tanuki k3s[642162]: E1127 12:58:08.502449 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"41285a47af6e20f5722c9a49c3af480473fedc8838e19ba7cee8fa56138bf3b2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:58:08 tanuki k3s[642162]: E1127 12:58:08.502560 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"41285a47af6e20f5722c9a49c3af480473fedc8838e19ba7cee8fa56138bf3b2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:58:08 tanuki k3s[642162]: E1127 12:58:08.502763 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"41285a47af6e20f5722c9a49c3af480473fedc8838e19ba7cee8fa56138bf3b2\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:58:10 tanuki k3s[642162]: E1127 12:58:10.457902 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f4569f96162c6ff0611fe793c359cfc9138f7d5aead97670c70fe4ee8468b3d7\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:58:10 tanuki k3s[642162]: E1127 12:58:10.458402 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f4569f96162c6ff0611fe793c359cfc9138f7d5aead97670c70fe4ee8468b3d7\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:58:10 tanuki k3s[642162]: E1127 12:58:10.458521 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f4569f96162c6ff0611fe793c359cfc9138f7d5aead97670c70fe4ee8468b3d7\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:58:10 tanuki k3s[642162]: E1127 12:58:10.458651 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"f4569f96162c6ff0611fe793c359cfc9138f7d5aead97670c70fe4ee8468b3d7\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:58:12 tanuki k3s[642162]: E1127 12:58:12.501430 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d050f9861d819ceb5213da4f2a1d8275f64fab192980b3b8ba40e9329cfed43c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:58:12 tanuki k3s[642162]: E1127 12:58:12.501567 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d050f9861d819ceb5213da4f2a1d8275f64fab192980b3b8ba40e9329cfed43c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:58:12 tanuki k3s[642162]: E1127 12:58:12.501639 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d050f9861d819ceb5213da4f2a1d8275f64fab192980b3b8ba40e9329cfed43c\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:58:12 tanuki k3s[642162]: E1127 12:58:12.501764 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"d050f9861d819ceb5213da4f2a1d8275f64fab192980b3b8ba40e9329cfed43c\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:58:12 tanuki k3s[642162]: time="2022-11-27T12:58:12-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:58:13 tanuki k3s[642162]: time="2022-11-27T12:58:13-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:58:13 tanuki k3s[642162]: time="2022-11-27T12:58:13-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:58:13 tanuki k3s[642162]: time="2022-11-27T12:58:13-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:58:20 tanuki k3s[642162]: E1127 12:58:20.551875 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e3b6d6891bce83f30c2b020ad234d478713e8f0641976d720e23e47702afbeb2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:58:20 tanuki k3s[642162]: E1127 12:58:20.552089 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e3b6d6891bce83f30c2b020ad234d478713e8f0641976d720e23e47702afbeb2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:58:20 tanuki k3s[642162]: E1127 12:58:20.552198 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e3b6d6891bce83f30c2b020ad234d478713e8f0641976d720e23e47702afbeb2\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:58:20 tanuki k3s[642162]: E1127 12:58:20.552421 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e3b6d6891bce83f30c2b020ad234d478713e8f0641976d720e23e47702afbeb2\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:58:22 tanuki k3s[642162]: E1127 12:58:22.457727 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c264e060eaa0accdf17e4e28a7f050b10df4a67272768207d878deff31f4e15d\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:58:22 tanuki k3s[642162]: E1127 12:58:22.459192 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c264e060eaa0accdf17e4e28a7f050b10df4a67272768207d878deff31f4e15d\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:58:22 tanuki k3s[642162]: E1127 12:58:22.459712 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c264e060eaa0accdf17e4e28a7f050b10df4a67272768207d878deff31f4e15d\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:58:22 tanuki k3s[642162]: E1127 12:58:22.460190 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"c264e060eaa0accdf17e4e28a7f050b10df4a67272768207d878deff31f4e15d\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:58:24 tanuki k3s[642162]: E1127 12:58:24.458773 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ceef87fe6725a49513199066aa135dd3262498871cc3b9dbf26c1dd1f04f4234\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:58:24 tanuki k3s[642162]: E1127 12:58:24.458906 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ceef87fe6725a49513199066aa135dd3262498871cc3b9dbf26c1dd1f04f4234\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:58:24 tanuki k3s[642162]: E1127 12:58:24.458971 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ceef87fe6725a49513199066aa135dd3262498871cc3b9dbf26c1dd1f04f4234\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:58:24 tanuki k3s[642162]: E1127 12:58:24.459093 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"ceef87fe6725a49513199066aa135dd3262498871cc3b9dbf26c1dd1f04f4234\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:58:25 tanuki k3s[642162]: E1127 12:58:25.527324 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b1eb8b5d4574b212875a371b1db18bd2aae43e89bcc9f240c77113a8d0f931cd\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:58:25 tanuki k3s[642162]: E1127 12:58:25.528812 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b1eb8b5d4574b212875a371b1db18bd2aae43e89bcc9f240c77113a8d0f931cd\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:58:25 tanuki k3s[642162]: E1127 12:58:25.529280 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b1eb8b5d4574b212875a371b1db18bd2aae43e89bcc9f240c77113a8d0f931cd\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:58:25 tanuki k3s[642162]: E1127 12:58:25.529768 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"b1eb8b5d4574b212875a371b1db18bd2aae43e89bcc9f240c77113a8d0f931cd\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:58:28 tanuki k3s[642162]: time="2022-11-27T12:58:28-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:58:33 tanuki k3s[642162]: E1127 12:58:33.505216 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fc11c1b8282f2a78a6440825f4df142b58901e688660ef2e7ebe22eddd92017b\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:58:33 tanuki k3s[642162]: E1127 12:58:33.506358 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fc11c1b8282f2a78a6440825f4df142b58901e688660ef2e7ebe22eddd92017b\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:58:33 tanuki k3s[642162]: E1127 12:58:33.506445 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fc11c1b8282f2a78a6440825f4df142b58901e688660ef2e7ebe22eddd92017b\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:58:33 tanuki k3s[642162]: E1127 12:58:33.506618 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"fc11c1b8282f2a78a6440825f4df142b58901e688660ef2e7ebe22eddd92017b\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:58:35 tanuki k3s[642162]: E1127 12:58:35.071847 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:58:35 tanuki k3s[642162]: W1127 12:58:35.360031 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:58:35 tanuki k3s[642162]: E1127 12:58:35.453456 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"167df1903ebe8b806bb3c87ab05c5e02e9fff8432570fb51187364a260597a98\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:58:35 tanuki k3s[642162]: E1127 12:58:35.453578 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"167df1903ebe8b806bb3c87ab05c5e02e9fff8432570fb51187364a260597a98\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:58:35 tanuki k3s[642162]: E1127 12:58:35.453633 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"167df1903ebe8b806bb3c87ab05c5e02e9fff8432570fb51187364a260597a98\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:58:35 tanuki k3s[642162]: E1127 12:58:35.453769 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"167df1903ebe8b806bb3c87ab05c5e02e9fff8432570fb51187364a260597a98\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:58:36 tanuki k3s[642162]: E1127 12:58:36.457322 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3c124ee664c1ddfaa3e72a7aa85c0a10da85846df1d1a4f96693b1e8c25f5864\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:58:36 tanuki k3s[642162]: E1127 12:58:36.457443 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3c124ee664c1ddfaa3e72a7aa85c0a10da85846df1d1a4f96693b1e8c25f5864\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:58:36 tanuki k3s[642162]: E1127 12:58:36.457503 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3c124ee664c1ddfaa3e72a7aa85c0a10da85846df1d1a4f96693b1e8c25f5864\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:58:36 tanuki k3s[642162]: E1127 12:58:36.457641 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"3c124ee664c1ddfaa3e72a7aa85c0a10da85846df1d1a4f96693b1e8c25f5864\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:58:38 tanuki k3s[642162]: E1127 12:58:38.503315 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e6cfa8663689a7697eea11f834c7ae059571571387622071c331b5f1906569f1\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:58:38 tanuki k3s[642162]: E1127 12:58:38.503444 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e6cfa8663689a7697eea11f834c7ae059571571387622071c331b5f1906569f1\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:58:38 tanuki k3s[642162]: E1127 12:58:38.503509 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e6cfa8663689a7697eea11f834c7ae059571571387622071c331b5f1906569f1\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:58:38 tanuki k3s[642162]: E1127 12:58:38.503630 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e6cfa8663689a7697eea11f834c7ae059571571387622071c331b5f1906569f1\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:58:43 tanuki k3s[642162]: time="2022-11-27T12:58:43-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:58:43 tanuki k3s[642162]: time="2022-11-27T12:58:43-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:58:43 tanuki k3s[642162]: time="2022-11-27T12:58:43-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:58:43 tanuki k3s[642162]: time="2022-11-27T12:58:43-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:58:43 tanuki k3s[642162]: time="2022-11-27T12:58:43-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:58:43 tanuki k3s[642162]: time="2022-11-27T12:58:43-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:58:43 tanuki k3s[642162]: time="2022-11-27T12:58:43-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:58:43 tanuki k3s[642162]: time="2022-11-27T12:58:43-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:58:44 tanuki k3s[642162]: time="2022-11-27T12:58:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:58:44 tanuki k3s[642162]: time="2022-11-27T12:58:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:58:44 tanuki k3s[642162]: time="2022-11-27T12:58:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:58:44 tanuki k3s[642162]: time="2022-11-27T12:58:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:58:44 tanuki k3s[642162]: time="2022-11-27T12:58:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:58:44 tanuki k3s[642162]: time="2022-11-27T12:58:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:58:44 tanuki k3s[642162]: time="2022-11-27T12:58:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:58:44 tanuki k3s[642162]: time="2022-11-27T12:58:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:58:44 tanuki k3s[642162]: time="2022-11-27T12:58:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:58:44 tanuki k3s[642162]: time="2022-11-27T12:58:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:58:44 tanuki k3s[642162]: time="2022-11-27T12:58:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:58:44 tanuki k3s[642162]: time="2022-11-27T12:58:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:58:44 tanuki k3s[642162]: time="2022-11-27T12:58:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:58:44 tanuki k3s[642162]: time="2022-11-27T12:58:44-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:58:44 tanuki k3s[642162]: time="2022-11-27T12:58:44-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:58:45 tanuki k3s[642162]: W1127 12:58:45.115098 642162 handler_proxy.go:102] no RequestInfo found in the context | |
| Nov 27 12:58:45 tanuki k3s[642162]: E1127 12:58:45.115215 642162 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService | |
| Nov 27 12:58:45 tanuki k3s[642162]: I1127 12:58:45.115246 642162 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue. | |
| Nov 27 12:58:45 tanuki k3s[642162]: W1127 12:58:45.115099 642162 handler_proxy.go:102] no RequestInfo found in the context | |
| Nov 27 12:58:45 tanuki k3s[642162]: E1127 12:58:45.115399 642162 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable | |
| Nov 27 12:58:45 tanuki k3s[642162]: , Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]] | |
| Nov 27 12:58:45 tanuki k3s[642162]: I1127 12:58:45.116288 642162 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue. | |
| Nov 27 12:58:46 tanuki k3s[642162]: W1127 12:58:46.353737 642162 sysinfo.go:203] Nodes topology is not available, providing CPU topology | |
| Nov 27 12:58:46 tanuki k3s[642162]: W1127 12:58:46.355795 642162 machine.go:65] Cannot read vendor id correctly, set empty. | |
| Nov 27 12:58:46 tanuki k3s[642162]: E1127 12:58:46.554971 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"930011ba73fc56b2874f04f0aa6ecbe9bfed2afdd0d2a3e14003b86ecb221c9f\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:58:46 tanuki k3s[642162]: E1127 12:58:46.555088 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"930011ba73fc56b2874f04f0aa6ecbe9bfed2afdd0d2a3e14003b86ecb221c9f\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:58:46 tanuki k3s[642162]: E1127 12:58:46.555154 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"930011ba73fc56b2874f04f0aa6ecbe9bfed2afdd0d2a3e14003b86ecb221c9f\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:58:46 tanuki k3s[642162]: E1127 12:58:46.555278 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"930011ba73fc56b2874f04f0aa6ecbe9bfed2afdd0d2a3e14003b86ecb221c9f\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:58:46 tanuki k3s[642162]: E1127 12:58:46.588149 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d0a23e5daf41567c6a76aa5b1b9c93b8f619cb801cbafcc372dd2ff6fc342bbe\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:58:46 tanuki k3s[642162]: E1127 12:58:46.588268 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d0a23e5daf41567c6a76aa5b1b9c93b8f619cb801cbafcc372dd2ff6fc342bbe\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:58:46 tanuki k3s[642162]: E1127 12:58:46.588332 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d0a23e5daf41567c6a76aa5b1b9c93b8f619cb801cbafcc372dd2ff6fc342bbe\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:58:46 tanuki k3s[642162]: E1127 12:58:46.588459 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"d0a23e5daf41567c6a76aa5b1b9c93b8f619cb801cbafcc372dd2ff6fc342bbe\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:58:50 tanuki k3s[642162]: E1127 12:58:50.528590 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9cc4358fbf1a1085acf63e118c1368e6855465494e89125392f1f6ebece0f693\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:58:50 tanuki k3s[642162]: E1127 12:58:50.528734 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9cc4358fbf1a1085acf63e118c1368e6855465494e89125392f1f6ebece0f693\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:58:50 tanuki k3s[642162]: E1127 12:58:50.528801 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9cc4358fbf1a1085acf63e118c1368e6855465494e89125392f1f6ebece0f693\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:58:50 tanuki k3s[642162]: E1127 12:58:50.528936 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"9cc4358fbf1a1085acf63e118c1368e6855465494e89125392f1f6ebece0f693\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:58:51 tanuki k3s[642162]: E1127 12:58:51.509668 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3756c9dcf4105ad441a51af8a5727c42f0a213301e95d76986d20f3a6c6d1f9f\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:58:51 tanuki k3s[642162]: E1127 12:58:51.509796 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3756c9dcf4105ad441a51af8a5727c42f0a213301e95d76986d20f3a6c6d1f9f\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:58:51 tanuki k3s[642162]: E1127 12:58:51.509860 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3756c9dcf4105ad441a51af8a5727c42f0a213301e95d76986d20f3a6c6d1f9f\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:58:51 tanuki k3s[642162]: E1127 12:58:51.510002 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"3756c9dcf4105ad441a51af8a5727c42f0a213301e95d76986d20f3a6c6d1f9f\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:58:58 tanuki k3s[642162]: E1127 12:58:58.457052 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7c222e8284f38c697a75dd52965bcfe3b417a3b442c7b01713a4df5976396367\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:58:58 tanuki k3s[642162]: E1127 12:58:58.457187 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7c222e8284f38c697a75dd52965bcfe3b417a3b442c7b01713a4df5976396367\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:58:58 tanuki k3s[642162]: E1127 12:58:58.457246 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7c222e8284f38c697a75dd52965bcfe3b417a3b442c7b01713a4df5976396367\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:58:58 tanuki k3s[642162]: E1127 12:58:58.457382 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"7c222e8284f38c697a75dd52965bcfe3b417a3b442c7b01713a4df5976396367\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: E1127 12:58:59.458568 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f8422280b0f38877e0cd203e180af84ed144a958edb5526860bc32ab21d1dfe6\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:58:59 tanuki k3s[642162]: E1127 12:58:59.458709 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f8422280b0f38877e0cd203e180af84ed144a958edb5526860bc32ab21d1dfe6\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:58:59 tanuki k3s[642162]: E1127 12:58:59.458771 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f8422280b0f38877e0cd203e180af84ed144a958edb5526860bc32ab21d1dfe6\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:58:59 tanuki k3s[642162]: E1127 12:58:59.458906 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"f8422280b0f38877e0cd203e180af84ed144a958edb5526860bc32ab21d1dfe6\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:58:59 tanuki k3s[642162]: time="2022-11-27T12:58:59-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:59:00 tanuki k3s[642162]: time="2022-11-27T12:59:00-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:59:02 tanuki k3s[642162]: E1127 12:59:02.537415 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ff9a7a00ee69bae8eb271b123dc12ab05ba07fa5ee971e6f5d2bf7e9b4a5b991\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:59:02 tanuki k3s[642162]: E1127 12:59:02.539068 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ff9a7a00ee69bae8eb271b123dc12ab05ba07fa5ee971e6f5d2bf7e9b4a5b991\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:59:02 tanuki k3s[642162]: E1127 12:59:02.539585 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ff9a7a00ee69bae8eb271b123dc12ab05ba07fa5ee971e6f5d2bf7e9b4a5b991\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:59:02 tanuki k3s[642162]: E1127 12:59:02.541374 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"ff9a7a00ee69bae8eb271b123dc12ab05ba07fa5ee971e6f5d2bf7e9b4a5b991\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:59:05 tanuki k3s[642162]: E1127 12:59:05.155447 642162 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request | |
| Nov 27 12:59:05 tanuki k3s[642162]: W1127 12:59:05.401371 642162 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request] | |
| Nov 27 12:59:06 tanuki k3s[642162]: E1127 12:59:06.502023 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ae43e18791a526ff6b0e6510096118a8ebf08cecd07656dea5afa63eb15207f3\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:59:06 tanuki k3s[642162]: E1127 12:59:06.502839 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ae43e18791a526ff6b0e6510096118a8ebf08cecd07656dea5afa63eb15207f3\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:59:06 tanuki k3s[642162]: E1127 12:59:06.502923 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ae43e18791a526ff6b0e6510096118a8ebf08cecd07656dea5afa63eb15207f3\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:59:06 tanuki k3s[642162]: E1127 12:59:06.503043 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"ae43e18791a526ff6b0e6510096118a8ebf08cecd07656dea5afa63eb15207f3\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:59:09 tanuki k3s[642162]: E1127 12:59:09.475886 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c12075670ec01387b6375a646b135acc9607abcd3b33d58ab99a93a3c1d446fb\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:59:09 tanuki k3s[642162]: E1127 12:59:09.477856 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c12075670ec01387b6375a646b135acc9607abcd3b33d58ab99a93a3c1d446fb\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:59:09 tanuki k3s[642162]: E1127 12:59:09.478328 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c12075670ec01387b6375a646b135acc9607abcd3b33d58ab99a93a3c1d446fb\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" | |
| Nov 27 12:59:09 tanuki k3s[642162]: E1127 12:59:09.479692 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kubesail-agent-78f6c568c4-2kk9g_kubesail-agent(d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"c12075670ec01387b6375a646b135acc9607abcd3b33d58ab99a93a3c1d446fb\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kubesail-agent/kubesail-agent-78f6c568c4-2kk9g" podUID=d63f7024-d5eb-4b84-8a33-0a7b6b6c7f7d | |
| Nov 27 12:59:11 tanuki k3s[642162]: E1127 12:59:11.457878 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3813ad5c7158f68a325055ae1d6334e5c160068a0c133b76f93db89bae957286\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:59:11 tanuki k3s[642162]: E1127 12:59:11.458002 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3813ad5c7158f68a325055ae1d6334e5c160068a0c133b76f93db89bae957286\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:59:11 tanuki k3s[642162]: E1127 12:59:11.458067 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3813ad5c7158f68a325055ae1d6334e5c160068a0c133b76f93db89bae957286\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/metrics-server-668d979685-dt55q" | |
| Nov 27 12:59:11 tanuki k3s[642162]: E1127 12:59:11.458298 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"metrics-server-668d979685-dt55q_kube-system(bfe3d994-79c1-4307-bca2-3db0583d9951)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"3813ad5c7158f68a325055ae1d6334e5c160068a0c133b76f93db89bae957286\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/metrics-server-668d979685-dt55q" podUID=bfe3d994-79c1-4307-bca2-3db0583d9951 | |
| Nov 27 12:59:12 tanuki k3s[642162]: E1127 12:59:12.945890 642162 controller_utils.go:256] Error while processing Node Add/Delete: failed to allocate cidr from cluster cidr at idx:0: CIDR allocation failed; there are no remaining CIDRs left to allocate in the accepted range | |
| Nov 27 12:59:12 tanuki k3s[642162]: I1127 12:59:12.946800 642162 event.go:294] "Event occurred" object="tanuki" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="CIDRNotAvailable" message="Node tanuki status is now: CIDRNotAvailable" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"9bb0328e-09fd-4d5d-b587-c4e112156724\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"234\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"86df5530-de7a-4eb4-b8be-405a976cadd2\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Warning' reason: 'ApplyManifestFailed' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\" failed: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"57d51086-4ec4-47d8-a11b-736a23ae87de\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"267\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"d714b86d-b04f-4827-84f3-f03958817697\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"275\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"5249bd85-12ae-4226-b71e-9e6b9c255780\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"280\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"a75b3c74-b7a0-4b8a-b3e7-9e1064ac12d7\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"285\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"18af4b30-ece1-4838-bb58-a2d76f677764\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"291\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: E1127 12:59:15.526703 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3bc923df208997e89467193a37cc48d7b2b0acba84f3a85f36108fd678386564\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:59:15 tanuki k3s[642162]: E1127 12:59:15.526843 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3bc923df208997e89467193a37cc48d7b2b0acba84f3a85f36108fd678386564\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:59:15 tanuki k3s[642162]: E1127 12:59:15.526920 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3bc923df208997e89467193a37cc48d7b2b0acba84f3a85f36108fd678386564\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" | |
| Nov 27 12:59:15 tanuki k3s[642162]: E1127 12:59:15.527081 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"local-path-provisioner-7b7dc8d6f5-7j8kv_kube-system(4b24e3b1-a081-4243-8bb7-816c5ec29f31)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"3bc923df208997e89467193a37cc48d7b2b0acba84f3a85f36108fd678386564\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-7j8kv" podUID=4b24e3b1-a081-4243-8bb7-816c5ec29f31 | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"3e7bf2c1-2251-4fc8-b01a-e99c7c9daf2d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"300\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"d9c16196-fd36-4dce-aae8-f71d6be9a744\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"307\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"75be780f-b182-4539-8f62-b999bda8c432\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"315\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"0ff000e6-01e1-4554-9946-823d1761fcba\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"324\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" | |
| Nov 27 12:59:15 tanuki k3s[642162]: time="2022-11-27T12:59:15-08:00" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to update kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service \"kube-dns\" is invalid: spec.clusterIPs[0]: Invalid value: []string{\"172.31.11.10\"}: may not change once set" | |
| Nov 27 12:59:18 tanuki k3s[642162]: E1127 12:59:18.528105 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"610ed5aa8ffd36183236c9d396f3ae19d6b21bb43b5b006253b4b100d6378048\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:59:18 tanuki k3s[642162]: E1127 12:59:18.528238 642162 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"610ed5aa8ffd36183236c9d396f3ae19d6b21bb43b5b006253b4b100d6378048\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:59:18 tanuki k3s[642162]: E1127 12:59:18.528296 642162 kuberuntime_manager.go:815] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"610ed5aa8ffd36183236c9d396f3ae19d6b21bb43b5b006253b4b100d6378048\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-b96499967-w74cl" | |
| Nov 27 12:59:18 tanuki k3s[642162]: E1127 12:59:18.528422 642162 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-b96499967-w74cl_kube-system(2f3fdc72-0488-4b13-8941-a07e8a26fba7)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"610ed5aa8ffd36183236c9d396f3ae19d6b21bb43b5b006253b4b100d6378048\\\": plugin type=\\\"flannel\\\" failed (add): open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-b96499967-w74cl" podUID=2f3fdc72-0488-4b13-8941-a07e8a26fba7 | |
| Nov 27 12:59:20 tanuki k3s[642162]: E1127 12:59:20.497974 642162 remote_runtime.go:201] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ddf5e2c5154c49255a35790ea6b4c9c43095f5c1856ad4c3a40a9fa4eade512f\": plugin type=\"flannel\" failed (add): open /run/flannel/subnet.env: no such file or directory" | |
| Nov 27 12:59 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment