Created
May 11, 2018 08:50
-
-
Save princerachit/0dd712c0dc3eccf8ec52ada75afd2d8b to your computer and use it in GitHub Desktop.
Kubelet log when pod was deleted
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| May 09 09:42:18 ubuntu kubelet[1162]: E0509 09:42:18.952203 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:20 ubuntu kubelet[1162]: E0509 09:42:20.975826 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:22 ubuntu kubelet[1162]: E0509 09:42:22.975917 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:24 ubuntu kubelet[1162]: E0509 09:42:24.994438 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:26 ubuntu kubelet[1162]: E0509 09:42:26.960364 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:28 ubuntu kubelet[1162]: E0509 09:42:28.968874 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:30 ubuntu kubelet[1162]: E0509 09:42:30.954420 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:32 ubuntu kubelet[1162]: E0509 09:42:32.968590 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:34 ubuntu kubelet[1162]: E0509 09:42:34.968373 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:36 ubuntu kubelet[1162]: E0509 09:42:36.970816 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:38 ubuntu kubelet[1162]: E0509 09:42:38.973061 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:40 ubuntu kubelet[1162]: E0509 09:42:40.977097 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:42 ubuntu kubelet[1162]: E0509 09:42:42.955140 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:44 ubuntu kubelet[1162]: E0509 09:42:44.967782 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:46 ubuntu kubelet[1162]: E0509 09:42:46.974321 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:48 ubuntu kubelet[1162]: E0509 09:42:48.958376 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:50 ubuntu kubelet[1162]: E0509 09:42:50.972383 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:52 ubuntu kubelet[1162]: E0509 09:42:52.956530 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:54 ubuntu kubelet[1162]: E0509 09:42:54.989553 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:56 ubuntu kubelet[1162]: E0509 09:42:56.969535 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:42:58 ubuntu kubelet[1162]: E0509 09:42:58.972550 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:43:00 ubuntu kubelet[1162]: E0509 09:43:00.955509 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:43:02 ubuntu kubelet[1162]: W0509 09:43:02.843055 1162 pod_container_deletor.go:77] Container "20653005b99e645fca0a6aee05a32e661900946ce779f74ed770ae6923708c38" not found in pod's containers | |
| May 09 09:43:02 ubuntu kubelet[1162]: E0509 09:43:02.976875 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:43:03 ubuntu kubelet[1162]: I0509 09:43:03.008436 1162 reconciler.go:181] operationExecutor.UnmountVolume started for volume "my-csi-volume" (UniqueName: "kubernetes.io/csi/csi-openebs^pvc-da18673b-533e-11e8-be33-000c29116015") pod "e8e70474-533e-11e8-be33-000c29116015" (UID: "e8e70474-533e-11e8-be33-000c29116015") | |
| May 09 09:43:03 ubuntu kubelet[1162]: I0509 09:43:03.008550 1162 reconciler.go:181] operationExecutor.UnmountVolume started for volume "default-token-68dz6" (UniqueName: "kubernetes.io/secret/e8e70474-533e-11e8-be33-000c29116015-default-token-68dz6") pod "e8e70474-533e-11e8-be33-000c29116015" (UID: "e8e70474-533e-11e8-be33-000c29116015") | |
| May 09 09:43:03 ubuntu kubelet[1162]: I0509 09:43:03.009284 1162 operation_generator.go:686] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/csi-openebs^pvc-da18673b-533e-11e8-be33-000c29116015" (OuterVolumeSpecName: "my-csi-volume") pod "e8e70474-533e-11e8-be33-000c29116015" (UID: "e8e70474-533e-11e8-be33-000c29116015"). InnerVolumeSpecName "pvc-da18673b-533e-11e8-be33-000c29116015". PluginName "kubernetes.io/csi", VolumeGidValue "" | |
| May 09 09:43:03 ubuntu kubelet[1162]: I0509 09:43:03.025102 1162 operation_generator.go:686] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e70474-533e-11e8-be33-000c29116015-default-token-68dz6" (OuterVolumeSpecName: "default-token-68dz6") pod "e8e70474-533e-11e8-be33-000c29116015" (UID: "e8e70474-533e-11e8-be33-000c29116015"). InnerVolumeSpecName "default-token-68dz6". PluginName "kubernetes.io/secret", VolumeGidValue "" | |
| May 09 09:43:03 ubuntu kubelet[1162]: I0509 09:43:03.109115 1162 reconciler.go:285] Volume detached for volume "default-token-68dz6" (UniqueName: "kubernetes.io/secret/e8e70474-533e-11e8-be33-000c29116015-default-token-68dz6") on node "minikube" DevicePath "" | |
| May 09 09:43:03 ubuntu kubelet[1162]: I0509 09:43:03.109864 1162 reconciler.go:278] operationExecutor.UnmountDevice started for volume "pvc-da18673b-533e-11e8-be33-000c29116015" (UniqueName: "kubernetes.io/csi/csi-openebs^pvc-da18673b-533e-11e8-be33-000c29116015") on node "minikube" | |
| May 09 09:43:03 ubuntu kubelet[1162]: W0509 09:43:03.111389 1162 mount_linux.go:177] could not determine device for path: "/var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-da18673b-533e-11e8-be33-000c29116015/globalmount" | |
| May 09 09:43:03 ubuntu kubelet[1162]: I0509 09:43:03.119199 1162 csi_attacher.go:487] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice... | |
| May 09 09:43:03 ubuntu kubelet[1162]: I0509 09:43:03.119801 1162 operation_generator.go:760] UnmountDevice succeeded for volume "pvc-da18673b-533e-11e8-be33-000c29116015" %!(EXTRA string=UnmountDevice succeeded for volume "pvc-da18673b-533e-11e8-be33-000c29116015" (UniqueName: "kubernetes.io/csi/csi-openebs^pvc-da18673b-533e-11e8-be33-000c29116015") on node "minikube" ) | |
| May 09 09:43:03 ubuntu kubelet[1162]: I0509 09:43:03.210595 1162 reconciler.go:285] Volume detached for volume "pvc-da18673b-533e-11e8-be33-000c29116015" (UniqueName: "kubernetes.io/csi/csi-openebs^pvc-da18673b-533e-11e8-be33-000c29116015") on node "minikube" DevicePath "" | |
| May 09 09:43:04 ubuntu kubelet[1162]: E0509 09:43:04.955685 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:43:06 ubuntu kubelet[1162]: E0509 09:43:06.979841 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:43:08 ubuntu kubelet[1162]: E0509 09:43:08.961786 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:43:10 ubuntu kubelet[1162]: E0509 09:43:10.980717 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 11 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:43:12 ubuntu kubelet[1162]: E0509 09:43:12.963248 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 12 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:43:14 ubuntu kubelet[1162]: E0509 09:43:14.966283 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 12 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:43:16 ubuntu kubelet[1162]: E0509 09:43:16.976336 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 12 errors similar to this. Turn up verbosity to see them. | |
| May 09 09:43:18 ubuntu kubelet[1162]: E0509 09:43:18.957029 1162 kubelet_volumes.go:140] Orphaned pod "06fe182c-51df-11e8-aac0-000c29116015" found, but volume paths are still present on disk : There were a total of 12 errors similar to this. Turn up verbosity to see them. |
Sorry for the extreme late reply.
NodeStage may be required by the CSI driver to setup the mountpoint for whatever reason. NodePublish must be supported by the CSI driver with expectation that the mount point will have been setup with the storage volume.
In our case we don't advertise STAGE_UNSTAGE_VOLUME capability because our volume is iscsi and can be setup on any node.
Another difference is NodeStage is a PerVolume/PerNode call, whereas NodePublish is a PerVolume/PerWorkload call. Making your volume available on multiple workloads on the same node looks like this if you choose to use NodeStage:NodeStageVolume [vol1/node1], NodePublishVolume [vol1/workload1], NodePublishVolume [vol1/workload2], NodeUnpublishVolume [vol1/workload1], NodeUnpublishVolume [vol1/workload2], NodeUnstageVolume [vol1/node1]NodeStage would be called before any NodePublish is started on the node, and NodeUnstage is called after all NodeUnpublish is complete on the node for the volume.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
What is a STAGE_UNSTAGE_VOLUME capability?
May 09 09:43:03 ubuntu kubelet[1162]: I0509 09:43:03.109864 1162 reconciler.go:278] operationExecutor.UnmountDevice started for volume "pvc-da18673b-533e-11e8-be33-000c29116015" (UniqueName: "kubernetes.io/csi/csi-openebs^pvc-da18673b-533e-11e8-be33-000c29116015") on node "minikube"
May 09 09:43:03 ubuntu kubelet[1162]: W0509 09:43:03.111389 1162 mount_linux.go:177] could not determine device for path: "/var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-da18673b-533e-11e8-be33-000c29116015/globalmount"
May 09 09:43:03 ubuntu kubelet[1162]: I0509 09:43:03.119199 1162 csi_attacher.go:487] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice...