I0918 05:30:03.539944 1 feature_gate.go:245] feature gates: &{map[]} I0918 05:30:03.540237 1 csi-provisioner.go:139] Version: v3.1.0 I0918 05:30:03.540274 1 csi-provisioner.go:162] Building kube configs for running in cluster... I0918 05:30:03.540876 1 connection.go:154] Connecting to unix:///csi/csi-provisioner.sock W0918 05:30:13.541821 1 connection.go:173] Still connecting to unix:///csi/csi-provisioner.sock W0918 05:30:23.542076 1 connection.go:173] Still connecting to unix:///csi/csi-provisioner.sock I0918 05:30:24.071460 1 common.go:111] Probing CSI driver for readiness I0918 05:30:24.071547 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0918 05:30:24.071592 1 connection.go:184] GRPC request: {} I0918 05:30:24.078657 1 connection.go:186] GRPC response: {} I0918 05:30:24.078732 1 connection.go:187] GRPC error: I0918 05:30:24.078784 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginInfo I0918 05:30:24.078801 1 connection.go:184] GRPC request: {} I0918 05:30:24.080250 1 connection.go:186] GRPC response: {"name":"rbd.csi.ceph.com","vendor_version":"v3.5.1"} I0918 05:30:24.080382 1 connection.go:187] GRPC error: I0918 05:30:24.080402 1 csi-provisioner.go:206] Detected CSI driver rbd.csi.ceph.com I0918 05:30:24.080420 1 csi-provisioner.go:216] Supports migration from in-tree plugin: kubernetes.io/rbd I0918 05:30:24.080715 1 connection.go:154] Connecting to unix:///csi/csi-provisioner.sock I0918 05:30:24.081456 1 common.go:111] Probing CSI driver for readiness I0918 05:30:24.081497 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0918 05:30:24.081512 1 connection.go:184] GRPC request: {} I0918 05:30:24.082256 1 connection.go:186] GRPC response: {} I0918 05:30:24.082303 1 connection.go:187] GRPC error: I0918 05:30:24.082331 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginCapabilities I0918 05:30:24.082343 1 connection.go:184] GRPC request: {} I0918 05:30:24.083974 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}},{"Type":{"Service":{"type":2}}}]} I0918 05:30:24.084280 1 connection.go:187] GRPC error: I0918 05:30:24.084490 1 connection.go:183] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I0918 05:30:24.084505 1 connection.go:184] GRPC request: {} I0918 05:30:24.087529 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}}]} I0918 05:30:24.087740 1 connection.go:187] GRPC error: I0918 05:30:24.087900 1 csi-provisioner.go:278] CSI driver does not support PUBLISH_UNPUBLISH_VOLUME, not watching VolumeAttachments I0918 05:30:24.088785 1 controller.go:732] Using saving PVs to API server in background I0918 05:30:24.090872 1 leaderelection.go:248] attempting to acquire leader lease kube-system/rbd-csi-ceph-com... I0918 05:30:24.110914 1 leaderelection.go:258] successfully acquired lease kube-system/rbd-csi-ceph-com I0918 05:30:24.111234 1 leader_election.go:212] new leader detected, current leader: ceph-csi-rbd-provisioner-6f6497f79c-cdls8 I0918 05:30:24.111650 1 leader_election.go:205] became leader, starting I0918 05:30:24.112122 1 reflector.go:219] Starting reflector *v1.PersistentVolumeClaim (15m0s) from k8s.io/client-go/informers/factory.go:134 I0918 05:30:24.112187 1 reflector.go:255] Listing and watching *v1.PersistentVolumeClaim from k8s.io/client-go/informers/factory.go:134 I0918 05:30:24.112231 1 reflector.go:219] Starting reflector *v1.StorageClass (1h0m0s) from k8s.io/client-go/informers/factory.go:134 I0918 05:30:24.112264 1 reflector.go:255] Listing and watching *v1.StorageClass from k8s.io/client-go/informers/factory.go:134 I0918 05:30:24.125448 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:30:24.212589 1 shared_informer.go:270] caches populated I0918 05:30:24.212648 1 shared_informer.go:270] caches populated I0918 05:30:24.212668 1 controller.go:811] Starting provisioner controller rbd.csi.ceph.com_ceph-csi-rbd-provisioner-6f6497f79c-cdls8_2a410f3b-534e-49c7-ac49-95f7ff6f104d! I0918 05:30:24.212721 1 clone_controller.go:66] Starting CloningProtection controller I0918 05:30:24.212799 1 clone_controller.go:82] Started CloningProtection controller I0918 05:30:24.212735 1 volume_store.go:97] Starting save volume queue I0918 05:30:24.213003 1 reflector.go:219] Starting reflector *v1.PersistentVolume (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:845 I0918 05:30:24.213035 1 reflector.go:255] Listing and watching *v1.PersistentVolume from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:845 I0918 05:30:24.213174 1 reflector.go:219] Starting reflector *v1.StorageClass (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:848 I0918 05:30:24.213197 1 reflector.go:255] Listing and watching *v1.StorageClass from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:848 I0918 05:30:24.313849 1 shared_informer.go:270] caches populated I0918 05:30:24.314485 1 controller.go:860] Started provisioner controller rbd.csi.ceph.com_ceph-csi-rbd-provisioner-6f6497f79c-cdls8_2a410f3b-534e-49c7-ac49-95f7ff6f104d! I0918 05:30:29.181955 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:30:34.190474 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:30:39.200574 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:30:44.210625 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:30:49.221259 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:30:54.235607 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:30:59.246856 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:31:04.256842 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:31:09.264783 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:31:14.274119 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:31:19.285859 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:31:24.291881 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:31:29.301533 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:31:34.309013 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:31:39.319035 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:31:44.326432 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:31:49.335930 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:31:54.345177 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:31:59.354340 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:32:04.362390 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:32:09.373118 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:32:14.383658 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:32:19.395293 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:32:24.406871 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:32:29.418805 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:32:34.431220 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:32:39.441500 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:32:44.451629 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:32:49.460424 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:32:54.469320 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:32:59.477784 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:33:04.488206 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:33:09.499283 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:33:14.512047 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:33:19.518909 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:33:24.530638 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:33:29.541336 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:33:34.549713 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:33:39.557257 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:33:44.566763 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:33:49.574936 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:33:54.582700 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:33:59.592805 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:34:04.601776 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:34:09.611403 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:34:14.623355 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:34:19.632829 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:34:24.643429 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:34:29.651892 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:34:34.667743 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:34:39.676933 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:34:44.689776 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:34:49.698945 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:34:54.708863 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:34:56.699121 1 controller.go:1337] provision "default/test-pvc" class "general": started I0918 05:34:56.699221 1 controller.go:528] skip translation of storage class for plugin: rbd.csi.ceph.com I0918 05:34:56.699352 1 event.go:285] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"test-pvc", UID:"09b3cd0f-984b-4299-859d-8c15fcc4eee3", APIVersion:"v1", ResourceVersion:"2613", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/test-pvc" I0918 05:34:56.706167 1 connection.go:183] GRPC call: /csi.v1.Controller/CreateVolume I0918 05:34:56.706195 1 connection.go:184] GRPC request: {"capacity_range":{"required_bytes":5368709120},"name":"pvc-09b3cd0f-984b-4299-859d-8c15fcc4eee3","parameters":{"clusterID":"4837cbf8-4f90-4300-b3f6-726c9b9f89b4","csi.storage.k8s.io/pv/name":"pvc-09b3cd0f-984b-4299-859d-8c15fcc4eee3","csi.storage.k8s.io/pvc/name":"test-pvc","csi.storage.k8s.io/pvc/namespace":"default","imageFeatures":"layering","pool":"kube","thickProvision":"false"},"secrets":"***stripped***","volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4","mount_flags":["discard"]}},"access_mode":{"mode":1}}]} I0918 05:34:56.965650 1 connection.go:186] GRPC response: {"volume":{"capacity_bytes":5368709120,"volume_context":{"clusterID":"4837cbf8-4f90-4300-b3f6-726c9b9f89b4","csi.storage.k8s.io/pv/name":"pvc-09b3cd0f-984b-4299-859d-8c15fcc4eee3","csi.storage.k8s.io/pvc/name":"test-pvc","csi.storage.k8s.io/pvc/namespace":"default","imageFeatures":"layering","imageName":"csi-vol-aec10d61-b322-11f1-bb85-5ad9bd52537d","journalPool":"kube","pool":"kube","thickProvision":"false"},"volume_id":"0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-aec10d61-b322-11f1-bb85-5ad9bd52537d"}} I0918 05:34:56.965825 1 connection.go:187] GRPC error: I0918 05:34:56.965837 1 controller.go:774] create volume rep: {CapacityBytes:5368709120 VolumeId:0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-aec10d61-b322-11f1-bb85-5ad9bd52537d VolumeContext:map[clusterID:4837cbf8-4f90-4300-b3f6-726c9b9f89b4 csi.storage.k8s.io/pv/name:pvc-09b3cd0f-984b-4299-859d-8c15fcc4eee3 csi.storage.k8s.io/pvc/name:test-pvc csi.storage.k8s.io/pvc/namespace:default imageFeatures:layering imageName:csi-vol-aec10d61-b322-11f1-bb85-5ad9bd52537d journalPool:kube pool:kube thickProvision:false] ContentSource: AccessibleTopology:[] XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0} I0918 05:34:56.965890 1 controller.go:858] successfully created PV pvc-09b3cd0f-984b-4299-859d-8c15fcc4eee3 for PVC test-pvc and csi volume name 0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-aec10d61-b322-11f1-bb85-5ad9bd52537d I0918 05:34:56.965907 1 controller.go:874] successfully created PV {GCEPersistentDisk:nil AWSElasticBlockStore:nil HostPath:nil Glusterfs:nil NFS:nil RBD:nil ISCSI:nil Cinder:nil CephFS:nil FC:nil Flocker:nil FlexVolume:nil AzureFile:nil VsphereVolume:nil Quobyte:nil AzureDisk:nil PhotonPersistentDisk:nil PortworxVolume:nil ScaleIO:nil Local:nil StorageOS:nil CSI:&CSIPersistentVolumeSource{Driver:rbd.csi.ceph.com,VolumeHandle:0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-aec10d61-b322-11f1-bb85-5ad9bd52537d,ReadOnly:false,FSType:ext4,VolumeAttributes:map[string]string{clusterID: 4837cbf8-4f90-4300-b3f6-726c9b9f89b4,csi.storage.k8s.io/pv/name: pvc-09b3cd0f-984b-4299-859d-8c15fcc4eee3,csi.storage.k8s.io/pvc/name: test-pvc,csi.storage.k8s.io/pvc/namespace: default,imageFeatures: layering,imageName: csi-vol-aec10d61-b322-11f1-bb85-5ad9bd52537d,journalPool: kube,pool: kube,storage.kubernetes.io/csiProvisionerIdentity: 1789709424087-8081-rbd.csi.ceph.com,thickProvision: false,},ControllerPublishSecretRef:nil,NodeStageSecretRef:&SecretReference{Name:csi-rbd-secret,Namespace:kube-system,},NodePublishSecretRef:nil,ControllerExpandSecretRef:&SecretReference{Name:csi-rbd-secret,Namespace:kube-system,},}} I0918 05:34:56.966090 1 controller.go:1442] provision "default/test-pvc" class "general": volume "pvc-09b3cd0f-984b-4299-859d-8c15fcc4eee3" provisioned I0918 05:34:56.966103 1 controller.go:1455] provision "default/test-pvc" class "general": succeeded I0918 05:34:56.966109 1 volume_store.go:154] Saving volume pvc-09b3cd0f-984b-4299-859d-8c15fcc4eee3 I0918 05:34:56.975185 1 volume_store.go:157] Volume pvc-09b3cd0f-984b-4299-859d-8c15fcc4eee3 saved I0918 05:34:56.975239 1 controller.go:1069] Claim processing succeeded, removing PVC 09b3cd0f-984b-4299-859d-8c15fcc4eee3 from claims in progress I0918 05:34:56.975413 1 event.go:285] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"test-pvc", UID:"09b3cd0f-984b-4299-859d-8c15fcc4eee3", APIVersion:"v1", ResourceVersion:"2613", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-09b3cd0f-984b-4299-859d-8c15fcc4eee3 I0918 05:34:59.717675 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:35:04.729344 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:35:09.739121 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:35:14.749579 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:35:19.761380 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:35:24.773997 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:35:29.783732 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:35:34.791393 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:35:39.801592 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0918 05:35:44.810872 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com