I0806 07:09:40.968281 1 cephcsi.go:191] Driver version: v3.11.0 and Git version: bc24b5eca87626d690a29effa9d7420cc0154a7a I0806 07:09:40.968481 1 cephcsi.go:223] Starting driver type: controller with name: rbd.csi.ceph.com I0806 07:09:40.969420 1 leaderelection.go:250] attempting to acquire leader lease kube-system/rbd.csi.ceph.com-kube-system... I0806 07:09:40.976725 1 leaderelection.go:354] lock is held by ceph-csi-rbd-provisioner-69cb97fb6-bnlj8_875664e2-db25-43da-a276-4eec00b34284 and has not yet expired I0806 07:09:40.976748 1 leaderelection.go:255] failed to acquire lease kube-system/rbd.csi.ceph.com-kube-system I0806 07:09:45.012802 1 leaderelection.go:354] lock is held by ceph-csi-rbd-provisioner-69cb97fb6-bnlj8_875664e2-db25-43da-a276-4eec00b34284 and has not yet expired I0806 07:09:45.012837 1 leaderelection.go:255] failed to acquire lease kube-system/rbd.csi.ceph.com-kube-system I0806 07:09:49.387819 1 leaderelection.go:354] lock is held by ceph-csi-rbd-provisioner-69cb97fb6-bnlj8_875664e2-db25-43da-a276-4eec00b34284 and has not yet expired I0806 07:09:49.387845 1 leaderelection.go:255] failed to acquire lease kube-system/rbd.csi.ceph.com-kube-system I0806 07:09:52.062656 1 leaderelection.go:354] lock is held by ceph-csi-rbd-provisioner-69cb97fb6-bnlj8_875664e2-db25-43da-a276-4eec00b34284 and has not yet expired I0806 07:09:52.062679 1 leaderelection.go:255] failed to acquire lease kube-system/rbd.csi.ceph.com-kube-system E0806 07:10:56.273898 1 leaderelection.go:332] error retrieving resource lock kube-system/rbd.csi.ceph.com-kube-system: Get "https://10.96.0.1:443/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system": stream error: stream ID 9; INTERNAL_ERROR; received from peer I0806 07:10:56.273968 1 leaderelection.go:255] failed to acquire lease kube-system/rbd.csi.ceph.com-kube-system I0806 07:11:15.484985 1 leaderelection.go:260] successfully acquired lease kube-system/rbd.csi.ceph.com-kube-system [controller-runtime] log.SetLogger(...) was never called; logs will not be displayed. Detected at: > goroutine 119 [running]: > runtime/debug.Stack() > /usr/local/go/src/runtime/debug/stack.go:24 +0x5e > sigs.k8s.io/controller-runtime/pkg/log.eventuallyFulfillRoot() > /go/src/github.com/ceph/ceph-csi/vendor/sigs.k8s.io/controller-runtime/pkg/log/log.go:60 +0xcd > sigs.k8s.io/controller-runtime/pkg/log.(*delegatingLogSink).Enabled(0xc00080bc80, 0x10?) > /go/src/github.com/ceph/ceph-csi/vendor/sigs.k8s.io/controller-runtime/pkg/log/deleg.go:111 +0x32 > github.com/go-logr/logr.Logger.Info({{0x27c4810?, 0xc00080bc80?}, 0xc000505fa8?}, {0xc0007814a0, 0x5b}, {0xc00071e1e0, 0x6, 0x6}) > /go/src/github.com/ceph/ceph-csi/vendor/github.com/go-logr/logr/logr.go:276 +0x72 > sigs.k8s.io/controller-runtime/pkg/internal/recorder.(*Provider).getBroadcaster.func1.1(0xc00048bb80) > /go/src/github.com/ceph/ceph-csi/vendor/sigs.k8s.io/controller-runtime/pkg/internal/recorder/recorder.go:104 +0x1e7 > k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher.func1() > /go/src/github.com/ceph/ceph-csi/vendor/k8s.io/client-go/tools/record/event.go:401 +0x11d > created by k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher in goroutine 80 > /go/src/github.com/ceph/ceph-csi/vendor/k8s.io/client-go/tools/record/event.go:387 +0x109 I0806 07:11:15.488453 1 reflector.go:289] Starting reflector *v1.PersistentVolume (9h42m15.395426105s) from sigs.k8s.io/controller-runtime/pkg/cache/internal/informers.go:105 I0806 07:11:15.488470 1 reflector.go:325] Listing and watching *v1.PersistentVolume from sigs.k8s.io/controller-runtime/pkg/cache/internal/informers.go:105 I0806 07:11:15.489928 1 reflector.go:351] Caches populated for *v1.PersistentVolume from sigs.k8s.io/controller-runtime/pkg/cache/internal/informers.go:105 I0806 07:11:15.516867 1 leaderelection.go:281] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system E0806 07:11:27.518833 1 leaderelection.go:332] error retrieving resource lock kube-system/rbd.csi.ceph.com-kube-system: Get "https://10.96.0.1:443/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system": context deadline exceeded I0806 07:11:27.518889 1 leaderelection.go:285] failed to renew lease kube-system/rbd.csi.ceph.com-kube-system: timed out waiting for the condition E0806 07:11:27.518960 1 controller.go:85] failed to start manager leader election lost E0806 07:11:27.518970 1 cephcsi.go:314] leader election lost