I0819 09:06:54.451287 1 options.go:220] external host was not specified, using 199.204.45.116 I0819 09:06:54.452076 1 server.go:148] Version: v1.28.13 I0819 09:06:54.452121 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0819 09:06:54.974532 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0819 09:06:54.982156 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0819 09:06:54.982180 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0819 09:06:54.982403 1 instance.go:298] Using reconciler: lease I0819 09:06:55.296880 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0819 09:06:55.296900 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0819 09:06:55.535817 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0819 09:06:55.535965 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0819 09:06:55.988978 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0819 09:06:55.999754 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0819 09:06:55.999785 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0819 09:06:55.999792 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0819 09:06:56.000253 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0819 09:06:56.000268 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0819 09:06:56.001277 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0819 09:06:56.001963 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0819 09:06:56.001979 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0819 09:06:56.001984 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0819 09:06:56.003462 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0819 09:06:56.003480 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0819 09:06:56.004100 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0819 09:06:56.004112 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0819 09:06:56.004117 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0819 09:06:56.004511 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0819 09:06:56.004523 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0819 09:06:56.004549 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0819 09:06:56.004920 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0819 09:06:56.013417 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0819 09:06:56.013459 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0819 09:06:56.013474 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0819 09:06:56.015220 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0819 09:06:56.015243 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0819 09:06:56.015251 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0819 09:06:56.016713 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0819 09:06:56.016737 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0819 09:06:56.019558 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0819 09:06:56.019571 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0819 09:06:56.019575 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0819 09:06:56.019971 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0819 09:06:56.019985 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0819 09:06:56.019989 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0819 09:06:56.021996 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0819 09:06:56.022009 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0819 09:06:56.022012 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0819 09:06:56.023132 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0819 09:06:56.024268 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0819 09:06:56.024282 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0819 09:06:56.024286 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0819 09:06:56.027724 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0819 09:06:56.027739 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0819 09:06:56.027743 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0819 09:06:56.028561 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0819 09:06:56.028573 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0819 09:06:56.028577 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0819 09:06:56.029020 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0819 09:06:56.029033 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0819 09:06:56.083460 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0819 09:06:56.083495 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0819 09:06:56.453369 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0819 09:06:56.453394 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0819 09:06:56.453456 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0819 09:06:56.453717 1 secure_serving.go:213] Serving securely on [::]:6443 I0819 09:06:56.453789 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0819 09:06:56.453835 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0819 09:06:56.453895 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0819 09:06:56.453917 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0819 09:06:56.454009 1 aggregator.go:164] waiting for initial CRD sync... I0819 09:06:56.454039 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0819 09:06:56.454046 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0819 09:06:56.454148 1 system_namespaces_controller.go:67] Starting system namespaces controller I0819 09:06:56.454192 1 controller.go:78] Starting OpenAPI AggregationController I0819 09:06:56.454221 1 controller.go:80] Starting OpenAPI V3 AggregationController I0819 09:06:56.454453 1 gc_controller.go:78] Starting apiserver lease garbage collector I0819 09:06:56.454721 1 controller.go:116] Starting legacy_token_tracking_controller I0819 09:06:56.454732 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0819 09:06:56.454781 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0819 09:06:56.454834 1 available_controller.go:423] Starting AvailableConditionController I0819 09:06:56.454843 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0819 09:06:56.455001 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0819 09:06:56.455136 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0819 09:06:56.455146 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0819 09:06:56.455192 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0819 09:06:56.455343 1 gc_controller.go:78] Starting apiserver lease garbage collector I0819 09:06:56.456010 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0819 09:06:56.456139 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0819 09:06:56.456468 1 controller.go:134] Starting OpenAPI controller I0819 09:06:56.456657 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0819 09:06:56.456749 1 controller.go:85] Starting OpenAPI V3 controller I0819 09:06:56.456817 1 naming_controller.go:291] Starting NamingConditionController I0819 09:06:56.456899 1 establishing_controller.go:76] Starting EstablishingController I0819 09:06:56.459286 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0819 09:06:56.459343 1 crd_finalizer.go:266] Starting CRDFinalizer E0819 09:06:56.547474 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0819 09:06:56.554763 1 shared_informer.go:318] Caches are synced for crd-autoregister I0819 09:06:56.554818 1 aggregator.go:166] initial CRD sync complete... I0819 09:06:56.554830 1 autoregister_controller.go:141] Starting autoregister controller I0819 09:06:56.554846 1 cache.go:32] Waiting for caches to sync for autoregister controller I0819 09:06:56.554857 1 cache.go:39] Caches are synced for autoregister controller I0819 09:06:56.554938 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0819 09:06:56.555073 1 apf_controller.go:379] Running API Priority and Fairness config worker I0819 09:06:56.555115 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0819 09:06:56.555140 1 shared_informer.go:318] Caches are synced for configmaps I0819 09:06:56.555076 1 cache.go:39] Caches are synced for AvailableConditionController controller I0819 09:06:56.555206 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0819 09:06:56.556811 1 controller.go:624] quota admission added evaluator for: namespaces I0819 09:06:56.574764 1 shared_informer.go:318] Caches are synced for node_authorizer I0819 09:06:56.752529 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0819 09:06:57.461423 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0819 09:06:57.465419 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0819 09:06:57.465443 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0819 09:06:58.026569 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0819 09:06:58.077776 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0819 09:06:58.166291 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0819 09:06:58.173486 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.116] I0819 09:06:58.174701 1 controller.go:624] quota admission added evaluator for: endpoints I0819 09:06:58.179707 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0819 09:06:58.914415 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0819 09:06:59.759038 1 controller.go:624] quota admission added evaluator for: deployments.apps I0819 09:06:59.819831 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0819 09:07:00.012879 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0819 09:07:03.961622 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0819 09:07:04.161928 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0819 09:07:31.419089 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0819 09:07:31.458515 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0819 09:07:31.642277 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0819 09:07:31.676796 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0819 09:07:31.703570 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0819 09:07:31.727411 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0819 09:07:31.727448 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0819 09:07:31.762818 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0819 09:07:31.795146 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0819 09:07:31.795221 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0819 09:07:31.836611 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0819 09:07:31.836651 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0819 09:07:31.846439 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0819 09:07:31.846475 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0819 09:07:31.879259 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0819 09:07:32.014819 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0819 09:07:32.014874 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0819 09:07:32.032568 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0819 09:07:32.090251 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0819 09:07:32.109308 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0819 09:07:32.145440 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0819 09:07:32.159372 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0819 09:07:32.839277 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0819 09:07:32.864391 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0819 09:07:32.959008 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0819 09:07:38.749517 1 controller.go:624] quota admission added evaluator for: jobs.batch I0819 09:07:39.413468 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0819 09:07:39.419585 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0819 09:07:39.433002 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0819 09:07:39.815734 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0819 09:07:40.014911 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0819 09:07:40.221622 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0819 09:07:40.614566 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0819 09:07:41.232651 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0819 09:07:42.235451 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0819 09:07:43.034224 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0819 09:07:43.315146 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0819 09:07:48.104344 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0819 09:07:48.104384 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0819 09:07:48.586200 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0819 09:07:57.129674 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.103.124.134"} W0819 09:07:57.157038 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.103.124.134:9443: connect: connection refused E0819 09:07:57.157081 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.103.124.134:9443: connect: connection refused I0819 09:08:10.224808 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0819 09:08:10.238695 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0819 09:08:10.256468 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0819 09:08:10.263897 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.97.91.210"} I0819 09:08:10.270203 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.108.176.60"} I0819 09:08:10.290127 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0819 09:08:10.338139 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0819 09:08:10.401855 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager W0819 09:08:16.957121 1 dispatcher.go:217] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": dial tcp 10.97.91.210:443: connect: connection refused I0819 09:08:21.955126 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0819 09:08:28.178295 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0819 09:08:41.016263 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.99.63.138"} I0819 09:08:41.026396 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.105.83.132"} I0819 09:08:41.034029 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.111.111.124"} I0819 09:08:41.040641 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.97.11.0"} I0819 09:08:47.985769 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0819 09:08:48.005463 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0819 09:08:48.027861 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0819 09:08:48.044557 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0819 09:08:48.068524 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0819 09:08:48.099311 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0819 09:08:48.119731 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0819 09:08:48.138514 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0819 09:08:48.167710 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0819 09:08:48.179736 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0819 09:08:48.211282 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0819 09:08:48.257072 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0819 09:08:48.274092 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0819 09:08:49.595505 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0819 09:08:53.139773 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0819 09:08:53.147662 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0819 09:08:53.202645 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.99.227.203"} I0819 09:08:53.228838 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0819 09:08:55.646498 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0819 09:08:55.679297 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0819 09:08:56.233942 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0819 09:08:56.233979 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0819 09:08:56.234004 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0819 09:09:03.037358 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0819 09:09:07.977042 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.106.88.48"} I0819 09:09:08.346961 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0819 09:09:08.604010 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.102.206.121"} I0819 09:09:08.621477 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.110.249.26"} I0819 09:10:37.498477 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.108.146.9"} I0819 09:10:39.977125 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.109.214.64"} I0819 09:10:39.986134 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.103.18.236"} I0819 09:10:46.482146 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.98.30.161"} I0819 09:10:46.493580 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.96.20.211"} I0819 09:11:31.268582 1 trace.go:236] Trace[1490432150]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b0e37baf-3a5c-4d00-83ad-28e3b28bd8d2,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (19-Aug-2026 09:11:30.420) (total time: 848ms): Trace[1490432150]: ---"About to write a response" 847ms (09:11:31.268) Trace[1490432150]: [848.001131ms] [848.001131ms] END I0819 09:11:31.281753 1 trace.go:236] Trace[892199238]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0f38f9d5-75a2-4726-bf2f-5db36279aebc,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (19-Aug-2026 09:11:30.552) (total time: 729ms): Trace[892199238]: ---"About to write a response" 729ms (09:11:31.281) Trace[892199238]: [729.090112ms] [729.090112ms] END I0819 09:11:31.281884 1 trace.go:236] Trace[929859887]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:314a3f88-ce7b-46c8-ba6b-ff9c390f6f71,client:10.0.0.93,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (19-Aug-2026 09:11:30.542) (total time: 739ms): Trace[929859887]: ["GuaranteedUpdate etcd3" audit-id:314a3f88-ce7b-46c8-ba6b-ff9c390f6f71,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 738ms (09:11:30.542) Trace[929859887]: ---"Txn call completed" 737ms (09:11:31.281)] Trace[929859887]: [739.125635ms] [739.125635ms] END I0819 09:11:31.282295 1 trace.go:236] Trace[1833986489]: "Get" accept:application/json, */*,audit-id:c42d021f-1db5-4837-bb0f-5e25e039507c,client:199.204.45.116,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/auth-system/services/keycloak-headless,user-agent:Helm/3.11.2,verb:GET (19-Aug-2026 09:11:30.613) (total time: 668ms): Trace[1833986489]: ---"About to write a response" 668ms (09:11:31.281) Trace[1833986489]: [668.620921ms] [668.620921ms] END I0819 09:11:36.650255 1 trace.go:236] Trace[1491233813]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1561e18e-872e-4a62-80c4-0161487c50a6,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (19-Aug-2026 09:11:33.328) (total time: 3321ms): Trace[1491233813]: ["GuaranteedUpdate etcd3" audit-id:1561e18e-872e-4a62-80c4-0161487c50a6,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 3321ms (09:11:33.329) Trace[1491233813]: ---"Txn call completed" 3320ms (09:11:36.650)] Trace[1491233813]: [3.321239024s] [3.321239024s] END I0819 09:11:36.650481 1 trace.go:236] Trace[1606748693]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:11817754-6b58-49c9-94b9-4ebe87e3e978,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (19-Aug-2026 09:11:33.329) (total time: 3320ms): Trace[1606748693]: ---"About to write a response" 3320ms (09:11:36.650) Trace[1606748693]: [3.320449423s] [3.320449423s] END I0819 09:11:36.650909 1 trace.go:236] Trace[1231255130]: "Update" accept:application/json, */*,audit-id:d4b0d68b-d5da-4e02-989d-ca8fb3027383,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (19-Aug-2026 09:11:33.330) (total time: 3320ms): Trace[1231255130]: ["GuaranteedUpdate etcd3" audit-id:d4b0d68b-d5da-4e02-989d-ca8fb3027383,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3320ms (09:11:33.330) Trace[1231255130]: ---"Txn call completed" 3319ms (09:11:36.650)] Trace[1231255130]: [3.320674329s] [3.320674329s] END I0819 09:11:36.657356 1 trace.go:236] Trace[389244639]: "Get" accept:application/json, */*,audit-id:161925c4-c23f-446d-a779-e0ee76df41e4,client:199.204.45.116,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/auth-system/services/keycloak-headless,user-agent:Helm/3.11.2,verb:GET (19-Aug-2026 09:11:34.548) (total time: 2108ms): Trace[389244639]: ---"About to write a response" 2108ms (09:11:36.657) Trace[389244639]: [2.108443405s] [2.108443405s] END I0819 09:11:36.657449 1 trace.go:236] Trace[1273132932]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:85862077-1096-46a5-bddd-b7eb18d7e23a,client:10.0.0.209,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (19-Aug-2026 09:11:33.592) (total time: 3065ms): Trace[1273132932]: ["GuaranteedUpdate etcd3" audit-id:85862077-1096-46a5-bddd-b7eb18d7e23a,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 3064ms (09:11:33.592) Trace[1273132932]: ---"Txn call completed" 3063ms (09:11:36.657)] Trace[1273132932]: [3.065103797s] [3.065103797s] END I0819 09:11:36.657634 1 trace.go:236] Trace[1021354412]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4ea655ac-92d5-4cf8-8274-56e95d17c439,client:10.0.0.93,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (19-Aug-2026 09:11:35.330) (total time: 1326ms): Trace[1021354412]: ["GuaranteedUpdate etcd3" audit-id:4ea655ac-92d5-4cf8-8274-56e95d17c439,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1326ms (09:11:35.331) Trace[1021354412]: ---"Txn call completed" 1325ms (09:11:36.657)] Trace[1021354412]: [1.326687886s] [1.326687886s] END I0819 09:11:36.657793 1 trace.go:236] Trace[223443192]: "Get" accept:application/json, */*,audit-id:2b986bb4-43d5-41cb-8e9b-7ce8af133eb4,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (19-Aug-2026 09:11:35.351) (total time: 1306ms): Trace[223443192]: ---"About to write a response" 1305ms (09:11:36.657) Trace[223443192]: [1.30620367s] [1.30620367s] END I0819 09:11:36.657906 1 trace.go:236] Trace[530442632]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0735d0ab-64a7-4d96-a810-1f47486e87e1,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (19-Aug-2026 09:11:35.772) (total time: 885ms): Trace[530442632]: ["GuaranteedUpdate etcd3" audit-id:0735d0ab-64a7-4d96-a810-1f47486e87e1,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 885ms (09:11:35.772) Trace[530442632]: ---"Txn call completed" 884ms (09:11:36.657)] Trace[530442632]: [885.294536ms] [885.294536ms] END I0819 09:11:36.657992 1 trace.go:236] Trace[422024581]: "Get" accept:application/json, */*,audit-id:8b7bf5a1-0412-4aa6-a579-ade2ad95f84d,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (19-Aug-2026 09:11:33.337) (total time: 3320ms): Trace[422024581]: ---"About to write a response" 3320ms (09:11:36.657) Trace[422024581]: [3.320267838s] [3.320267838s] END I0819 09:11:36.658038 1 trace.go:236] Trace[1278244107]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a02f1b5f-0aed-4868-8b40-e4dcc52a361b,client:10.0.0.157,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (19-Aug-2026 09:11:33.649) (total time: 3007ms): Trace[1278244107]: ["GuaranteedUpdate etcd3" audit-id:a02f1b5f-0aed-4868-8b40-e4dcc52a361b,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 3007ms (09:11:33.649) Trace[1278244107]: ---"Txn call completed" 3006ms (09:11:36.657)] Trace[1278244107]: [3.007656505s] [3.007656505s] END I0819 09:11:36.657828 1 trace.go:236] Trace[671098677]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0499fcd5-193d-4ad8-8c3f-f231e2d65ac1,client:10.0.0.247,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (19-Aug-2026 09:11:35.332) (total time: 1325ms): Trace[671098677]: ["GuaranteedUpdate etcd3" audit-id:0499fcd5-193d-4ad8-8c3f-f231e2d65ac1,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1324ms (09:11:35.332) Trace[671098677]: ---"Txn call completed" 1324ms (09:11:36.657)] Trace[671098677]: [1.325102484s] [1.325102484s] END I0819 09:11:36.664174 1 trace.go:236] Trace[423577730]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8d27c296-0885-4c08-a32b-1a609603e8c0,client:199.204.45.116,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/valkey-node-0.18cd29dee52a097f,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (19-Aug-2026 09:11:34.433) (total time: 2230ms): Trace[423577730]: ["GuaranteedUpdate etcd3" audit-id:8d27c296-0885-4c08-a32b-1a609603e8c0,key:/events/openstack/valkey-node-0.18cd29dee52a097f,type:*core.Event,resource:events 2230ms (09:11:34.433) Trace[423577730]: ---"initial value restored" 2223ms (09:11:36.657)] Trace[423577730]: [2.230830215s] [2.230830215s] END E0819 09:12:13.775756 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0819 09:12:13.775801 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0819 09:12:13.775846 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 20.53µs, panicked: false, err: context deadline exceeded, panic-reason: E0819 09:12:13.777205 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0819 09:12:13.777286 1 trace.go:236] Trace[352953373]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:431bf74f-bd05-432e-a272-304167c3534c,client:10.0.0.209,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (19-Aug-2026 09:12:08.775) (total time: 5001ms): Trace[352953373]: ["GuaranteedUpdate etcd3" audit-id:431bf74f-bd05-432e-a272-304167c3534c,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (09:12:08.775) Trace[352953373]: ---"Txn call failed" err:context deadline exceeded 4999ms (09:12:13.775)] Trace[352953373]: [5.001710462s] [5.001710462s] END E0819 09:12:13.777439 1 timeout.go:142] post-timeout activity - time-elapsed: 1.671314ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0819 09:12:13.844614 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0819 09:12:13.844652 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0819 09:12:13.844679 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 8.01µs, panicked: false, err: context canceled, panic-reason: E0819 09:12:13.845080 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0819 09:12:13.845157 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 31.581µs, panicked: false, err: context canceled, panic-reason: E0819 09:12:13.845659 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0819 09:12:13.845749 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 6.43µs, panicked: false, err: context deadline exceeded, panic-reason: E0819 09:12:13.845819 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0819 09:12:13.845969 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0819 09:12:13.846812 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0819 09:12:13.846868 1 trace.go:236] Trace[329586595]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2f013751-d076-45fe-8289-ac3b817b3f44,client:10.0.0.93,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (19-Aug-2026 09:12:08.844) (total time: 5001ms): Trace[329586595]: ["GuaranteedUpdate etcd3" audit-id:2f013751-d076-45fe-8289-ac3b817b3f44,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (09:12:08.845) Trace[329586595]: ---"Txn call failed" err:context canceled 4998ms (09:12:13.844)] Trace[329586595]: [5.001959937s] [5.001959937s] END E0819 09:12:13.847010 1 timeout.go:142] post-timeout activity - time-elapsed: 2.347891ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0819 09:12:13.847074 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0819 09:12:13.847883 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0819 09:12:13.848418 1 trace.go:236] Trace[1041480150]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0b899a00-11de-4c6b-b400-4a21fcaa1e11,client:10.0.0.247,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (19-Aug-2026 09:12:08.845) (total time: 5002ms): Trace[1041480150]: ["GuaranteedUpdate etcd3" audit-id:0b899a00-11de-4c6b-b400-4a21fcaa1e11,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (09:12:08.845) Trace[1041480150]: ---"Txn call failed" err:context deadline exceeded 4998ms (09:12:13.845)] Trace[1041480150]: [5.002622254s] [5.002622254s] END I0819 09:12:13.848494 1 trace.go:236] Trace[173895544]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:93298199-bd07-4bfe-8b5e-4c4d56c09e94,client:10.0.0.157,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (19-Aug-2026 09:12:08.846) (total time: 5002ms): Trace[173895544]: ["GuaranteedUpdate etcd3" audit-id:93298199-bd07-4bfe-8b5e-4c4d56c09e94,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (09:12:08.846) Trace[173895544]: ---"Txn call failed" err:context canceled 4998ms (09:12:13.845)] Trace[173895544]: [5.002329267s] [5.002329267s] END E0819 09:12:13.848520 1 timeout.go:142] post-timeout activity - time-elapsed: 2.932937ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0819 09:12:13.848632 1 timeout.go:142] post-timeout activity - time-elapsed: 3.43947ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0819 09:12:13.867686 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0819 09:12:13.867754 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0819 09:12:13.869446 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0819 09:12:13.869487 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0819 09:12:13.870637 1 trace.go:236] Trace[1155042378]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0110f76f-0ce3-49bb-bb8c-a6814c978e1d,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (19-Aug-2026 09:12:08.867) (total time: 5002ms): Trace[1155042378]: [5.002577373s] [5.002577373s] END E0819 09:12:13.870848 1 timeout.go:142] post-timeout activity - time-elapsed: 3.132132ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0819 09:12:13.880465 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0819 09:12:13.880546 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0819 09:12:13.880842 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0819 09:12:13.881962 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0819 09:12:13.882022 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0819 09:12:13.882070 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0819 09:12:13.883155 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0819 09:12:13.883250 1 trace.go:236] Trace[1258604510]: "Get" accept:application/json, */*,audit-id:1f1cd284-b521-49eb-8172-0a29b3d3c812,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (19-Aug-2026 09:12:08.880) (total time: 5002ms): Trace[1258604510]: [5.002739058s] [5.002739058s] END E0819 09:12:13.883270 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0819 09:12:13.883357 1 timeout.go:142] post-timeout activity - time-elapsed: 2.730812ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: I0819 09:12:13.884405 1 trace.go:236] Trace[96205542]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:30465eb0-927d-4dab-889f-e849aa02edcc,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (19-Aug-2026 09:12:08.880) (total time: 5003ms): Trace[96205542]: [5.003695213s] [5.003695213s] END E0819 09:12:13.884482 1 timeout.go:142] post-timeout activity - time-elapsed: 3.632855ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0819 09:12:14.175272 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0819 09:12:14.175447 1 trace.go:236] Trace[2038020108]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ddd2b1c4-f480-4eed-9d7f-251ed32fa3d6,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (19-Aug-2026 09:12:07.172) (total time: 7003ms): Trace[2038020108]: ["GuaranteedUpdate etcd3" audit-id:ddd2b1c4-f480-4eed-9d7f-251ed32fa3d6,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:12:07.172) Trace[2038020108]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:12:14.175)] Trace[2038020108]: [7.003309955s] [7.003309955s] END E0819 09:12:14.663528 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0819 09:12:14.663674 1 trace.go:236] Trace[2070451571]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b4a16ee5-cff1-4a66-99ea-4e0049227a68,client:10.0.0.93,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (19-Aug-2026 09:12:07.661) (total time: 7002ms): Trace[2070451571]: [7.002134814s] [7.002134814s] END E0819 09:12:17.085605 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0819 09:12:17.085806 1 trace.go:236] Trace[141748243]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3f7393d7-ef19-4edc-adfc-83c142dc2e9a,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (19-Aug-2026 09:12:10.082) (total time: 7003ms): Trace[141748243]: ["GuaranteedUpdate etcd3" audit-id:3f7393d7-ef19-4edc-adfc-83c142dc2e9a,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:12:10.082) Trace[141748243]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:12:17.085)] Trace[141748243]: [7.003356425s] [7.003356425s] END E0819 09:12:17.192169 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0819 09:12:17.192473 1 trace.go:236] Trace[535079002]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:638608b4-ec3f-49c3-b675-d9640f727c3e,client:199.204.45.116,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (19-Aug-2026 09:12:10.189) (total time: 7002ms): Trace[535079002]: ["Create etcd3" audit-id:638608b4-ec3f-49c3-b675-d9640f727c3e,key:/events/kube-system/kube-apiserver-instance.18cd29ee3415c5ff,type:*core.Event,resource:events 7002ms (09:12:10.190) Trace[535079002]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:12:17.192)] Trace[535079002]: [7.002746239s] [7.002746239s] END E0819 09:12:18.775211 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0819 09:12:18.775338 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0819 09:12:18.776763 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0819 09:12:18.776928 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0819 09:12:18.777944 1 trace.go:236] Trace[474354076]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:62d28891-2b3d-4981-a742-6fb082dae6ae,client:10.0.0.209,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (19-Aug-2026 09:12:13.777) (total time: 5000ms): Trace[474354076]: [5.000744664s] [5.000744664s] END E0819 09:12:18.778088 1 timeout.go:142] post-timeout activity - time-elapsed: 3.05952ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0819 09:12:18.844816 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0819 09:12:18.844894 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0819 09:12:18.845622 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0819 09:12:18.845755 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0819 09:12:18.845861 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0819 09:12:18.846065 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0819 09:12:18.846993 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0819 09:12:18.847325 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0819 09:12:18.847398 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0819 09:12:18.847431 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0819 09:12:18.848121 1 trace.go:236] Trace[1362673121]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a1f652cc-7b0d-4fa1-9fb1-e0b5693ae405,client:10.0.0.93,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (19-Aug-2026 09:12:13.845) (total time: 5002ms): Trace[1362673121]: [5.002377596s] [5.002377596s] END E0819 09:12:18.848220 1 timeout.go:142] post-timeout activity - time-elapsed: 3.307166ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0819 09:12:18.849226 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0819 09:12:18.849242 1 trace.go:236] Trace[1070117852]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7cf3a5ba-4e3f-4dc8-9c29-8732fb9d7907,client:10.0.0.247,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (19-Aug-2026 09:12:13.847) (total time: 5001ms): Trace[1070117852]: [5.00135131s] [5.00135131s] END E0819 09:12:18.849299 1 timeout.go:142] post-timeout activity - time-elapsed: 3.697587ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0819 09:12:18.849360 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0819 09:12:18.850636 1 trace.go:236] Trace[401002958]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:57a147db-9605-4fe6-b441-98b58e3e8626,client:10.0.0.157,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (19-Aug-2026 09:12:13.845) (total time: 5004ms): Trace[401002958]: [5.004559104s] [5.004559104s] END E0819 09:12:18.850939 1 timeout.go:142] post-timeout activity - time-elapsed: 5.076433ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0819 09:12:18.868238 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0819 09:12:18.868296 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0819 09:12:18.869499 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0819 09:12:18.869564 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0819 09:12:18.871245 1 trace.go:236] Trace[352031176]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:79275819-c157-4603-a5b1-d68d740a0eb4,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (19-Aug-2026 09:12:15.870) (total time: 3000ms): Trace[352031176]: [3.000525207s] [3.000525207s] END E0819 09:12:18.871515 1 timeout.go:142] post-timeout activity - time-elapsed: 3.242015ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0819 09:12:18.872496 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled I0819 09:12:18.872766 1 trace.go:236] Trace[966527998]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:12c230b3-2a26-4790-937f-8940c0d62df4,client:10.0.0.93,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (19-Aug-2026 09:12:14.675) (total time: 4196ms): Trace[966527998]: [4.196898952s] [4.196898952s] END E0819 09:12:18.872988 1 wrap.go:54] timeout or abort while handling: method=GET URI="/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" audit-ID="12c230b3-2a26-4790-937f-8940c0d62df4" E0819 09:12:18.873015 1 timeout.go:142] post-timeout activity - time-elapsed: 3.44µs, GET "/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" result: E0819 09:12:18.879718 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0819 09:12:18.879799 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0819 09:12:18.880007 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0819 09:12:18.880192 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0819 09:12:18.880773 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0819 09:12:18.881115 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0819 09:12:18.881267 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0819 09:12:18.881270 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0819 09:12:18.881285 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0819 09:12:18.881849 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0819 09:12:18.882455 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0819 09:12:18.882479 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0819 09:12:18.882500 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0819 09:12:18.882559 1 trace.go:236] Trace[2013877977]: "Get" accept:application/json, */*,audit-id:47d964ad-4502-43b6-828d-ab12549aa0d1,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (19-Aug-2026 09:12:08.879) (total time: 10003ms): Trace[2013877977]: [10.003367819s] [10.003367819s] END E0819 09:12:18.882667 1 timeout.go:142] post-timeout activity - time-elapsed: 2.894256ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0819 09:12:18.883267 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0819 09:12:18.883620 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0819 09:12:18.883620 1 trace.go:236] Trace[1247621982]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:30830a7a-ae4f-493d-b1c1-feef3ea1e3e1,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (19-Aug-2026 09:12:15.881) (total time: 3001ms): Trace[1247621982]: [3.0017882s] [3.0017882s] END I0819 09:12:18.883783 1 trace.go:236] Trace[447094502]: "Get" accept:application/json, */*,audit-id:c5d940a8-c30f-4680-a6fb-60ec359bb3f9,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (19-Aug-2026 09:12:08.880) (total time: 10003ms): Trace[447094502]: [10.003490222s] [10.003490222s] END E0819 09:12:18.883808 1 timeout.go:142] post-timeout activity - time-elapsed: 3.7977ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0819 09:12:18.883844 1 timeout.go:142] post-timeout activity - time-elapsed: 3.594064ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: E0819 09:12:18.884739 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0819 09:12:18.885871 1 trace.go:236] Trace[1636760836]: "Get" accept:application/json, */*,audit-id:7e81c9e1-32d7-4a4d-9a3a-ee76e7fa7301,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (19-Aug-2026 09:12:15.882) (total time: 3003ms): Trace[1636760836]: [3.00369024s] [3.00369024s] END E0819 09:12:18.885999 1 timeout.go:142] post-timeout activity - time-elapsed: 4.504418ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0819 09:12:19.631782 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0819 09:12:19.632003 1 trace.go:236] Trace[29666858]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9f870379-43d6-4760-a295-b8500f38c021,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (19-Aug-2026 09:12:12.629) (total time: 7002ms): Trace[29666858]: ["GuaranteedUpdate etcd3" audit-id:9f870379-43d6-4760-a295-b8500f38c021,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (09:12:12.629) Trace[29666858]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:12:19.631)] Trace[29666858]: [7.00276351s] [7.00276351s] END E0819 09:12:19.633335 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0819 09:12:21.059847 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0819 09:12:21.060056 1 trace.go:236] Trace[1012829252]: "Update" accept:application/json, */*,audit-id:5c42f922-405c-41a5-823b-369c284db8e0,client:10.0.0.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (19-Aug-2026 09:12:14.056) (total time: 7003ms): Trace[1012829252]: ["GuaranteedUpdate etcd3" audit-id:5c42f922-405c-41a5-823b-369c284db8e0,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:12:14.056) Trace[1012829252]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:12:21.059)] Trace[1012829252]: [7.003340684s] [7.003340684s] END E0819 09:12:21.180374 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0819 09:12:21.180599 1 trace.go:236] Trace[1556742478]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:22435bb7-6512-448e-a77d-2ccdba1239d6,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (19-Aug-2026 09:12:14.177) (total time: 7003ms): Trace[1556742478]: ["GuaranteedUpdate etcd3" audit-id:22435bb7-6512-448e-a77d-2ccdba1239d6,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (09:12:14.177) Trace[1556742478]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:12:21.180)] Trace[1556742478]: [7.003035906s] [7.003035906s] END E0819 09:12:21.665118 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0819 09:12:21.665228 1 trace.go:236] Trace[983883843]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.116,type:*v1.Endpoints,resource:apiServerIPInfo (19-Aug-2026 09:12:08.175) (total time: 13489ms): Trace[983883843]: [13.489182657s] [13.489182657s] END E0819 09:12:21.665271 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out I0819 09:12:21.665380 1 trace.go:236] Trace[653680397]: "Get" accept:application/json, */*,audit-id:6cc9956f-414a-4e11-a35b-884c63e02436,client:199.204.45.116,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/auth-system/services/keycloak-headless,user-agent:Helm/3.11.2,verb:GET (19-Aug-2026 09:12:08.546) (total time: 13118ms): Trace[653680397]: [13.118524784s] [13.118524784s] END E0819 09:12:21.942461 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0819 09:12:21.942667 1 trace.go:236] Trace[446745479]: "Update" accept:application/json, */*,audit-id:b08293ee-fad2-4152-858e-f5e3b665129e,client:10.0.0.58,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.15.5 (linux/amd64) cert-manager/e8fdbe63fd94107a83d3c9f9c134f2d222ba9cff,verb:PUT (19-Aug-2026 09:12:14.939) (total time: 7003ms): Trace[446745479]: ["GuaranteedUpdate etcd3" audit-id:b08293ee-fad2-4152-858e-f5e3b665129e,key:/leases/cert-manager/cert-manager-controller,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:12:14.939) Trace[446745479]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:12:21.942)] Trace[446745479]: [7.003270503s] [7.003270503s] END I0819 09:12:22.652346 1 trace.go:236] Trace[1067437146]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0555733b-0b20-4ca1-b3f0-8c0c006344d1,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (19-Aug-2026 09:12:18.869) (total time: 3783ms): Trace[1067437146]: ["GuaranteedUpdate etcd3" audit-id:0555733b-0b20-4ca1-b3f0-8c0c006344d1,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 3783ms (09:12:18.869) Trace[1067437146]: ---"Txn call completed" 3782ms (09:12:22.652)] Trace[1067437146]: [3.783173304s] [3.783173304s] END I0819 09:12:22.652668 1 trace.go:236] Trace[1299783482]: "Update" accept:application/json, */*,audit-id:4fe2fa08-2539-485e-b81c-16438cf40e6c,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (19-Aug-2026 09:12:18.881) (total time: 3770ms): Trace[1299783482]: ["GuaranteedUpdate etcd3" audit-id:4fe2fa08-2539-485e-b81c-16438cf40e6c,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3770ms (09:12:18.881) Trace[1299783482]: ---"Txn call completed" 3769ms (09:12:22.652)] Trace[1299783482]: [3.770838942s] [3.770838942s] END I0819 09:12:22.653251 1 trace.go:236] Trace[146298656]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7a59f103-2ad2-4b45-a70d-14408ecc8008,client:199.204.45.116,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/datadir-percona-xtradb-pxc-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (19-Aug-2026 09:12:16.909) (total time: 5744ms): Trace[146298656]: ---"About to write a response" 5744ms (09:12:22.653) Trace[146298656]: [5.744188436s] [5.744188436s] END I0819 09:12:22.653808 1 trace.go:236] Trace[1653957333]: "Update" accept:application/json, */*,audit-id:5a5c6350-43d5-436f-b9ae-85954a637e85,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (19-Aug-2026 09:12:18.880) (total time: 3772ms): Trace[1653957333]: ["GuaranteedUpdate etcd3" audit-id:5a5c6350-43d5-436f-b9ae-85954a637e85,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3772ms (09:12:18.881) Trace[1653957333]: ---"Txn call completed" 3771ms (09:12:22.653)] Trace[1653957333]: [3.772885765s] [3.772885765s] END I0819 09:12:22.653894 1 trace.go:236] Trace[508809596]: "Get" accept:application/json, */*,audit-id:06abb2dc-aaec-4c32-9963-bc9920732cbc,client:10.0.0.58,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.15.5 (linux/amd64) cert-manager/e8fdbe63fd94107a83d3c9f9c134f2d222ba9cff,verb:GET (19-Aug-2026 09:12:21.944) (total time: 709ms): Trace[508809596]: ---"About to write a response" 709ms (09:12:22.653) Trace[508809596]: [709.38334ms] [709.38334ms] END I0819 09:12:22.654315 1 trace.go:236] Trace[2085290463]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:62af3b01-9b20-40b1-bc95-b6e81778cfe0,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (19-Aug-2026 09:12:19.634) (total time: 3019ms): Trace[2085290463]: ["GuaranteedUpdate etcd3" audit-id:62af3b01-9b20-40b1-bc95-b6e81778cfe0,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 3019ms (09:12:19.634) Trace[2085290463]: ---"Txn call completed" 3017ms (09:12:22.653)] Trace[2085290463]: [3.019671908s] [3.019671908s] END I0819 09:12:22.654609 1 trace.go:236] Trace[948741585]: "Create" accept:application/json, */*,audit-id:6143faf3-2db3-4891-999a-74fdb9fbe032,client:10.0.0.209,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (19-Aug-2026 09:12:18.777) (total time: 3876ms): Trace[948741585]: ["Create etcd3" audit-id:6143faf3-2db3-4891-999a-74fdb9fbe032,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18cd29f033db93ec,type:*core.Event,resource:events 3875ms (09:12:18.779) Trace[948741585]: ---"Txn call succeeded" 3875ms (09:12:22.654)] Trace[948741585]: [3.876629369s] [3.876629369s] END E0819 09:12:22.654867 1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again" I0819 09:12:22.655141 1 trace.go:236] Trace[872119894]: "Update" accept:application/json, */*,audit-id:2d5890f1-acc3-45bf-be3a-fa7487d64520,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (19-Aug-2026 09:12:18.880) (total time: 3774ms): Trace[872119894]: ["GuaranteedUpdate etcd3" audit-id:2d5890f1-acc3-45bf-be3a-fa7487d64520,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3774ms (09:12:18.880) Trace[872119894]: ---"Txn call completed" 3772ms (09:12:22.654)] Trace[872119894]: [3.774532988s] [3.774532988s] END I0819 09:12:22.655285 1 trace.go:236] Trace[1315585711]: "Update" accept:application/json, */*,audit-id:a6d6760f-aac0-4a6a-93d0-860ecee9c9eb,client:199.204.45.116,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/auth-system/secrets/sh.helm.release.v1.keycloak.v1,user-agent:Helm/3.11.2,verb:PUT (19-Aug-2026 09:12:21.698) (total time: 956ms): Trace[1315585711]: ["GuaranteedUpdate etcd3" audit-id:a6d6760f-aac0-4a6a-93d0-860ecee9c9eb,key:/secrets/auth-system/sh.helm.release.v1.keycloak.v1,type:*core.Secret,resource:secrets 953ms (09:12:21.701) Trace[1315585711]: ---"Txn call completed" 950ms (09:12:22.654)] Trace[1315585711]: [956.536324ms] [956.536324ms] END I0819 09:12:22.657305 1 trace.go:236] Trace[285263636]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0d21d2e8-68e0-4079-8f13-6e05c5ec628b,client:199.204.45.116,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (19-Aug-2026 09:12:20.176) (total time: 2480ms): Trace[285263636]: ---"About to write a response" 2480ms (09:12:22.657) Trace[285263636]: [2.480372575s] [2.480372575s] END I0819 09:12:22.657433 1 trace.go:236] Trace[1103417833]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f20fb0fd-58a3-460d-a60a-5b2771e5598e,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (19-Aug-2026 09:12:21.182) (total time: 1474ms): Trace[1103417833]: ["GuaranteedUpdate etcd3" audit-id:f20fb0fd-58a3-460d-a60a-5b2771e5598e,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 1474ms (09:12:21.182) Trace[1103417833]: ---"Txn call completed" 1472ms (09:12:22.656)] Trace[1103417833]: [1.474731976s] [1.474731976s] END I0819 09:12:22.657884 1 trace.go:236] Trace[1529237840]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:aa5fcd78-52cc-42bd-9a12-da979d7e8664,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (19-Aug-2026 09:12:17.088) (total time: 5569ms): Trace[1529237840]: ---"About to write a response" 5569ms (09:12:22.657) Trace[1529237840]: [5.569628252s] [5.569628252s] END I0819 09:12:22.657930 1 trace.go:236] Trace[1192587338]: "Get" accept:application/json, */*,audit-id:2ffc6699-5f27-45e9-b192-16f10b7ff314,client:10.0.0.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (19-Aug-2026 09:12:21.062) (total time: 1595ms): Trace[1192587338]: ---"About to write a response" 1595ms (09:12:22.657) Trace[1192587338]: [1.595594216s] [1.595594216s] END I0819 09:12:22.659690 1 trace.go:236] Trace[492509199]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a19ff1e8-696f-4e28-9917-802ac7aa5380,client:199.204.45.116,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/auth-system/events/keycloak-0.18cd29de49eaaabb,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (19-Aug-2026 09:12:17.194) (total time: 5465ms): Trace[492509199]: ["GuaranteedUpdate etcd3" audit-id:a19ff1e8-696f-4e28-9917-802ac7aa5380,key:/events/auth-system/keycloak-0.18cd29de49eaaabb,type:*core.Event,resource:events 5464ms (09:12:17.194) Trace[492509199]: ---"initial value restored" 5458ms (09:12:22.653)] Trace[492509199]: [5.465031946s] [5.465031946s] END I0819 09:12:22.667269 1 trace.go:236] Trace[1513282068]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.116,type:*v1.Endpoints,resource:apiServerIPInfo (19-Aug-2026 09:12:21.666) (total time: 1000ms): Trace[1513282068]: ---"initial value restored" 990ms (09:12:22.656) Trace[1513282068]: [1.000940785s] [1.000940785s] END