2026-03-11 23:24:49.272840 | Job console starting
2026-03-11 23:24:49.333098 | Updating git repos
2026-03-11 23:24:49.377383 | Cloning repos into workspace
2026-03-11 23:24:49.589075 | Restoring repo states
2026-03-11 23:24:49.607952 | Merging changes
2026-03-11 23:24:50.174183 | Checking out repos
2026-03-11 23:24:50.276461 | Preparing playbooks
2026-03-11 23:24:51.690662 | Running Ansible setup
2026-03-11 23:24:57.035840 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-11 23:24:57.619819 | 
2026-03-11 23:24:57.619942 | PLAY [localhost]
2026-03-11 23:24:57.626977 | 
2026-03-11 23:24:57.627045 | TASK [Gathering Facts]
2026-03-11 23:24:58.660462 | localhost | ok
2026-03-11 23:24:58.670049 | 
2026-03-11 23:24:58.670135 | TASK [Setup log path fact]
2026-03-11 23:24:58.694404 | localhost | ok
2026-03-11 23:24:58.710056 | 
2026-03-11 23:24:58.710136 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-11 23:24:58.739469 | localhost | ok
2026-03-11 23:24:58.746526 | 
2026-03-11 23:24:58.746597 | TASK [emit-job-header : Print job information]
2026-03-11 23:24:58.788733 | # Job Information
2026-03-11 23:24:58.788923 | Ansible Version: 2.16.16
2026-03-11 23:24:58.789144 | Job: ansible-collection-kubernetes-molecule-cluster-upgrade
2026-03-11 23:24:58.789230 | Pipeline: check
2026-03-11 23:24:58.789292 | Executor: 0a8996d2b663
2026-03-11 23:24:58.789350 | Triggered by: https://github.com/vexxhost/ansible-collection-kubernetes/pull/238
2026-03-11 23:24:58.789409 | Event ID: 5ebdc030-1da1-11f1-811d-5a677c16b3ff
2026-03-11 23:24:58.794466 | 
2026-03-11 23:24:58.794537 | LOOP [emit-job-header : Print node information]
2026-03-11 23:24:58.901029 | localhost | ok:
2026-03-11 23:24:59.104062 | localhost | # Node Information
2026-03-11 23:24:59.104272 | localhost | Inventory Hostname: controller-1
2026-03-11 23:24:59.104331 | localhost | Hostname: np0000158541
2026-03-11 23:24:59.104379 | localhost | Username: zuul
2026-03-11 23:24:59.104432 | localhost | Distro: Debian 13.3
2026-03-11 23:24:59.104478 | localhost | Provider: yul1
2026-03-11 23:24:59.104521 | localhost | Region: ca-ymq-1
2026-03-11 23:24:59.104563 | localhost | Label: debian-trixie
2026-03-11 23:24:59.104605 | localhost | Product Name: OpenStack Nova
2026-03-11 23:24:59.104647 | localhost | Interface IP: 199.204.45.3
2026-03-11 23:24:59.158812 | localhost | ok:
2026-03-11 23:24:59.159082 | localhost | # Node Information
2026-03-11 23:24:59.159351 | localhost | Inventory Hostname: controller-2
2026-03-11 23:24:59.159450 | localhost | Hostname: np0000158542
2026-03-11 23:24:59.159519 | localhost | Username: zuul
2026-03-11 23:24:59.159581 | localhost | Distro: Debian 13.3
2026-03-11 23:24:59.159640 | localhost | Provider: yul1
2026-03-11 23:24:59.159700 | localhost | Region: ca-ymq-1
2026-03-11 23:24:59.159758 | localhost | Label: debian-trixie
2026-03-11 23:24:59.159816 | localhost | Product Name: OpenStack Nova
2026-03-11 23:24:59.159930 | localhost | Interface IP: 162.253.55.195
2026-03-11 23:24:59.205417 | localhost | ok:
2026-03-11 23:24:59.205523 | localhost | # Node Information
2026-03-11 23:24:59.205548 | localhost | Inventory Hostname: controller-3
2026-03-11 23:24:59.205570 | localhost | Hostname: np0000158543
2026-03-11 23:24:59.205590 | localhost | Username: zuul
2026-03-11 23:24:59.205611 | localhost | Distro: Debian 13.3
2026-03-11 23:24:59.205631 | localhost | Provider: yul1
2026-03-11 23:24:59.205650 | localhost | Region: ca-ymq-1
2026-03-11 23:24:59.205668 | localhost | Label: debian-trixie
2026-03-11 23:24:59.205687 | localhost | Product Name: OpenStack Nova
2026-03-11 23:24:59.205705 | localhost | Interface IP: 199.204.45.242
2026-03-11 23:24:59.218373 | 
2026-03-11 23:24:59.218555 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-03-11 23:24:59.678491 | localhost -> localhost | changed
2026-03-11 23:24:59.685206 | 
2026-03-11 23:24:59.685294 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-03-11 23:25:00.597616 | localhost -> localhost | changed
2026-03-11 23:25:00.607842 | 
2026-03-11 23:25:00.607920 | PLAY [all]
2026-03-11 23:25:00.615599 | 
2026-03-11 23:25:00.615671 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-03-11 23:25:00.874683 | controller-1 -> localhost | ok
2026-03-11 23:25:00.881570 | 
2026-03-11 23:25:00.881661 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-03-11 23:25:00.915708 | controller-1 | ok
2026-03-11 23:25:00.919009 | controller-2 | ok
2026-03-11 23:25:00.933016 | controller-3 | ok
2026-03-11 23:25:00.956535 | controller-1 | included: /var/lib/zuul/builds/d29727a84a3048eb896d3409f707b006/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-11 23:25:00.956593 | controller-2 | included: /var/lib/zuul/builds/d29727a84a3048eb896d3409f707b006/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-11 23:25:00.956618 | controller-3 | included: /var/lib/zuul/builds/d29727a84a3048eb896d3409f707b006/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-11 23:25:00.961944 | 
2026-03-11 23:25:00.962007 | TASK [add-build-sshkey : Create Temp SSH key]
2026-03-11 23:25:01.969727 | controller-1 -> localhost | Generating public/private rsa key pair.
2026-03-11 23:25:01.969923 | controller-1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/d29727a84a3048eb896d3409f707b006/work/d29727a84a3048eb896d3409f707b006_id_rsa
2026-03-11 23:25:01.969954 | controller-1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/d29727a84a3048eb896d3409f707b006/work/d29727a84a3048eb896d3409f707b006_id_rsa.pub
2026-03-11 23:25:01.969978 | controller-1 -> localhost | The key fingerprint is:
2026-03-11 23:25:01.970000 | controller-1 -> localhost | SHA256:S2Sb+QLa21Q5uGjJFbycxV+4ZLm1ReWwFQ3ewyAIR6Y zuul-build-sshkey
2026-03-11 23:25:01.970022 | controller-1 -> localhost | The key's randomart image is:
2026-03-11 23:25:01.970042 | controller-1 -> localhost | +---[RSA 3072]----+
2026-03-11 23:25:01.970063 | controller-1 -> localhost | |       .o+.. .ooB|
2026-03-11 23:25:01.970084 | controller-1 -> localhost | |       .+o  .+oB.|
2026-03-11 23:25:01.970105 | controller-1 -> localhost | |       E= o = =o+|
2026-03-11 23:25:01.970125 | controller-1 -> localhost | |       + X = = o.|
2026-03-11 23:25:01.970144 | controller-1 -> localhost | |      . S + + .  |
2026-03-11 23:25:01.970164 | controller-1 -> localhost | |     + * = .     |
2026-03-11 23:25:01.970183 | controller-1 -> localhost | |    . * = .      |
2026-03-11 23:25:01.970202 | controller-1 -> localhost | |     . + .       |
2026-03-11 23:25:01.970222 | controller-1 -> localhost | |      . .        |
2026-03-11 23:25:01.970244 | controller-1 -> localhost | +----[SHA256]-----+
2026-03-11 23:25:01.970294 | controller-1 -> localhost | ok: Runtime: 0:00:00.507520
2026-03-11 23:25:01.974480 | 
2026-03-11 23:25:01.974543 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-03-11 23:25:02.008771 | controller-1 | ok
2026-03-11 23:25:02.012613 | controller-2 | ok
2026-03-11 23:25:02.026930 | controller-3 | ok
2026-03-11 23:25:02.044048 | controller-1 | included: /var/lib/zuul/builds/d29727a84a3048eb896d3409f707b006/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-11 23:25:02.044102 | controller-2 | included: /var/lib/zuul/builds/d29727a84a3048eb896d3409f707b006/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-11 23:25:02.044127 | controller-3 | included: /var/lib/zuul/builds/d29727a84a3048eb896d3409f707b006/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-11 23:25:02.056255 | 
2026-03-11 23:25:02.056324 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-03-11 23:25:02.082014 | controller-1 | skipping: Conditional result was False
2026-03-11 23:25:02.093582 | controller-2 | skipping: Conditional result was False
2026-03-11 23:25:02.104267 | controller-3 | skipping: Conditional result was False
2026-03-11 23:25:02.112056 | 
2026-03-11 23:25:02.112146 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-03-11 23:25:02.649055 | controller-3 | changed
2026-03-11 23:25:02.653894 | controller-1 | changed
2026-03-11 23:25:02.680831 | controller-2 | changed
2026-03-11 23:25:02.687799 | 
2026-03-11 23:25:02.687924 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-03-11 23:25:02.905539 | controller-1 | ok
2026-03-11 23:25:03.110745 | controller-3 | ok
2026-03-11 23:25:03.114071 | controller-2 | ok
2026-03-11 23:25:03.118139 | 
2026-03-11 23:25:03.118249 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-03-11 23:25:03.642664 | controller-1 | changed
2026-03-11 23:25:03.676621 | controller-2 | changed
2026-03-11 23:25:03.680758 | controller-3 | changed
2026-03-11 23:25:03.685065 | 
2026-03-11 23:25:03.685129 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-03-11 23:25:04.217760 | controller-1 | changed
2026-03-11 23:25:04.222929 | controller-3 | changed
2026-03-11 23:25:04.267658 | controller-2 | changed
2026-03-11 23:25:04.272062 | 
2026-03-11 23:25:04.272129 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-03-11 23:25:04.306709 | controller-1 | skipping: Conditional result was False
2026-03-11 23:25:04.309179 | controller-2 | skipping: Conditional result was False
2026-03-11 23:25:04.319605 | controller-3 | skipping: Conditional result was False
2026-03-11 23:25:04.325043 | 
2026-03-11 23:25:04.325139 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-03-11 23:25:04.837145 | controller-1 -> localhost | changed
2026-03-11 23:25:04.914619 | 
2026-03-11 23:25:04.914767 | TASK [add-build-sshkey : Add back temp key]
2026-03-11 23:25:05.182027 | controller-1 -> localhost | Identity added: /var/lib/zuul/builds/d29727a84a3048eb896d3409f707b006/work/d29727a84a3048eb896d3409f707b006_id_rsa (zuul-build-sshkey)
2026-03-11 23:25:05.182439 | controller-1 -> localhost | ok: Runtime: 0:00:00.014250
2026-03-11 23:25:05.187358 | 
2026-03-11 23:25:05.187426 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-03-11 23:25:05.478936 | controller-1 | ok
2026-03-11 23:25:05.579271 | controller-2 | ok
2026-03-11 23:25:05.582681 | controller-3 | ok
2026-03-11 23:25:05.586976 | 
2026-03-11 23:25:05.587040 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-03-11 23:25:05.627839 | controller-1 | skipping: Conditional result was False
2026-03-11 23:25:05.639423 | controller-2 | skipping: Conditional result was False
2026-03-11 23:25:05.650153 | controller-3 | skipping: Conditional result was False
2026-03-11 23:25:05.672322 | 
2026-03-11 23:25:05.672395 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-03-11 23:25:06.007517 | controller-2 | ok
2026-03-11 23:25:06.021771 | controller-3 | ok
2026-03-11 23:25:06.029813 | controller-1 | ok
2026-03-11 23:25:06.035380 | 
2026-03-11 23:25:06.035462 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-03-11 23:25:07.099713 | controller-1 | Output suppressed because no_log was given
2026-03-11 23:25:07.118187 | controller-2 | Output suppressed because no_log was given
2026-03-11 23:25:07.124001 | controller-3 | Output suppressed because no_log was given
2026-03-11 23:25:07.147147 | 
2026-03-11 23:25:07.147251 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-03-11 23:25:07.353858 | controller-1 | ok: "logs"
2026-03-11 23:25:07.354160 | controller-1 | ok: All items complete
2026-03-11 23:25:07.354190 | 
2026-03-11 23:25:07.367281 | controller-2 | ok: "logs"
2026-03-11 23:25:07.374856 | controller-3 | ok: "logs"
2026-03-11 23:25:07.553835 | controller-1 | ok: "artifacts"
2026-03-11 23:25:07.573509 | controller-3 | ok: "artifacts"
2026-03-11 23:25:07.578425 | controller-2 | ok: "artifacts"
2026-03-11 23:25:07.735182 | controller-1 | ok: "docs"
2026-03-11 23:25:07.759537 | controller-2 | ok: "docs"
2026-03-11 23:25:07.764734 | controller-3 | ok: "docs"
2026-03-11 23:25:07.777917 | 
2026-03-11 23:25:07.778185 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-03-11 23:25:08.004981 | controller-1 | changed: "logs"
2026-03-11 23:25:08.005254 | controller-1 | ok: All items complete
2026-03-11 23:25:08.005284 | 
2026-03-11 23:25:08.008922 | controller-2 | changed: "logs"
2026-03-11 23:25:08.012178 | controller-3 | changed: "logs"
2026-03-11 23:25:08.189990 | controller-3 | changed: "artifacts"
2026-03-11 23:25:08.194411 | controller-2 | changed: "artifacts"
2026-03-11 23:25:08.203705 | controller-1 | changed: "artifacts"
2026-03-11 23:25:08.369500 | controller-3 | changed: "docs"
2026-03-11 23:25:08.375043 | controller-2 | changed: "docs"
2026-03-11 23:25:08.386494 | controller-1 | changed: "docs"
2026-03-11 23:25:08.386573 | controller-1 | changed: All items complete
2026-03-11 23:25:08.386609 | 
2026-03-11 23:25:08.411147 | 
2026-03-11 23:25:08.411255 | PLAY RECAP
2026-03-11 23:25:08.411304 | controller-1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-03-11 23:25:08.411333 | controller-2 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-03-11 23:25:08.411359 | controller-3 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-03-11 23:25:08.411383 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-11 23:25:08.411401 | 
2026-03-11 23:25:08.532944 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-11 23:25:08.537291 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-11 23:25:09.162439 | 
2026-03-11 23:25:09.162575 | PLAY [all]
2026-03-11 23:25:09.173765 | 
2026-03-11 23:25:09.173840 | TASK [setup-uv : Extract archive]
2026-03-11 23:25:11.688452 | controller-2 | changed
2026-03-11 23:25:11.724985 | controller-3 | changed
2026-03-11 23:25:11.770381 | controller-1 | changed
2026-03-11 23:25:11.779497 | 
2026-03-11 23:25:11.779622 | TASK [setup-uv : Print version]
2026-03-11 23:25:12.166886 | controller-2 | uv 0.8.13
2026-03-11 23:25:12.171806 | controller-1 | uv 0.8.13
2026-03-11 23:25:12.202687 | controller-3 | uv 0.8.13
2026-03-11 23:25:12.351372 | controller-2 | ok: Runtime: 0:00:00.012757
2026-03-11 23:25:12.360561 | controller-3 | ok: Runtime: 0:00:00.014236
2026-03-11 23:25:12.366431 | controller-1 | ok: Runtime: 0:00:00.015016
2026-03-11 23:25:12.381019 | 
2026-03-11 23:25:12.381084 | PLAY RECAP
2026-03-11 23:25:12.381136 | controller-1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-11 23:25:12.381168 | controller-2 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-11 23:25:12.381205 | controller-3 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-11 23:25:12.381225 | 
2026-03-11 23:25:12.497337 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-11 23:25:12.500736 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-11 23:25:13.111267 | 
2026-03-11 23:25:13.111426 | PLAY [all]
2026-03-11 23:25:13.122979 | 
2026-03-11 23:25:13.123057 | TASK [Copy inventory file for Zuul]
2026-03-11 23:25:14.075591 | controller-1 | changed
2026-03-11 23:25:14.082387 | 
2026-03-11 23:25:14.082469 | TASK [Switch "ansible_host" to private IP]
2026-03-11 23:25:14.426476 | controller-1 | changed: 3 replacements made
2026-03-11 23:25:14.430824 | 
2026-03-11 23:25:14.430883 | TASK [Run Molecule scenario]
2026-03-11 23:25:14.922588 | controller-1 | Using CPython 3.13.5 interpreter at: /usr/bin/python3
2026-03-11 23:25:14.922715 | controller-1 | Creating virtual environment at: .venv
2026-03-11 23:25:15.196597 | controller-1 | Downloading pygments (1.2MiB)
2026-03-11 23:25:15.204214 | controller-1 | Downloading ansible-core (2.3MiB)
2026-03-11 23:25:15.205285 | controller-1 | Downloading cryptography (4.3MiB)
2026-03-11 23:25:15.355012 | controller-1 |  Downloading cryptography
2026-03-11 23:25:15.407772 | controller-1 |  Downloading pygments
2026-03-11 23:25:15.560832 | controller-1 |  Downloading ansible-core
2026-03-11 23:25:15.612521 | controller-1 | Installed 36 packages in 50ms
2026-03-11 23:25:16.279141 | controller-1 | INFO     Collection 'vexxhost.kubernetes' detected.
2026-03-11 23:25:16.279233 | controller-1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-03-11 23:25:17.178314 | controller-1 | CRITICAL 'extensions/molecule/default/molecule.yml' glob failed.  Exiting.
2026-03-11 23:25:17.178382 | controller-1 | INFO     default scenario not found, disabling shared state.
2026-03-11 23:25:17.178403 | controller-1 | INFO     [cluster-upgrade > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-03-11 23:25:17.178512 | controller-1 | INFO     [cluster-upgrade > prerun] Performing prerun with role_name_check=0...
2026-03-11 23:25:39.428503 | controller-1 | INFO     [cluster-upgrade > dependency] Executing
2026-03-11 23:25:39.428581 | controller-1 | WARNING  [cluster-upgrade > dependency] Missing roles requirements file: requirements.yml
2026-03-11 23:25:39.428591 | controller-1 | WARNING  [cluster-upgrade > dependency] Missing collections requirements file: collections.yml
2026-03-11 23:25:39.428616 | controller-1 | WARNING  [cluster-upgrade > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-03-11 23:25:39.432101 | controller-1 | INFO     [cluster-upgrade > cleanup] Executing
2026-03-11 23:25:39.432392 | controller-1 | WARNING  [cluster-upgrade > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-11 23:25:39.442566 | controller-1 | INFO     [cluster-upgrade > destroy] Executing
2026-03-11 23:25:39.442628 | controller-1 | WARNING  [cluster-upgrade > destroy] Skipping, '--destroy=never' requested.
2026-03-11 23:25:39.442691 | controller-1 | INFO     [cluster-upgrade > destroy] Executed: Successful
2026-03-11 23:25:39.462048 | controller-1 | INFO     [cluster-upgrade > syntax] Executing
2026-03-11 23:25:40.895618 | controller-1 |
2026-03-11 23:25:40.895665 | controller-1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/extensions/molecule/cluster-upgrade/converge.yml
2026-03-11 23:25:40.998175 | controller-1 | INFO     [cluster-upgrade > syntax] Executed: Successful
2026-03-11 23:25:41.009096 | controller-1 | INFO     [cluster-upgrade > create] Executing
2026-03-11 23:25:41.010536 | controller-1 | WARNING  [cluster-upgrade > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-11 23:25:41.016011 | controller-1 | INFO     [cluster-upgrade > prepare] Executing
2026-03-11 23:25:42.322895 | controller-1 |
2026-03-11 23:25:42.322927 | controller-1 | PLAY [Prepare] *****************************************************************
2026-03-11 23:25:42.322932 | controller-1 |
2026-03-11 23:25:42.322936 | controller-1 | TASK [Gathering Facts] *********************************************************
2026-03-11 23:25:42.322940 | controller-1 | Wednesday 11 March 2026  23:25:42 +0000 (0:00:00.032)       0:00:00.032 *******
2026-03-11 23:25:43.528106 | controller-1 | [WARNING]: Host 'controller-1' is using the discovered Python interpreter at '/usr/bin/python3.13', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-03-11 23:25:43.548185 | controller-1 | [WARNING]: Host 'controller-2' is using the discovered Python interpreter at '/usr/bin/python3.13', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-03-11 23:25:43.569087 | controller-1 | [WARNING]: Host 'controller-3' is using the discovered Python interpreter at '/usr/bin/python3.13', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-03-11 23:25:43.576344 | controller-1 | ok: [controller-1]
2026-03-11 23:25:43.576373 | controller-1 | ok: [controller-2]
2026-03-11 23:25:43.576488 | controller-1 | ok: [controller-3]
2026-03-11 23:25:43.576562 | controller-1 |
2026-03-11 23:25:43.576649 | controller-1 | TASK [Install Debian packages] *************************************************
2026-03-11 23:25:43.576728 | controller-1 | Wednesday 11 March 2026  23:25:43 +0000 (0:00:01.256)       0:00:01.288 *******
2026-03-11 23:25:49.204056 | controller-1 | ok: [controller-3]
2026-03-11 23:25:49.204101 | controller-1 | ok: [controller-1]
2026-03-11 23:25:49.204104 | controller-1 | ok: [controller-2]
2026-03-11 23:25:49.204108 | controller-1 |
2026-03-11 23:25:49.204112 | controller-1 | PLAY [Configure Kubernetes VIP] ************************************************
2026-03-11 23:25:49.204115 | controller-1 |
2026-03-11 23:25:49.204120 | controller-1 | TASK [Gathering Facts] *********************************************************
2026-03-11 23:25:49.204124 | controller-1 | Wednesday 11 March 2026  23:25:49 +0000 (0:00:05.617)       0:00:06.906 *******
2026-03-11 23:25:50.053878 | controller-1 | ok: [controller-3]
2026-03-11 23:25:50.054037 | controller-1 | ok: [controller-1]
2026-03-11 23:25:50.054230 | controller-1 | ok: [controller-2]
2026-03-11 23:25:50.054404 | controller-1 |
2026-03-11 23:25:50.054634 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/etc/kubernetes/manifests)] ***
2026-03-11 23:25:50.054827 | controller-1 | Wednesday 11 March 2026  23:25:50 +0000 (0:00:00.859)       0:00:07.765 *******
2026-03-11 23:25:50.522133 | controller-1 | changed: [controller-2]
2026-03-11 23:25:50.522259 | controller-1 | changed: [controller-1]
2026-03-11 23:25:50.522445 | controller-1 | changed: [controller-3]
2026-03-11 23:25:50.522614 | controller-1 |
2026-03-11 23:25:50.522813 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack] ****************
2026-03-11 23:25:50.523003 | controller-1 | Wednesday 11 March 2026  23:25:50 +0000 (0:00:00.468)       0:00:08.234 *******
2026-03-11 23:25:51.963600 | controller-1 | ok: [controller-2] => (item=/etc/keepalived/keepalived.conf)
2026-03-11 23:25:51.963636 | controller-1 | ok: [controller-1] => (item=/etc/keepalived/keepalived.conf)
2026-03-11 23:25:51.963642 | controller-1 | ok: [controller-3] => (item=/etc/keepalived/keepalived.conf)
2026-03-11 23:25:51.963647 | controller-1 | ok: [controller-2] => (item=/etc/keepalived/check_apiserver.sh)
2026-03-11 23:25:51.963652 | controller-1 | ok: [controller-1] => (item=/etc/keepalived/check_apiserver.sh)
2026-03-11 23:25:51.963656 | controller-1 | ok: [controller-3] => (item=/etc/keepalived/check_apiserver.sh)
2026-03-11 23:25:51.963661 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes/manifests/keepalived.yaml)
2026-03-11 23:25:51.963666 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes/manifests/keepalived.yaml)
2026-03-11 23:25:51.963671 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes/manifests/keepalived.yaml)
2026-03-11 23:25:51.963675 | controller-1 | ok: [controller-2] => (item=/etc/haproxy/haproxy.cfg)
2026-03-11 23:25:51.963684 | controller-1 | ok: [controller-1] => (item=/etc/haproxy/haproxy.cfg)
2026-03-11 23:25:51.963854 | controller-1 | ok: [controller-3] => (item=/etc/haproxy/haproxy.cfg)
2026-03-11 23:25:51.964057 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes/manifests/haproxy.yaml)
2026-03-11 23:25:51.964262 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes/manifests/haproxy.yaml)
2026-03-11 23:25:51.964461 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes/manifests/haproxy.yaml)
2026-03-11 23:25:51.964642 | controller-1 |
2026-03-11 23:25:51.964863 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Switch API server to run on port 6443] ****
2026-03-11 23:25:51.965058 | controller-1 | Wednesday 11 March 2026  23:25:51 +0000 (0:00:01.439)       0:00:09.673 *******
2026-03-11 23:25:52.365701 | controller-1 | [ERROR]: Task failed: Module failed: Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !
2026-03-11 23:25:52.365888 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kube_vip/tasks/main.yml:32:3
2026-03-11 23:25:52.366074 | controller-1 |
2026-03-11 23:25:52.366333 | controller-1 | 30     - Restart "kubelet" service
2026-03-11 23:25:52.366526 | controller-1 | 31
2026-03-11 23:25:52.366728 | controller-1 | 32 - name: Switch API server to run on port 6443
2026-03-11 23:25:52.366918 | controller-1 |      ^ column 3
2026-03-11 23:25:52.367104 | controller-1 |
2026-03-11 23:25:52.367402 | controller-1 | failed: [controller-1] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257}
2026-03-11 23:25:52.372219 | controller-1 | failed: [controller-3] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257}
2026-03-11 23:25:52.373299 | controller-1 | failed: [controller-2] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257}
2026-03-11 23:25:52.638928 | controller-1 | [ERROR]: Task failed: Module failed: Path /etc/kubernetes/controller-manager.conf does not exist !
2026-03-11 23:25:52.638980 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kube_vip/tasks/main.yml:32:3
2026-03-11 23:25:52.638984 | controller-1 |
2026-03-11 23:25:52.638989 | controller-1 | 30     - Restart "kubelet" service
2026-03-11 23:25:52.638993 | controller-1 | 31
2026-03-11 23:25:52.638999 | controller-1 | 32 - name: Switch API server to run on port 6443
2026-03-11 23:25:52.639118 | controller-1 |      ^ column 3
2026-03-11 23:25:52.639230 | controller-1 |
2026-03-11 23:25:52.639366 | controller-1 | failed: [controller-2] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257}
2026-03-11 23:25:52.639650 | controller-1 | failed: [controller-3] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257}
2026-03-11 23:25:52.639752 | controller-1 | failed: [controller-1] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257}
2026-03-11 23:25:52.885705 | controller-1 | [ERROR]: Task failed: Module failed: Path /etc/kubernetes/scheduler.conf does not exist !
2026-03-11 23:25:52.885893 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kube_vip/tasks/main.yml:32:3
2026-03-11 23:25:52.886093 | controller-1 |
2026-03-11 23:25:52.886285 | controller-1 | 30     - Restart "kubelet" service
2026-03-11 23:25:52.886469 | controller-1 | 31
2026-03-11 23:25:52.888544 | controller-1 | 32 - name: Switch API server to run on port 6443
2026-03-11 23:25:52.888565 | controller-1 |      ^ column 3
2026-03-11 23:25:52.888574 | controller-1 |
2026-03-11 23:25:52.888588 | controller-1 | failed: [controller-2] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257}
2026-03-11 23:25:52.919054 | controller-1 | failed: [controller-3] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257}
2026-03-11 23:25:52.930262 | controller-1 | failed: [controller-1] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257}
2026-03-11 23:25:52.938243 | controller-1 | ...ignoring
2026-03-11 23:25:52.938394 | controller-1 | ...ignoring
2026-03-11 23:25:52.938581 | controller-1 | ...ignoring
2026-03-11 23:25:52.938759 | controller-1 |
2026-03-11 23:25:52.938966 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Check if super-admin.conf exists] *********
2026-03-11 23:25:52.939159 | controller-1 | Wednesday 11 March 2026  23:25:52 +0000 (0:00:00.976)       0:00:10.650 *******
2026-03-11 23:25:53.346054 | controller-1 | ok: [controller-2]
2026-03-11 23:25:53.346208 | controller-1 | ok: [controller-1]
2026-03-11 23:25:53.346395 | controller-1 | ok: [controller-3]
2026-03-11 23:25:53.346571 | controller-1 |
2026-03-11 23:25:53.346770 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Check if kubeadm has already run] *********
2026-03-11 23:25:53.346960 | controller-1 | Wednesday 11 March 2026  23:25:53 +0000 (0:00:00.407)       0:00:11.057 *******
2026-03-11 23:25:53.676740 | controller-1 | ok: [controller-1]
2026-03-11 23:25:53.676802 | controller-1 | ok: [controller-3]
2026-03-11 23:25:53.676815 | controller-1 | ok: [controller-2]
2026-03-11 23:25:53.676941 | controller-1 |
2026-03-11 23:25:53.677071 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path] ************
2026-03-11 23:25:53.677189 | controller-1 | Wednesday 11 March 2026  23:25:53 +0000 (0:00:00.326)       0:00:11.384 *******
2026-03-11 23:25:53.737396 | controller-1 | ok: [controller-1]
2026-03-11 23:25:53.739602 | controller-1 | ok: [controller-2]
2026-03-11 23:25:53.739636 | controller-1 | ok: [controller-3]
2026-03-11 23:25:53.739640 | controller-1 |
2026-03-11 23:25:53.739644 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path (with super-admin.conf)] ***
2026-03-11 23:25:53.739648 | controller-1 | Wednesday 11 March 2026  23:25:53 +0000 (0:00:00.064)       0:00:11.448 *******
2026-03-11 23:25:53.807745 | controller-1 | ok: [controller-1]
2026-03-11 23:25:53.807799 | controller-1 | skipping: [controller-2]
2026-03-11 23:25:53.807808 | controller-1 | skipping: [controller-3]
2026-03-11 23:25:53.807816 | controller-1 |
2026-03-11 23:25:53.807825 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Upload Kubernetes manifest] ***************
2026-03-11 23:25:53.807835 | controller-1 | Wednesday 11 March 2026  23:25:53 +0000 (0:00:00.069)       0:00:11.518 *******
2026-03-11 23:25:54.748616 | controller-1 | ok: [controller-2]
2026-03-11 23:25:54.748763 | controller-1 | ok: [controller-3]
2026-03-11 23:25:54.748955 | controller-1 | ok: [controller-1]
2026-03-11 23:25:54.749163 | controller-1 |
2026-03-11 23:25:54.749366 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Ensure kube-vip configuration file] *******
2026-03-11 23:25:54.749560 | controller-1 | Wednesday 11 March 2026  23:25:54 +0000 (0:00:00.941)       0:00:12.459 *******
2026-03-11 23:25:55.131290 | controller-1 | ok: [controller-1]
2026-03-11 23:25:55.131350 | controller-1 | ok: [controller-2]
2026-03-11 23:25:55.131358 | controller-1 | ok: [controller-3]
2026-03-11 23:25:55.131437 | controller-1 |
2026-03-11 23:25:55.131556 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] ***************************
2026-03-11 23:25:55.135577 | controller-1 | Wednesday 11 March 2026  23:25:55 +0000 (0:00:00.319)       0:00:12.779 *******
2026-03-11 23:25:55.135596 | controller-1 |
2026-03-11 23:25:55.135604 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] ***************************
2026-03-11 23:25:55.135612 | controller-1 | Wednesday 11 March 2026  23:25:55 +0000 (0:00:00.003)       0:00:12.783 *******
2026-03-11 23:25:55.135619 | controller-1 |
2026-03-11 23:25:55.135626 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] ***************************
2026-03-11 23:25:55.135633 | controller-1 | Wednesday 11 March 2026  23:25:55 +0000 (0:00:00.002)       0:00:12.785 *******
2026-03-11 23:25:55.135640 | controller-1 |
2026-03-11 23:25:55.135647 | controller-1 | PLAY [Install Kubernetes] ******************************************************
2026-03-11 23:25:55.135654 | controller-1 |
2026-03-11 23:25:55.135661 | controller-1 | TASK [Gathering Facts] *********************************************************
2026-03-11 23:25:55.135668 | controller-1 | Wednesday 11 March 2026  23:25:55 +0000 (0:00:00.058)       0:00:12.843 *******
2026-03-11 23:25:55.999559 | controller-1 | ok: [controller-2]
2026-03-11 23:25:55.999701 | controller-1 | ok: [controller-1]
2026-03-11 23:25:55.999883 | controller-1 | ok: [controller-3]
2026-03-11 23:25:56.000061 | controller-1 |
2026-03-11 23:25:56.000256 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-11 23:25:56.000447 | controller-1 | Wednesday 11 March 2026  23:25:55 +0000 (0:00:00.867)       0:00:13.711 *******
2026-03-11 23:25:56.417823 | controller-1 | ok: [controller-1]
2026-03-11 23:25:56.417925 | controller-1 | ok: [controller-2]
2026-03-11 23:25:56.418130 | controller-1 | ok: [controller-3]
2026-03-11 23:25:56.418410 | controller-1 |
2026-03-11 23:25:56.418511 | controller-1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-11 23:25:56.418752 | controller-1 | Wednesday 11 March 2026  23:25:56 +0000 (0:00:00.418)       0:00:14.130 *******
2026-03-11 23:25:56.504847 | controller-1 | skipping: [controller-1]
2026-03-11 23:25:56.505008 | controller-1 | skipping: [controller-2]
2026-03-11 23:25:56.505251 | controller-1 | skipping: [controller-3]
2026-03-11 23:25:56.505385 | controller-1 |
2026-03-11 23:25:56.505594 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-11 23:25:56.505789 | controller-1 | Wednesday 11 March 2026  23:25:56 +0000 (0:00:00.087)       0:00:14.217 *******
2026-03-11 23:25:56.858463 | controller-1 | changed: [controller-1]
2026-03-11 23:25:56.858630 | controller-1 | changed: [controller-2]
2026-03-11 23:25:56.858817 | controller-1 | changed: [controller-3]
2026-03-11 23:25:56.858987 | controller-1 |
2026-03-11 23:25:56.859184 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:25:56.859373 | controller-1 | Wednesday 11 March 2026  23:25:56 +0000 (0:00:00.353)       0:00:14.570 *******
2026-03-11 23:25:56.972092 | controller-1 | ok: [controller-1] => {
2026-03-11 23:25:56.972353 | controller-1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-11 23:25:56.972508 | controller-1 | }
2026-03-11 23:25:56.972751 | controller-1 | ok: [controller-2] => {
2026-03-11 23:25:56.972914 | controller-1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-11 23:25:56.973086 | controller-1 | }
2026-03-11 23:25:56.973262 | controller-1 | ok: [controller-3] => {
2026-03-11 23:25:56.973460 | controller-1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-11 23:25:56.973638 | controller-1 | }
2026-03-11 23:25:56.973811 | controller-1 |
2026-03-11 23:25:56.974005 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:25:56.974195 | controller-1 | Wednesday 11 March 2026  23:25:56 +0000 (0:00:00.113)       0:00:14.683 *******
2026-03-11 23:25:57.770875 | controller-1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually
2026-03-11 23:25:57.837416 | controller-1 | changed: [controller-3]
2026-03-11 23:25:57.837595 | controller-1 | changed: [controller-2]
2026-03-11 23:25:57.837785 | controller-1 | changed: [controller-1]
2026-03-11 23:25:57.837963 | controller-1 |
2026-03-11 23:25:57.838164 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:25:57.838361 | controller-1 | Wednesday 11 March 2026  23:25:57 +0000 (0:00:00.865)       0:00:15.549 *******
2026-03-11 23:25:57.935453 | controller-1 | skipping: [controller-1]
2026-03-11 23:25:57.935688 | controller-1 | skipping: [controller-2]
2026-03-11 23:25:57.935908 | controller-1 | skipping: [controller-3]
2026-03-11 23:25:57.936066 | controller-1 |
2026-03-11 23:25:57.936264 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-11 23:25:57.936457 | controller-1 | Wednesday 11 March 2026  23:25:57 +0000 (0:00:00.098)       0:00:15.647 *******
2026-03-11 23:25:58.296913 | controller-1 | ok: [controller-1]
2026-03-11 23:25:58.297049 | controller-1 | ok: [controller-2]
2026-03-11 23:25:58.297295 | controller-1 | ok: [controller-3]
2026-03-11 23:25:58.297426 | controller-1 |
2026-03-11 23:25:58.297666 | controller-1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-11 23:25:58.297814 | controller-1 | Wednesday 11 March 2026  23:25:58 +0000 (0:00:00.361)       0:00:16.009 *******
2026-03-11 23:25:59.358711 | controller-1 | ok: [controller-2]
2026-03-11 23:25:59.358768 | controller-1 | ok: [controller-1]
2026-03-11 23:25:59.358777 | controller-1 | ok: [controller-3]
2026-03-11 23:25:59.358786 | controller-1 |
2026-03-11 23:25:59.358794 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:25:59.358802 | controller-1 | Wednesday 11 March 2026  23:25:59 +0000 (0:00:01.060)       0:00:17.069 *******
2026-03-11 23:25:59.468255 | controller-1 | ok: [controller-1] => {
2026-03-11 23:25:59.468285 | controller-1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-11 23:25:59.468381 | controller-1 | }
2026-03-11 23:25:59.468470 | controller-1 | ok: [controller-2] => {
2026-03-11 23:25:59.468559 | controller-1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-11 23:25:59.468632 | controller-1 | }
2026-03-11 23:25:59.468718 | controller-1 | ok: [controller-3] => {
2026-03-11 23:25:59.468822 | controller-1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-11 23:25:59.468895 | controller-1 | }
2026-03-11 23:25:59.468974 | controller-1 |
2026-03-11 23:25:59.469064 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:25:59.469151 | controller-1 | Wednesday 11 March 2026  23:25:59 +0000 (0:00:00.109)       0:00:17.178 *******
2026-03-11 23:26:00.484389 | controller-1 | changed: [controller-2]
2026-03-11 23:26:00.484450 | controller-1 | changed: [controller-1]
2026-03-11 23:26:00.484459 | controller-1 | changed: [controller-3]
2026-03-11 23:26:00.484468 | controller-1 |
2026-03-11 23:26:00.484477 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:26:00.484487 | controller-1 | Wednesday 11 March 2026  23:26:00 +0000 (0:00:01.016)       0:00:18.195 *******
2026-03-11 23:26:03.626417 | controller-1 | changed: [controller-1]
2026-03-11 23:26:03.626449 | controller-1 | changed: [controller-2]
2026-03-11 23:26:03.626453 | controller-1 | changed: [controller-3]
2026-03-11 23:26:03.626457 | controller-1 |
2026-03-11 23:26:03.626461 | controller-1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-11 23:26:03.626464 | controller-1 | Wednesday 11 March 2026  23:26:03 +0000 (0:00:03.141)       0:00:21.337 *******
2026-03-11 23:26:03.697333 | controller-1 | skipping: [controller-1]
2026-03-11 23:26:03.697340 | controller-1 | skipping: [controller-2]
2026-03-11 23:26:03.697344 | controller-1 | skipping: [controller-3]
2026-03-11 23:26:03.697348 | controller-1 |
2026-03-11 23:26:03.697351 | controller-1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-11 23:26:03.697354 | controller-1 | Wednesday 11 March 2026  23:26:03 +0000 (0:00:00.069)       0:00:21.406 *******
2026-03-11 23:26:03.778254 | controller-1 | skipping: [controller-1]
2026-03-11 23:26:03.778261 | controller-1 | skipping: [controller-2]
2026-03-11 23:26:03.778264 | controller-1 | skipping: [controller-3]
2026-03-11 23:26:03.778267 | controller-1 |
2026-03-11 23:26:03.778271 | controller-1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-11 23:26:03.778274 | controller-1 | Wednesday 11 March 2026  23:26:03 +0000 (0:00:00.071)       0:00:21.478 *******
2026-03-11 23:26:03.804113 | controller-1 | skipping: [controller-1]
2026-03-11 23:26:03.838248 | controller-1 | skipping: [controller-2]
2026-03-11 23:26:03.838321 | controller-1 | skipping: [controller-3]
2026-03-11 23:26:03.838401 | controller-1 |
2026-03-11 23:26:03.838492 | controller-1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-11 23:26:03.838581 | controller-1 | Wednesday 11 March 2026  23:26:03 +0000 (0:00:00.072)       0:00:21.550 *******
2026-03-11 23:26:11.168150 | controller-1 | changed: [controller-1]
2026-03-11 23:26:11.168206 | controller-1 | changed: [controller-3]
2026-03-11 23:26:11.171615 | controller-1 | changed: [controller-2]
2026-03-11 23:26:11.171658 | controller-1 |
2026-03-11 23:26:11.171663 | controller-1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-11 23:26:11.171667 | controller-1 | Wednesday 11 March 2026  23:26:11 +0000 (0:00:07.329)       0:00:28.880 *******
2026-03-11 23:26:11.919989 | controller-1 | changed: [controller-2]
2026-03-11 23:26:11.920094 | controller-1 | changed: [controller-1]
2026-03-11 23:26:11.920245 | controller-1 | changed: [controller-3]
2026-03-11 23:26:11.920363 | controller-1 |
2026-03-11 23:26:11.920509 | controller-1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-11 23:26:11.920673 | controller-1 | Wednesday 11 March 2026  23:26:11 +0000 (0:00:00.751)       0:00:29.631 *******
2026-03-11 23:26:13.379394 | controller-1 | changed: [controller-1] => (item={'path': '/etc/containerd'})
2026-03-11 23:26:13.379442 | controller-1 | changed: [controller-2] => (item={'path': '/etc/containerd'})
2026-03-11 23:26:13.379570 | controller-1 | changed: [controller-3] => (item={'path': '/etc/containerd'})
2026-03-11 23:26:13.381099 | controller-1 | changed: [controller-2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-11 23:26:13.381138 | controller-1 | changed: [controller-1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-11 23:26:13.381144 | controller-1 | changed: [controller-3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-11 23:26:13.381149 | controller-1 | changed: [controller-1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-11 23:26:13.381154 | controller-1 | changed: [controller-2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-11 23:26:13.381159 | controller-1 | changed: [controller-3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-11 23:26:13.381164 | controller-1 | changed: [controller-1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-11 23:26:13.381176 | controller-1 | changed: [controller-2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-11 23:26:13.381181 | controller-1 | changed: [controller-3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-11 23:26:13.381186 | controller-1 | changed: [controller-1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-11 23:26:13.381191 | controller-1 | changed: [controller-2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-11 23:26:13.381195 | controller-1 | changed: [controller-3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-11 23:26:13.381201 | controller-1 |
2026-03-11 23:26:13.381206 | controller-1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-11 23:26:13.381211 | controller-1 | Wednesday 11 March 2026  23:26:13 +0000 (0:00:01.460)       0:00:31.091 *******
2026-03-11 23:26:14.246719 | controller-1 | changed: [controller-2]
2026-03-11 23:26:14.246769 | controller-1 | changed: [controller-1]
2026-03-11 23:26:14.246827 | controller-1 | changed: [controller-3]
2026-03-11 23:26:14.246904 | controller-1 |
2026-03-11 23:26:14.246992 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-11 23:26:14.247079 | controller-1 | Wednesday 11 March 2026  23:26:14 +0000 (0:00:00.847)       0:00:31.938 *******
2026-03-11 23:26:14.247150 | controller-1 |
2026-03-11 23:26:14.247234 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-11 23:26:14.247320 | controller-1 | Wednesday 11 March 2026  23:26:14 +0000 (0:00:00.007)       0:00:31.946 *******
2026-03-11 23:26:14.247395 | controller-1 |
2026-03-11 23:26:14.247478 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-11 23:26:14.247814 | controller-1 | Wednesday 11 March 2026  23:26:14 +0000 (0:00:00.004)       0:00:31.951 *******
2026-03-11 23:26:14.247881 | controller-1 |
2026-03-11 23:26:14.247901 | controller-1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-03-11 23:26:14.247909 | controller-1 | Wednesday 11 March 2026  23:26:14 +0000 (0:00:00.005)       0:00:31.956 *******
2026-03-11 23:26:15.220124 | controller-1 | changed: [controller-2]
2026-03-11 23:26:15.220189 | controller-1 | changed: [controller-3]
2026-03-11 23:26:15.220201 | controller-1 | changed: [controller-1]
2026-03-11 23:26:15.220511 | controller-1 |
2026-03-11 23:26:15.220544 | controller-1 | RUNNING HANDLER [vexxhost.kubernetes.kubelet : Reload systemd] *****************
2026-03-11 23:26:15.220550 | controller-1 | Wednesday 11 March 2026  23:26:15 +0000 (0:00:00.972)       0:00:32.929 *******
2026-03-11 23:26:17.108147 | controller-1 | ok: [controller-2]
2026-03-11 23:26:17.108213 | controller-1 | ok: [controller-3]
2026-03-11 23:26:17.108296 | controller-1 | ok: [controller-1]
2026-03-11 23:26:17.108408 | controller-1 |
2026-03-11 23:26:17.108530 | controller-1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-11 23:26:17.108650 | controller-1 | Wednesday 11 March 2026  23:26:17 +0000 (0:00:01.888)       0:00:34.818 *******
2026-03-11 23:26:17.923062 | controller-1 | changed: [controller-1]
2026-03-11 23:26:17.923109 | controller-1 | changed: [controller-2]
2026-03-11 23:26:17.923126 | controller-1 | changed: [controller-3]
2026-03-11 23:26:17.923190 | controller-1 |
2026-03-11 23:26:17.923299 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the "kubeadm-config" ConfigMap] ***
2026-03-11 23:26:17.923386 | controller-1 | Wednesday 11 March 2026  23:26:17 +0000 (0:00:00.816)       0:00:35.635 *******
2026-03-11 23:26:18.585006 | controller-1 | [ERROR]: Task failed: Module failed: Failed to import the required Python library (kubernetes) on np0000158541's Python /usr/bin/python3.13. Please read the module documentation and install it in the appropriate location. If the required library is installed, but Ansible is using the wrong Python interpreter, please consult the documentation on ansible_python_interpreter
2026-03-11 23:26:18.585055 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes_upgrade_check/tasks/main.yml:16:3
2026-03-11 23:26:18.585063 | controller-1 |
2026-03-11 23:26:18.585070 | controller-1 | 14
2026-03-11 23:26:18.585075 | controller-1 | 15 ---
2026-03-11 23:26:18.585081 | controller-1 | 16 - name: Retrieve the "kubeadm-config" ConfigMap
2026-03-11 23:26:18.585097 | controller-1 |      ^ column 3
2026-03-11 23:26:18.585103 | controller-1 |
2026-03-11 23:26:18.585109 | controller-1 | fatal: [controller-1]: FAILED! => {"changed": false, "msg": "Failed to import the required Python library (kubernetes) on np0000158541's Python /usr/bin/python3.13. Please read the module documentation and install it in the appropriate location. If the required library is installed, but Ansible is using the wrong Python interpreter, please consult the documentation on ansible_python_interpreter"}
2026-03-11 23:26:18.596188 | controller-1 | ...ignoring
2026-03-11 23:26:18.596380 | controller-1 |
2026-03-11 23:26:18.596556 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Parse the ClusterConfiguration] ***
2026-03-11 23:26:18.596715 | controller-1 | Wednesday 11 March 2026  23:26:18 +0000 (0:00:00.671)       0:00:36.306 *******
2026-03-11 23:26:18.640195 | controller-1 | skipping: [controller-1]
2026-03-11 23:26:18.640254 | controller-1 |
2026-03-11 23:26:18.640407 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the current Kubernetes version] ***
2026-03-11 23:26:18.640531 | controller-1 | Wednesday 11 March 2026  23:26:18 +0000 (0:00:00.043)       0:00:36.349 *******
2026-03-11 23:26:18.679960 | controller-1 | skipping: [controller-1]
2026-03-11 23:26:18.680056 | controller-1 |
2026-03-11 23:26:18.680187 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Extract major, minor, and patch versions] ***
2026-03-11 23:26:18.680296 | controller-1 | Wednesday 11 March 2026  23:26:18 +0000 (0:00:00.042)       0:00:36.392 *******
2026-03-11 23:26:18.720266 | controller-1 | skipping: [controller-1]
2026-03-11 23:26:18.720322 | controller-1 |
2026-03-11 23:26:18.720386 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Fail if we're jumping more than one minor version] ***
2026-03-11 23:26:18.720469 | controller-1 | Wednesday 11 March 2026  23:26:18 +0000 (0:00:00.039)       0:00:36.432 *******
2026-03-11 23:26:18.796779 | controller-1 | skipping: [controller-1]
2026-03-11 23:26:18.796819 | controller-1 | skipping: [controller-2]
2026-03-11 23:26:18.796825 | controller-1 | skipping: [controller-3]
2026-03-11 23:26:18.796831 | controller-1 |
2026-03-11 23:26:18.796836 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Set fact if we need to upgrade] ***
2026-03-11 23:26:18.796842 | controller-1 | Wednesday 11 March 2026  23:26:18 +0000 (0:00:00.073)       0:00:36.505 *******
2026-03-11 23:26:18.883149 | controller-1 | skipping: [controller-1]
2026-03-11 23:26:18.883197 | controller-1 | skipping: [controller-2]
2026-03-11 23:26:18.883588 | controller-1 | skipping: [controller-3]
2026-03-11 23:26:18.883618 | controller-1 |
2026-03-11 23:26:18.883624 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-11 23:26:18.883628 | controller-1 | Wednesday 11 March 2026  23:26:18 +0000 (0:00:00.090)       0:00:36.595 *******
2026-03-11 23:26:19.240239 | controller-1 | ok: [controller-1]
2026-03-11 23:26:19.240289 | controller-1 | ok: [controller-2]
2026-03-11 23:26:19.240366 | controller-1 | ok: [controller-3]
2026-03-11 23:26:19.240451 | controller-1 |
2026-03-11 23:26:19.240660 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:26:19.240699 | controller-1 | Wednesday 11 March 2026  23:26:19 +0000 (0:00:00.353)       0:00:36.949 *******
2026-03-11 23:26:19.336168 | controller-1 | ok: [controller-1] => {
2026-03-11 23:26:19.336201 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubeadm"
2026-03-11 23:26:19.336288 | controller-1 | }
2026-03-11 23:26:19.336377 | controller-1 | ok: [controller-2] => {
2026-03-11 23:26:19.336466 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubeadm"
2026-03-11 23:26:19.336542 | controller-1 | }
2026-03-11 23:26:19.336629 | controller-1 | ok: [controller-3] => {
2026-03-11 23:26:19.337070 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubeadm"
2026-03-11 23:26:19.337102 | controller-1 | }
2026-03-11 23:26:19.337107 | controller-1 |
2026-03-11 23:26:19.337111 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:26:19.337115 | controller-1 | Wednesday 11 March 2026  23:26:19 +0000 (0:00:00.094)       0:00:37.044 *******
2026-03-11 23:26:21.179140 | controller-1 | changed: [controller-2]
2026-03-11 23:26:21.179209 | controller-1 | changed: [controller-3]
2026-03-11 23:26:21.179307 | controller-1 | changed: [controller-1]
2026-03-11 23:26:21.179417 | controller-1 |
2026-03-11 23:26:21.179567 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:26:21.179737 | controller-1 | Wednesday 11 March 2026  23:26:21 +0000 (0:00:01.846)       0:00:38.891 *******
2026-03-11 23:26:21.224125 | controller-1 | skipping: [controller-1]
2026-03-11 23:26:21.283820 | controller-1 | skipping: [controller-2]
2026-03-11 23:26:21.283870 | controller-1 | skipping: [controller-3]
2026-03-11 23:26:21.283963 | controller-1 |
2026-03-11 23:26:21.284058 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-11 23:26:21.284156 | controller-1 | Wednesday 11 March 2026  23:26:21 +0000 (0:00:00.105)       0:00:38.996 *******
2026-03-11 23:26:21.673498 | controller-1 | ok: [controller-1]
2026-03-11 23:26:21.673593 | controller-1 | ok: [controller-2]
2026-03-11 23:26:21.673607 | controller-1 | ok: [controller-3]
2026-03-11 23:26:21.673729 | controller-1 |
2026-03-11 23:26:21.673851 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:26:21.673970 | controller-1 | Wednesday 11 March 2026  23:26:21 +0000 (0:00:00.388)       0:00:39.385 *******
2026-03-11 23:26:21.764031 | controller-1 | ok: [controller-1] => {
2026-03-11 23:26:21.764154 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubectl"
2026-03-11 23:26:21.764271 | controller-1 | }
2026-03-11 23:26:21.764388 | controller-1 | ok: [controller-2] => {
2026-03-11 23:26:21.764509 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubectl"
2026-03-11 23:26:21.764613 | controller-1 | }
2026-03-11 23:26:21.764742 | controller-1 | ok: [controller-3] => {
2026-03-11 23:26:21.764851 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubectl"
2026-03-11 23:26:21.764963 | controller-1 | }
2026-03-11 23:26:21.765069 | controller-1 |
2026-03-11 23:26:21.765190 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:26:21.765310 | controller-1 | Wednesday 11 March 2026  23:26:21 +0000 (0:00:00.090)       0:00:39.475 *******
2026-03-11 23:26:23.016065 | controller-1 | changed: [controller-2]
2026-03-11 23:26:23.016166 | controller-1 | changed: [controller-3]
2026-03-11 23:26:23.016175 | controller-1 | changed: [controller-1]
2026-03-11 23:26:23.016201 | controller-1 |
2026-03-11 23:26:23.016311 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:26:23.016400 | controller-1 | Wednesday 11 March 2026  23:26:23 +0000 (0:00:01.250)       0:00:40.726 *******
2026-03-11 23:26:23.050159 | controller-1 | skipping: [controller-1]
2026-03-11 23:26:23.130175 | controller-1 | skipping: [controller-2]
2026-03-11 23:26:23.130205 | controller-1 | skipping: [controller-3]
2026-03-11 23:26:23.130297 | controller-1 |
2026-03-11 23:26:23.130393 | controller-1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-11 23:26:23.130476 | controller-1 | Wednesday 11 March 2026  23:26:23 +0000 (0:00:00.115)       0:00:40.842 *******
2026-03-11 23:26:23.204501 | controller-1 | skipping: [controller-1]
2026-03-11 23:26:23.204525 | controller-1 | skipping: [controller-2]
2026-03-11 23:26:23.204534 | controller-1 | skipping: [controller-3]
2026-03-11 23:26:23.204542 | controller-1 |
2026-03-11 23:26:23.204550 | controller-1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-11 23:26:23.204563 | controller-1 | Wednesday 11 March 2026  23:26:23 +0000 (0:00:00.071)       0:00:40.914 *******
2026-03-11 23:26:23.280753 | controller-1 | skipping: [controller-1]
2026-03-11 23:26:23.280806 | controller-1 | skipping: [controller-2]
2026-03-11 23:26:23.280886 | controller-1 | skipping: [controller-3]
2026-03-11 23:26:23.280968 | controller-1 |
2026-03-11 23:26:23.281057 | controller-1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-11 23:26:23.281153 | controller-1 | Wednesday 11 March 2026  23:26:23 +0000 (0:00:00.077)       0:00:40.992 *******
2026-03-11 23:26:23.360528 | controller-1 | skipping: [controller-1]
2026-03-11 23:26:23.360561 | controller-1 | skipping: [controller-2]
2026-03-11 23:26:23.360565 | controller-1 | skipping: [controller-3]
2026-03-11 23:26:23.360569 | controller-1 |
2026-03-11 23:26:23.360572 | controller-1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-11 23:26:23.360576 | controller-1 | Wednesday 11 March 2026  23:26:23 +0000 (0:00:00.077)       0:00:41.070 *******
2026-03-11 23:26:24.370208 | controller-1 | ok: [controller-2]
2026-03-11 23:26:24.370273 | controller-1 | ok: [controller-3]
2026-03-11 23:26:24.370404 | controller-1 | ok: [controller-1]
2026-03-11 23:26:24.370513 | controller-1 |
2026-03-11 23:26:24.370644 | controller-1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-11 23:26:24.370788 | controller-1 | Wednesday 11 March 2026  23:26:24 +0000 (0:00:01.012)       0:00:42.082 *******
2026-03-11 23:26:25.647631 | controller-1 | ok: [controller-1]
2026-03-11 23:26:25.647711 | controller-1 | ok: [controller-2]
2026-03-11 23:26:25.648226 | controller-1 | ok: [controller-3]
2026-03-11 23:26:25.648270 | controller-1 |
2026-03-11 23:26:25.648277 | controller-1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-11 23:26:25.648283 | controller-1 | Wednesday 11 March 2026  23:26:25 +0000 (0:00:01.277)       0:00:43.359 *******
2026-03-11 23:26:27.156080 | controller-1 | ok: [controller-1] => (item={'path': '/etc/containerd'})
2026-03-11 23:26:27.156139 | controller-1 | ok: [controller-2] => (item={'path': '/etc/containerd'})
2026-03-11 23:26:27.156205 | controller-1 | ok: [controller-3] => (item={'path': '/etc/containerd'})
2026-03-11 23:26:27.156297 | controller-1 | ok: [controller-1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-11 23:26:27.157531 | controller-1 | ok: [controller-2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-11 23:26:27.157567 | controller-1 | ok: [controller-3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-11 23:26:27.157571 | controller-1 | ok: [controller-2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-11 23:26:27.157575 | controller-1 | ok: [controller-1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-11 23:26:27.157579 | controller-1 | ok: [controller-3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-11 23:26:27.157583 | controller-1 | ok: [controller-2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-11 23:26:27.157586 | controller-1 | ok: [controller-1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-11 23:26:27.157601 | controller-1 | ok: [controller-3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-11 23:26:27.157606 | controller-1 | ok: [controller-2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-11 23:26:27.157610 | controller-1 | ok: [controller-1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-11 23:26:27.157613 | controller-1 | ok: [controller-3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-11 23:26:27.157617 | controller-1 |
2026-03-11 23:26:27.157621 | controller-1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-11 23:26:27.157625 | controller-1 | Wednesday 11 March 2026  23:26:27 +0000 (0:00:01.505)       0:00:44.864 *******
2026-03-11 23:26:28.008601 | controller-1 | ok: [controller-2]
2026-03-11 23:26:28.008689 | controller-1 | ok: [controller-1]
2026-03-11 23:26:28.008698 | controller-1 | ok: [controller-3]
2026-03-11 23:26:28.008779 | controller-1 |
2026-03-11 23:26:28.008878 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-11 23:26:28.008975 | controller-1 | Wednesday 11 March 2026  23:26:27 +0000 (0:00:00.838)       0:00:45.703 *******
2026-03-11 23:26:28.009730 | controller-1 |
2026-03-11 23:26:28.009767 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-11 23:26:28.009772 | controller-1 | Wednesday 11 March 2026  23:26:27 +0000 (0:00:00.005)       0:00:45.709 *******
2026-03-11 23:26:28.009776 | controller-1 |
2026-03-11 23:26:28.009779 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-11 23:26:28.009782 | controller-1 | Wednesday 11 March 2026  23:26:27 +0000 (0:00:00.004)       0:00:45.713 *******
2026-03-11 23:26:28.009786 | controller-1 |
2026-03-11 23:26:28.009789 | controller-1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-11 23:26:28.009792 | controller-1 | Wednesday 11 March 2026  23:26:28 +0000 (0:00:00.004)       0:00:45.718 *******
2026-03-11 23:26:28.567369 | controller-1 | ok: [controller-1]
2026-03-11 23:26:28.567432 | controller-1 | ok: [controller-2]
2026-03-11 23:26:28.567490 | controller-1 | ok: [controller-3]
2026-03-11 23:26:28.567608 | controller-1 |
2026-03-11 23:26:28.567839 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-11 23:26:28.567881 | controller-1 | Wednesday 11 March 2026  23:26:28 +0000 (0:00:00.561)       0:00:46.279 *******
2026-03-11 23:26:28.928073 | controller-1 | ok: [controller-1]
2026-03-11 23:26:28.928131 | controller-1 | ok: [controller-3]
2026-03-11 23:26:28.928195 | controller-1 | ok: [controller-2]
2026-03-11 23:26:28.928271 | controller-1 |
2026-03-11 23:26:28.928358 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:26:28.928501 | controller-1 | Wednesday 11 March 2026  23:26:28 +0000 (0:00:00.359)       0:00:46.638 *******
2026-03-11 23:26:29.024402 | controller-1 | ok: [controller-1] => {
2026-03-11 23:26:29.024460 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/crictl-v1.34.0-linux-amd64.tar.gz"
2026-03-11 23:26:29.024472 | controller-1 | }
2026-03-11 23:26:29.024618 | controller-1 | ok: [controller-2] => {
2026-03-11 23:26:29.024721 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/crictl-v1.34.0-linux-amd64.tar.gz"
2026-03-11 23:26:29.024832 | controller-1 | }
2026-03-11 23:26:29.024966 | controller-1 | ok: [controller-3] => {
2026-03-11 23:26:29.025070 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/crictl-v1.34.0-linux-amd64.tar.gz"
2026-03-11 23:26:29.025475 | controller-1 | }
2026-03-11 23:26:29.025486 | controller-1 |
2026-03-11 23:26:29.025490 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:26:29.025495 | controller-1 | Wednesday 11 March 2026  23:26:29 +0000 (0:00:00.097)       0:00:46.736 *******
2026-03-11 23:26:30.044384 | controller-1 | changed: [controller-2]
2026-03-11 23:26:30.044462 | controller-1 | changed: [controller-1]
2026-03-11 23:26:30.044472 | controller-1 | changed: [controller-3]
2026-03-11 23:26:30.044481 | controller-1 |
2026-03-11 23:26:30.045368 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:26:30.045387 | controller-1 | Wednesday 11 March 2026  23:26:30 +0000 (0:00:01.012)       0:00:47.748 *******
2026-03-11 23:26:31.800716 | controller-1 | changed: [controller-1]
2026-03-11 23:26:31.800795 | controller-1 | changed: [controller-2]
2026-03-11 23:26:31.800804 | controller-1 | changed: [controller-3]
2026-03-11 23:26:31.800867 | controller-1 |
2026-03-11 23:26:31.801025 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:26:31.801059 | controller-1 | Wednesday 11 March 2026  23:26:31 +0000 (0:00:01.759)       0:00:49.508 *******
2026-03-11 23:26:31.905217 | controller-1 | ok: [controller-1] => {
2026-03-11 23:26:31.905336 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/critest-v1.34.0-linux-amd64.tar.gz"
2026-03-11 23:26:31.905458 | controller-1 | }
2026-03-11 23:26:31.905581 | controller-1 | ok: [controller-2] => {
2026-03-11 23:26:31.905714 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/critest-v1.34.0-linux-amd64.tar.gz"
2026-03-11 23:26:31.905818 | controller-1 | }
2026-03-11 23:26:31.905934 | controller-1 | ok: [controller-3] => {
2026-03-11 23:26:31.906077 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/critest-v1.34.0-linux-amd64.tar.gz"
2026-03-11 23:26:31.906177 | controller-1 | }
2026-03-11 23:26:31.906284 | controller-1 |
2026-03-11 23:26:31.906573 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:26:31.906610 | controller-1 | Wednesday 11 March 2026  23:26:31 +0000 (0:00:00.108)       0:00:49.617 *******
2026-03-11 23:26:32.804125 | controller-1 | changed: [controller-2]
2026-03-11 23:26:32.804188 | controller-1 | changed: [controller-1]
2026-03-11 23:26:32.804197 | controller-1 | changed: [controller-3]
2026-03-11 23:26:32.804261 | controller-1 |
2026-03-11 23:26:32.804367 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:26:32.804456 | controller-1 | Wednesday 11 March 2026  23:26:32 +0000 (0:00:00.897)       0:00:50.514 *******
2026-03-11 23:26:34.566825 | controller-1 | changed: [controller-2]
2026-03-11 23:26:34.566893 | controller-1 | changed: [controller-1]
2026-03-11 23:26:34.566906 | controller-1 | changed: [controller-3]
2026-03-11 23:26:34.567005 | controller-1 |
2026-03-11 23:26:34.567211 | controller-1 | TASK [vexxhost.containers.cri_tools : Create crictl config] ********************
2026-03-11 23:26:34.567240 | controller-1 | Wednesday 11 March 2026  23:26:34 +0000 (0:00:01.764)       0:00:52.279 *******
2026-03-11 23:26:35.316024 | controller-1 | changed: [controller-2]
2026-03-11 23:26:35.316072 | controller-1 | changed: [controller-1]
2026-03-11 23:26:35.316138 | controller-1 | changed: [controller-3]
2026-03-11 23:26:35.316214 | controller-1 |
2026-03-11 23:26:35.316303 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/opt/cni/bin)] *********
2026-03-11 23:26:35.316542 | controller-1 | Wednesday 11 March 2026  23:26:35 +0000 (0:00:00.746)       0:00:53.025 *******
2026-03-11 23:26:35.669927 | controller-1 | changed: [controller-2]
2026-03-11 23:26:35.669972 | controller-1 | changed: [controller-3]
2026-03-11 23:26:35.671585 | controller-1 | changed: [controller-1]
2026-03-11 23:26:35.671596 | controller-1 |
2026-03-11 23:26:35.671600 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-11 23:26:35.671604 | controller-1 | Wednesday 11 March 2026  23:26:35 +0000 (0:00:00.356)       0:00:53.382 *******
2026-03-11 23:26:36.075472 | controller-1 | ok: [controller-1]
2026-03-11 23:26:36.075563 | controller-1 | ok: [controller-3]
2026-03-11 23:26:36.075903 | controller-1 | ok: [controller-2]
2026-03-11 23:26:36.075933 | controller-1 |
2026-03-11 23:26:36.075938 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:26:36.075942 | controller-1 | Wednesday 11 March 2026  23:26:36 +0000 (0:00:00.405)       0:00:53.787 *******
2026-03-11 23:26:36.172439 | controller-1 | ok: [controller-1] => {
2026-03-11 23:26:36.172773 | controller-1 |     "msg": "https://github.com/containernetworking/plugins/releases/download/v1.8.0/cni-plugins-linux-amd64-v1.8.0.tgz"
2026-03-11 23:26:36.173077 | controller-1 | }
2026-03-11 23:26:36.173324 | controller-1 | ok: [controller-2] => {
2026-03-11 23:26:36.173583 | controller-1 |     "msg": "https://github.com/containernetworking/plugins/releases/download/v1.8.0/cni-plugins-linux-amd64-v1.8.0.tgz"
2026-03-11 23:26:36.173816 | controller-1 | }
2026-03-11 23:26:36.174056 | controller-1 | ok: [controller-3] => {
2026-03-11 23:26:36.174309 | controller-1 |     "msg": "https://github.com/containernetworking/plugins/releases/download/v1.8.0/cni-plugins-linux-amd64-v1.8.0.tgz"
2026-03-11 23:26:36.174541 | controller-1 | }
2026-03-11 23:26:36.174763 | controller-1 |
2026-03-11 23:26:36.175012 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:26:36.175257 | controller-1 | Wednesday 11 March 2026  23:26:36 +0000 (0:00:00.096)       0:00:53.884 *******
2026-03-11 23:26:37.420149 | controller-1 | changed: [controller-1]
2026-03-11 23:26:37.420302 | controller-1 | changed: [controller-3]
2026-03-11 23:26:37.420326 | controller-1 | changed: [controller-2]
2026-03-11 23:26:37.420383 | controller-1 |
2026-03-11 23:26:37.420529 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:26:37.420642 | controller-1 | Wednesday 11 March 2026  23:26:37 +0000 (0:00:01.245)       0:00:55.130 *******
2026-03-11 23:26:40.424162 | controller-1 | changed: [controller-1]
2026-03-11 23:26:40.424214 | controller-1 | changed: [controller-3]
2026-03-11 23:26:40.424288 | controller-1 | changed: [controller-2]
2026-03-11 23:26:40.424378 | controller-1 |
2026-03-11 23:26:40.424463 | controller-1 | TASK [vexxhost.containers.cni_plugins : Gather variables for each operating system] ***
2026-03-11 23:26:40.424550 | controller-1 | Wednesday 11 March 2026  23:26:40 +0000 (0:00:03.006)       0:00:58.136 *******
2026-03-11 23:26:40.506826 | controller-1 | ok: [controller-1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers/roles/cni_plugins/vars/debian.yml)
2026-03-11 23:26:40.506951 | controller-1 | ok: [controller-2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers/roles/cni_plugins/vars/debian.yml)
2026-03-11 23:26:40.507073 | controller-1 | ok: [controller-3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers/roles/cni_plugins/vars/debian.yml)
2026-03-11 23:26:40.507184 | controller-1 |
2026-03-11 23:26:40.507312 | controller-1 | TASK [vexxhost.containers.cni_plugins : Install additional packages] ***********
2026-03-11 23:26:40.507466 | controller-1 | Wednesday 11 March 2026  23:26:40 +0000 (0:00:00.082)       0:00:58.219 *******
2026-03-11 23:26:41.475777 | controller-1 | ok: [controller-1]
2026-03-11 23:26:41.475847 | controller-1 | ok: [controller-3]
2026-03-11 23:26:41.475856 | controller-1 | ok: [controller-2]
2026-03-11 23:26:41.475952 | controller-1 |
2026-03-11 23:26:41.476041 | controller-1 | TASK [vexxhost.containers.cni_plugins : Ensure IPv6 is enabled] ****************
2026-03-11 23:26:41.476117 | controller-1 | Wednesday 11 March 2026  23:26:41 +0000 (0:00:00.966)       0:00:59.185 *******
2026-03-11 23:26:41.952078 | controller-1 | changed: [controller-3]
2026-03-11 23:26:41.952131 | controller-1 | changed: [controller-1]
2026-03-11 23:26:41.952143 | controller-1 | changed: [controller-2]
2026-03-11 23:26:41.952247 | controller-1 |
2026-03-11 23:26:41.952341 | controller-1 | TASK [vexxhost.containers.cni_plugins : Enable kernel modules on-boot] *********
2026-03-11 23:26:41.952428 | controller-1 | Wednesday 11 March 2026  23:26:41 +0000 (0:00:00.478)       0:00:59.664 *******
2026-03-11 23:26:42.672124 | controller-1 | changed: [controller-2]
2026-03-11 23:26:42.672169 | controller-1 | changed: [controller-1]
2026-03-11 23:26:42.672500 | controller-1 | changed: [controller-3]
2026-03-11 23:26:42.672510 | controller-1 |
2026-03-11 23:26:42.672521 | controller-1 | TASK [vexxhost.containers.cni_plugins : Enable kernel modules in runtime] ******
2026-03-11 23:26:42.672525 | controller-1 | Wednesday 11 March 2026  23:26:42 +0000 (0:00:00.720)       0:01:00.384 *******
2026-03-11 23:26:44.204041 | controller-1 | changed: [controller-3] => (item=br_netfilter)
2026-03-11 23:26:44.204100 | controller-1 | changed: [controller-1] => (item=br_netfilter)
2026-03-11 23:26:44.204145 | controller-1 | changed: [controller-2] => (item=br_netfilter)
2026-03-11 23:26:44.204252 | controller-1 | ok: [controller-3] => (item=ip_tables)
2026-03-11 23:26:44.204337 | controller-1 | ok: [controller-2] => (item=ip_tables)
2026-03-11 23:26:44.204425 | controller-1 | ok: [controller-1] => (item=ip_tables)
2026-03-11 23:26:44.204505 | controller-1 | changed: [controller-3] => (item=ip6_tables)
2026-03-11 23:26:44.204604 | controller-1 | changed: [controller-2] => (item=ip6_tables)
2026-03-11 23:26:44.204683 | controller-1 | changed: [controller-1] => (item=ip6_tables)
2026-03-11 23:26:44.204771 | controller-1 | changed: [controller-3] => (item=nf_conntrack)
2026-03-11 23:26:44.204857 | controller-1 | changed: [controller-2] => (item=nf_conntrack)
2026-03-11 23:26:44.204945 | controller-1 | changed: [controller-1] => (item=nf_conntrack)
2026-03-11 23:26:44.205052 | controller-1 |
2026-03-11 23:26:44.205133 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-11 23:26:44.205220 | controller-1 | Wednesday 11 March 2026  23:26:44 +0000 (0:00:01.528)       0:01:01.913 *******
2026-03-11 23:26:44.539545 | controller-1 | ok: [controller-1]
2026-03-11 23:26:44.539572 | controller-1 | ok: [controller-2]
2026-03-11 23:26:44.539577 | controller-1 | ok: [controller-3]
2026-03-11 23:26:44.539582 | controller-1 |
2026-03-11 23:26:44.539586 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:26:44.539590 | controller-1 | Wednesday 11 March 2026  23:26:44 +0000 (0:00:00.338)       0:01:02.251 *******
2026-03-11 23:26:44.625722 | controller-1 | ok: [controller-1] => {
2026-03-11 23:26:44.625818 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubelet"
2026-03-11 23:26:44.625905 | controller-1 | }
2026-03-11 23:26:44.625994 | controller-1 | ok: [controller-2] => {
2026-03-11 23:26:44.626083 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubelet"
2026-03-11 23:26:44.626158 | controller-1 | }
2026-03-11 23:26:44.626243 | controller-1 | ok: [controller-3] => {
2026-03-11 23:26:44.626330 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubelet"
2026-03-11 23:26:44.626410 | controller-1 | }
2026-03-11 23:26:44.626488 | controller-1 |
2026-03-11 23:26:44.626578 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:26:44.626666 | controller-1 | Wednesday 11 March 2026  23:26:44 +0000 (0:00:00.086)       0:01:02.337 *******
2026-03-11 23:26:46.271954 | controller-1 | changed: [controller-3]
2026-03-11 23:26:46.272006 | controller-1 | changed: [controller-2]
2026-03-11 23:26:46.275632 | controller-1 | changed: [controller-1]
2026-03-11 23:26:46.275681 | controller-1 |
2026-03-11 23:26:46.275691 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:26:46.275699 | controller-1 | Wednesday 11 March 2026  23:26:46 +0000 (0:00:01.643)       0:01:03.981 *******
2026-03-11 23:26:46.302449 | controller-1 | skipping: [controller-1]
2026-03-11 23:26:46.353123 | controller-1 | skipping: [controller-2]
2026-03-11 23:26:46.354093 | controller-1 | skipping: [controller-3]
2026-03-11 23:26:46.354291 | controller-1 |
2026-03-11 23:26:46.354509 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Gather variables for each operating system] ***
2026-03-11 23:26:46.354704 | controller-1 | Wednesday 11 March 2026  23:26:46 +0000 (0:00:00.084)       0:01:04.065 *******
2026-03-11 23:26:46.447976 | controller-1 | ok: [controller-1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/vars/debian.yml)
2026-03-11 23:26:46.448221 | controller-1 | ok: [controller-2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/vars/debian.yml)
2026-03-11 23:26:46.448442 | controller-1 | ok: [controller-3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/vars/debian.yml)
2026-03-11 23:26:46.448577 | controller-1 |
2026-03-11 23:26:46.448836 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Install coreutils] *************************
2026-03-11 23:26:46.448976 | controller-1 | Wednesday 11 March 2026  23:26:46 +0000 (0:00:00.094)       0:01:04.159 *******
2026-03-11 23:26:46.491583 | controller-1 | skipping: [controller-1]
2026-03-11 23:26:46.522000 | controller-1 | skipping: [controller-2]
2026-03-11 23:26:46.522209 | controller-1 | skipping: [controller-3]
2026-03-11 23:26:46.522387 | controller-1 |
2026-03-11 23:26:46.522591 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Install additional packages] ***************
2026-03-11 23:26:46.522786 | controller-1 | Wednesday 11 March 2026  23:26:46 +0000 (0:00:00.074)       0:01:04.234 *******
2026-03-11 23:26:49.404770 | controller-1 | changed: [controller-1]
2026-03-11 23:26:49.404899 | controller-1 | changed: [controller-3]
2026-03-11 23:26:49.405092 | controller-1 | changed: [controller-2]
2026-03-11 23:26:49.405261 | controller-1 |
2026-03-11 23:26:49.405465 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Configure sysctl values] *******************
2026-03-11 23:26:49.405659 | controller-1 | Wednesday 11 March 2026  23:26:49 +0000 (0:00:02.882)       0:01:07.116 *******
2026-03-11 23:26:51.623323 | controller-1 | changed: [controller-1] => (item={'name': 'net.ipv4.ip_forward', 'value': 1})
2026-03-11 23:26:51.623388 | controller-1 | changed: [controller-2] => (item={'name': 'net.ipv4.ip_forward', 'value': 1})
2026-03-11 23:26:51.623484 | controller-1 | changed: [controller-3] => (item={'name': 'net.ipv4.ip_forward', 'value': 1})
2026-03-11 23:26:51.625431 | controller-1 | changed: [controller-1] => (item={'name': 'net.bridge.bridge-nf-call-iptables', 'value': 1})
2026-03-11 23:26:51.625457 | controller-1 | changed: [controller-2] => (item={'name': 'net.bridge.bridge-nf-call-iptables', 'value': 1})
2026-03-11 23:26:51.625461 | controller-1 | changed: [controller-3] => (item={'name': 'net.bridge.bridge-nf-call-iptables', 'value': 1})
2026-03-11 23:26:51.625465 | controller-1 | changed: [controller-1] => (item={'name': 'net.bridge.bridge-nf-call-ip6tables', 'value': 1})
2026-03-11 23:26:51.625468 | controller-1 | changed: [controller-2] => (item={'name': 'net.bridge.bridge-nf-call-ip6tables', 'value': 1})
2026-03-11 23:26:51.625472 | controller-1 | changed: [controller-3] => (item={'name': 'net.bridge.bridge-nf-call-ip6tables', 'value': 1})
2026-03-11 23:26:51.625475 | controller-1 | changed: [controller-1] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 0})
2026-03-11 23:26:51.625478 | controller-1 | changed: [controller-2] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 0})
2026-03-11 23:26:51.625489 | controller-1 | changed: [controller-3] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 0})
2026-03-11 23:26:51.625493 | controller-1 | changed: [controller-2] => (item={'name': 'fs.inotify.max_queued_events', 'value': 1048576})
2026-03-11 23:26:51.625496 | controller-1 | changed: [controller-1] => (item={'name': 'fs.inotify.max_queued_events', 'value': 1048576})
2026-03-11 23:26:51.625499 | controller-1 | changed: [controller-3] => (item={'name': 'fs.inotify.max_queued_events', 'value': 1048576})
2026-03-11 23:26:51.625503 | controller-1 | changed: [controller-2] => (item={'name': 'fs.inotify.max_user_instances', 'value': 8192})
2026-03-11 23:26:51.625506 | controller-1 | changed: [controller-1] => (item={'name': 'fs.inotify.max_user_instances', 'value': 8192})
2026-03-11 23:26:51.625509 | controller-1 | changed: [controller-3] => (item={'name': 'fs.inotify.max_user_instances', 'value': 8192})
2026-03-11 23:26:51.625512 | controller-1 | changed: [controller-2] => (item={'name': 'fs.inotify.max_user_watches', 'value': 1048576})
2026-03-11 23:26:51.625516 | controller-1 | changed: [controller-3] => (item={'name': 'fs.inotify.max_user_watches', 'value': 1048576})
2026-03-11 23:26:51.625519 | controller-1 | changed: [controller-1] => (item={'name': 'fs.inotify.max_user_watches', 'value': 1048576})
2026-03-11 23:26:51.625523 | controller-1 |
2026-03-11 23:26:51.625526 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Create folders for kubernetes configuration] ***
2026-03-11 23:26:51.625530 | controller-1 | Wednesday 11 March 2026  23:26:51 +0000 (0:00:02.218)       0:01:09.335 *******
2026-03-11 23:26:52.496186 | controller-1 | changed: [controller-1] => (item=/etc/systemd/system/kubelet.service.d)
2026-03-11 23:26:52.496238 | controller-1 | changed: [controller-2] => (item=/etc/systemd/system/kubelet.service.d)
2026-03-11 23:26:52.496324 | controller-1 | changed: [controller-3] => (item=/etc/systemd/system/kubelet.service.d)
2026-03-11 23:26:52.496415 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes)
2026-03-11 23:26:52.496502 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes)
2026-03-11 23:26:52.496592 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes)
2026-03-11 23:26:52.496684 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes/manifests)
2026-03-11 23:26:52.496772 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes/manifests)
2026-03-11 23:26:52.496860 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes/manifests)
2026-03-11 23:26:52.496943 | controller-1 |
2026-03-11 23:26:52.497034 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Add kubelet systemd service config] ********
2026-03-11 23:26:52.497123 | controller-1 | Wednesday 11 March 2026  23:26:52 +0000 (0:00:00.869)       0:01:10.205 *******
2026-03-11 23:26:53.229776 | controller-1 | changed: [controller-1]
2026-03-11 23:26:53.229802 | controller-1 | changed: [controller-2]
2026-03-11 23:26:53.229806 | controller-1 | changed: [controller-3]
2026-03-11 23:26:53.229810 | controller-1 |
2026-03-11 23:26:53.229813 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Add kubeadm dropin for kubelet systemd service config] ***
2026-03-11 23:26:53.229817 | controller-1 | Wednesday 11 March 2026  23:26:53 +0000 (0:00:00.736)       0:01:10.941 *******
2026-03-11 23:26:53.970636 | controller-1 | changed: [controller-1]
2026-03-11 23:26:53.970686 | controller-1 | changed: [controller-2]
2026-03-11 23:26:53.970783 | controller-1 | changed: [controller-3]
2026-03-11 23:26:53.970869 | controller-1 |
2026-03-11 23:26:53.971070 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Check swap status] *************************
2026-03-11 23:26:53.971099 | controller-1 | Wednesday 11 March 2026  23:26:53 +0000 (0:00:00.741)       0:01:11.682 *******
2026-03-11 23:26:54.395695 | controller-1 | ok: [controller-2]
2026-03-11 23:26:54.395732 | controller-1 | ok: [controller-3]
2026-03-11 23:26:54.395741 | controller-1 | ok: [controller-1]
2026-03-11 23:26:54.395749 | controller-1 |
2026-03-11 23:26:54.395757 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Disable swap] ******************************
2026-03-11 23:26:54.395765 | controller-1 | Wednesday 11 March 2026  23:26:54 +0000 (0:00:00.424)       0:01:12.107 *******
2026-03-11 23:26:54.443587 | controller-1 | [ERROR]: Task failed: Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result.
2026-03-11 23:26:54.445352 | controller-1 |
2026-03-11 23:26:54.445390 | controller-1 | Task failed.
2026-03-11 23:26:54.445397 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:78:7
2026-03-11 23:26:54.445400 | controller-1 |
2026-03-11 23:26:54.445405 | controller-1 | 76       register: kubelet_swapon
2026-03-11 23:26:54.445409 | controller-1 | 77
2026-03-11 23:26:54.445413 | controller-1 | 78     - name: Disable swap
2026-03-11 23:26:54.445417 | controller-1 |          ^ column 7
2026-03-11 23:26:54.445420 | controller-1 |
2026-03-11 23:26:54.445424 | controller-1 | <<< caused by >>>
2026-03-11 23:26:54.445427 | controller-1 |
2026-03-11 23:26:54.445431 | controller-1 | Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result.
2026-03-11 23:26:54.445435 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11
2026-03-11 23:26:54.445439 | controller-1 |
2026-03-11 23:26:54.445442 | controller-1 | 81       ignore_errors: "{{ ansible_check_mode }}"
2026-03-11 23:26:54.445446 | controller-1 | 82       when:
2026-03-11 23:26:54.445449 | controller-1 | 83         - kubelet_swapon.stdout
2026-03-11 23:26:54.445453 | controller-1 |              ^ column 11
2026-03-11 23:26:54.445457 | controller-1 |
2026-03-11 23:26:54.445461 | controller-1 | Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option.
2026-03-11 23:26:54.445464 | controller-1 |
2026-03-11 23:26:54.447380 | controller-1 | fatal: [controller-1]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result."}
2026-03-11 23:26:54.447560 | controller-1 | fatal: [controller-2]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result."}
2026-03-11 23:26:54.460118 | controller-1 | fatal: [controller-3]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result."}
2026-03-11 23:26:54.471983 | controller-1 | ...ignoring
2026-03-11 23:26:54.472070 | controller-1 | ...ignoring
2026-03-11 23:26:54.472158 | controller-1 | ...ignoring
2026-03-11 23:26:54.472241 | controller-1 |
2026-03-11 23:26:54.472453 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Remove swapfile from /etc/fstab] ***********
2026-03-11 23:26:54.472483 | controller-1 | Wednesday 11 March 2026  23:26:54 +0000 (0:00:00.073)       0:01:12.181 *******
2026-03-11 23:26:55.223158 | controller-1 | ok: [controller-2] => (item=swap)
2026-03-11 23:26:55.223234 | controller-1 | ok: [controller-1] => (item=swap)
2026-03-11 23:26:55.223243 | controller-1 | ok: [controller-3] => (item=swap)
2026-03-11 23:26:55.223346 | controller-1 | ok: [controller-2] => (item=none)
2026-03-11 23:26:55.223435 | controller-1 | ok: [controller-1] => (item=none)
2026-03-11 23:26:55.223527 | controller-1 | ok: [controller-3] => (item=none)
2026-03-11 23:26:55.223849 | controller-1 |
2026-03-11 23:26:55.223885 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Create noswap systemd service config file] ***
2026-03-11 23:26:55.223891 | controller-1 | Wednesday 11 March 2026  23:26:55 +0000 (0:00:00.754)       0:01:12.935 *******
2026-03-11 23:26:55.936137 | controller-1 | changed: [controller-1]
2026-03-11 23:26:55.936190 | controller-1 | changed: [controller-2]
2026-03-11 23:26:55.936256 | controller-1 | changed: [controller-3]
2026-03-11 23:26:55.936361 | controller-1 |
2026-03-11 23:26:55.936445 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Enable noswap service] *********************
2026-03-11 23:26:55.936536 | controller-1 | Wednesday 11 March 2026  23:26:55 +0000 (0:00:00.710)       0:01:13.645 *******
2026-03-11 23:26:56.693207 | controller-1 | changed: [controller-1]
2026-03-11 23:26:56.693251 | controller-1 | changed: [controller-2]
2026-03-11 23:26:56.693337 | controller-1 | changed: [controller-3]
2026-03-11 23:26:56.693416 | controller-1 |
2026-03-11 23:26:56.693508 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Force any restarts if necessary] ***********
2026-03-11 23:26:56.693599 | controller-1 | Wednesday 11 March 2026  23:26:56 +0000 (0:00:00.744)       0:01:14.390 *******
2026-03-11 23:26:56.693671 | controller-1 |
2026-03-11 23:26:56.693763 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Force any restarts if necessary] ***********
2026-03-11 23:26:56.693850 | controller-1 | Wednesday 11 March 2026  23:26:56 +0000 (0:00:00.006)       0:01:14.396 *******
2026-03-11 23:26:56.694347 | controller-1 |
2026-03-11 23:26:56.694357 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Force any restarts if necessary] ***********
2026-03-11 23:26:56.694361 | controller-1 | Wednesday 11 March 2026  23:26:56 +0000 (0:00:00.004)       0:01:14.401 *******
2026-03-11 23:26:56.694365 | controller-1 |
2026-03-11 23:26:56.694368 | controller-1 | RUNNING HANDLER [vexxhost.kubernetes.kubelet : Reload systemd] *****************
2026-03-11 23:26:56.694371 | controller-1 | Wednesday 11 March 2026  23:26:56 +0000 (0:00:00.004)       0:01:14.405 *******
2026-03-11 23:26:58.235682 | controller-1 | ok: [controller-1]
2026-03-11 23:26:58.235726 | controller-1 | ok: [controller-2]
2026-03-11 23:26:58.235839 | controller-1 | ok: [controller-3]
2026-03-11 23:26:58.235917 | controller-1 |
2026-03-11 23:26:58.236090 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Enable and start kubelet service] **********
2026-03-11 23:26:58.236101 | controller-1 | Wednesday 11 March 2026  23:26:58 +0000 (0:00:01.539)       0:01:15.945 *******
2026-03-11 23:26:59.040082 | controller-1 | changed: [controller-1]
2026-03-11 23:26:59.040144 | controller-1 | changed: [controller-2]
2026-03-11 23:26:59.040213 | controller-1 | changed: [controller-3]
2026-03-11 23:26:59.040491 | controller-1 |
2026-03-11 23:26:59.040519 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Ensure availability of dbus on Debian] *****
2026-03-11 23:26:59.040524 | controller-1 | Wednesday 11 March 2026  23:26:59 +0000 (0:00:00.805)       0:01:16.750 *******
2026-03-11 23:26:59.972085 | controller-1 | ok: [controller-2]
2026-03-11 23:26:59.972152 | controller-1 | ok: [controller-1]
2026-03-11 23:26:59.972212 | controller-1 | ok: [controller-3]
2026-03-11 23:26:59.973277 | controller-1 |
2026-03-11 23:26:59.973373 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Configure short hostname] ******************
2026-03-11 23:26:59.973383 | controller-1 | Wednesday 11 March 2026  23:26:59 +0000 (0:00:00.930)       0:01:17.681 *******
2026-03-11 23:27:00.868105 | controller-1 | changed: [controller-1]
2026-03-11 23:27:00.868190 | controller-1 | changed: [controller-3]
2026-03-11 23:27:00.868199 | controller-1 | changed: [controller-2]
2026-03-11 23:27:00.868249 | controller-1 |
2026-03-11 23:27:00.868366 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Ensure hostname inside hosts file] *********
2026-03-11 23:27:00.868455 | controller-1 | Wednesday 11 March 2026  23:27:00 +0000 (0:00:00.899)       0:01:18.580 *******
2026-03-11 23:27:01.298566 | controller-1 | changed: [controller-2]
2026-03-11 23:27:01.298645 | controller-1 | changed: [controller-3]
2026-03-11 23:27:01.298654 | controller-1 | changed: [controller-1]
2026-03-11 23:27:01.298741 | controller-1 |
2026-03-11 23:27:01.298832 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Remove kubernetes repository] ***********
2026-03-11 23:27:01.298924 | controller-1 | Wednesday 11 March 2026  23:27:01 +0000 (0:00:00.430)       0:01:19.010 *******
2026-03-11 23:27:01.978989 | controller-1 | ok: [controller-1]
2026-03-11 23:27:01.979057 | controller-1 | ok: [controller-3]
2026-03-11 23:27:01.979067 | controller-1 | ok: [controller-2]
2026-03-11 23:27:01.979169 | controller-1 |
2026-03-11 23:27:01.979264 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Setup control plane] ********************
2026-03-11 23:27:01.979348 | controller-1 | Wednesday 11 March 2026  23:27:01 +0000 (0:00:00.680)       0:01:19.691 *******
2026-03-11 23:27:02.108118 | controller-1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes/tasks/control-plane.yml for controller-1, controller-2, controller-3
2026-03-11 23:27:02.108205 | controller-1 |
2026-03-11 23:27:02.108215 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Bootstrap cluster] **********************
2026-03-11 23:27:02.108287 | controller-1 | Wednesday 11 March 2026  23:27:02 +0000 (0:00:00.126)       0:01:19.817 *******
2026-03-11 23:27:02.232047 | controller-1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes/tasks/bootstrap-cluster.yml for controller-1, controller-2, controller-3
2026-03-11 23:27:02.232113 | controller-1 |
2026-03-11 23:27:02.232152 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Check if any control plane is bootstrapped] ***
2026-03-11 23:27:02.232255 | controller-1 | Wednesday 11 March 2026  23:27:02 +0000 (0:00:00.126)       0:01:19.944 *******
2026-03-11 23:27:03.118809 | controller-1 | ok: [controller-1] => (item=controller-1)
2026-03-11 23:27:03.118970 | controller-1 | ok: [controller-2 -> controller-1(199.204.45.3)] => (item=controller-1)
2026-03-11 23:27:03.119164 | controller-1 | ok: [controller-3 -> controller-1(199.204.45.3)] => (item=controller-1)
2026-03-11 23:27:03.119356 | controller-1 | ok: [controller-3 -> controller-2(162.253.55.195)] => (item=controller-2)
2026-03-11 23:27:03.119603 | controller-1 | ok: [controller-2] => (item=controller-2)
2026-03-11 23:27:03.119799 | controller-1 | ok: [controller-1 -> controller-2(162.253.55.195)] => (item=controller-2)
2026-03-11 23:27:03.119972 | controller-1 | ok: [controller-3] => (item=controller-3)
2026-03-11 23:27:03.120162 | controller-1 | ok: [controller-2 -> controller-3(199.204.45.242)] => (item=controller-3)
2026-03-11 23:27:03.120354 | controller-1 | ok: [controller-1 -> controller-3(199.204.45.242)] => (item=controller-3)
2026-03-11 23:27:03.120533 | controller-1 |
2026-03-11 23:27:03.120731 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Pick node from pre-existing cluster] ****
2026-03-11 23:27:03.120927 | controller-1 | Wednesday 11 March 2026  23:27:03 +0000 (0:00:00.886)       0:01:20.830 *******
2026-03-11 23:27:03.183064 | controller-1 | skipping: [controller-1]
2026-03-11 23:27:03.183275 | controller-1 | skipping: [controller-2]
2026-03-11 23:27:03.183482 | controller-1 | skipping: [controller-3]
2026-03-11 23:27:03.183868 | controller-1 |
2026-03-11 23:27:03.184097 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Select first node to initialize cluster] ***
2026-03-11 23:27:03.184303 | controller-1 | Wednesday 11 March 2026  23:27:03 +0000 (0:00:00.064)       0:01:20.895 *******
2026-03-11 23:27:03.262266 | controller-1 | ok: [controller-1]
2026-03-11 23:27:03.262417 | controller-1 | ok: [controller-2]
2026-03-11 23:27:03.262689 | controller-1 | ok: [controller-3]
2026-03-11 23:27:03.262802 | controller-1 |
2026-03-11 23:27:03.263054 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Print selected bootstrap node] **********
2026-03-11 23:27:03.263188 | controller-1 | Wednesday 11 March 2026  23:27:03 +0000 (0:00:00.078)       0:01:20.974 *******
2026-03-11 23:27:03.328010 | controller-1 | ok: [controller-1] => {
2026-03-11 23:27:03.328167 | controller-1 |     "msg": "controller-1"
2026-03-11 23:27:03.328418 | controller-1 | }
2026-03-11 23:27:03.328568 | controller-1 | ok: [controller-2] => {
2026-03-11 23:27:03.328814 | controller-1 |     "msg": "controller-1"
2026-03-11 23:27:03.328940 | controller-1 | }
2026-03-11 23:27:03.329197 | controller-1 | ok: [controller-3] => {
2026-03-11 23:27:03.329330 | controller-1 |     "msg": "controller-1"
2026-03-11 23:27:03.329508 | controller-1 | }
2026-03-11 23:27:03.329680 | controller-1 |
2026-03-11 23:27:03.329901 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Upload cluster configuration for bootstrap node] ***
2026-03-11 23:27:03.330145 | controller-1 | Wednesday 11 March 2026  23:27:03 +0000 (0:00:00.065)       0:01:21.040 *******
2026-03-11 23:27:04.011778 | controller-1 | skipping: [controller-2]
2026-03-11 23:27:04.011949 | controller-1 | skipping: [controller-3]
2026-03-11 23:27:04.012147 | controller-1 | changed: [controller-1]
2026-03-11 23:27:04.012391 | controller-1 |
2026-03-11 23:27:04.012609 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create pki folder] **********************
2026-03-11 23:27:04.012785 | controller-1 | Wednesday 11 March 2026  23:27:04 +0000 (0:00:00.683)       0:01:21.723 *******
2026-03-11 23:27:04.086459 | controller-1 | skipping: [controller-1]
2026-03-11 23:27:04.086648 | controller-1 | skipping: [controller-2]
2026-03-11 23:27:04.086854 | controller-1 | skipping: [controller-3]
2026-03-11 23:27:04.087025 | controller-1 |
2026-03-11 23:27:04.087228 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create kubernetes ca key] ***************
2026-03-11 23:27:04.087431 | controller-1 | Wednesday 11 March 2026  23:27:04 +0000 (0:00:00.074)       0:01:21.798 *******
2026-03-11 23:27:04.163236 | controller-1 | skipping: [controller-1]
2026-03-11 23:27:04.163264 | controller-1 | skipping: [controller-2]
2026-03-11 23:27:04.163273 | controller-1 | skipping: [controller-3]
2026-03-11 23:27:04.163281 | controller-1 |
2026-03-11 23:27:04.163289 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create kubernetes ca cert] **************
2026-03-11 23:27:04.163297 | controller-1 | Wednesday 11 March 2026  23:27:04 +0000 (0:00:00.075)       0:01:21.874 *******
2026-03-11 23:27:04.236150 | controller-1 | skipping: [controller-1]
2026-03-11 23:27:04.236180 | controller-1 | skipping: [controller-2]
2026-03-11 23:27:04.236267 | controller-1 | skipping: [controller-3]
2026-03-11 23:27:04.236355 | controller-1 |
2026-03-11 23:27:04.236445 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create etcd-ca key] *********************
2026-03-11 23:27:04.236532 | controller-1 | Wednesday 11 March 2026  23:27:04 +0000 (0:00:00.071)       0:01:21.946 *******
2026-03-11 23:27:04.306461 | controller-1 | skipping: [controller-1]
2026-03-11 23:27:04.306491 | controller-1 | skipping: [controller-2]
2026-03-11 23:27:04.306554 | controller-1 | skipping: [controller-3]
2026-03-11 23:27:04.306654 | controller-1 |
2026-03-11 23:27:04.306747 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create etcd-ca cert] ********************
2026-03-11 23:27:04.306837 | controller-1 | Wednesday 11 March 2026  23:27:04 +0000 (0:00:00.072)       0:01:22.018 *******
2026-03-11 23:27:04.378610 | controller-1 | skipping: [controller-1]
2026-03-11 23:27:04.378656 | controller-1 | skipping: [controller-2]
2026-03-11 23:27:04.378737 | controller-1 | skipping: [controller-3]
2026-03-11 23:27:04.378819 | controller-1 |
2026-03-11 23:27:04.378918 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create front-proxy-ca key] **************
2026-03-11 23:27:04.379023 | controller-1 | Wednesday 11 March 2026  23:27:04 +0000 (0:00:00.071)       0:01:22.090 *******
2026-03-11 23:27:04.456182 | controller-1 | skipping: [controller-1]
2026-03-11 23:27:04.456213 | controller-1 | skipping: [controller-2]
2026-03-11 23:27:04.456283 | controller-1 | skipping: [controller-3]
2026-03-11 23:27:04.456388 | controller-1 |
2026-03-11 23:27:04.456476 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create front-proxy-ca cert] *************
2026-03-11 23:27:04.456566 | controller-1 | Wednesday 11 March 2026  23:27:04 +0000 (0:00:00.073)       0:01:22.164 *******
2026-03-11 23:27:04.526226 | controller-1 | skipping: [controller-1]
2026-03-11 23:27:04.526256 | controller-1 | skipping: [controller-2]
2026-03-11 23:27:04.526351 | controller-1 | skipping: [controller-3]
2026-03-11 23:27:04.526448 | controller-1 |
2026-03-11 23:27:04.526521 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Initialize cluster] *********************
2026-03-11 23:27:04.526658 | controller-1 | Wednesday 11 March 2026  23:27:04 +0000 (0:00:00.073)       0:01:22.237 *******
2026-03-11 23:27:38.837664 | controller-1 | changed: [controller-1]
2026-03-11 23:27:38.871654 | controller-1 | skipping: [controller-2]
2026-03-11 23:27:38.871775 | controller-1 | skipping: [controller-3]
2026-03-11 23:27:38.871886 | controller-1 |
2026-03-11 23:27:38.872021 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Check if the node is already part of the cluster] ***
2026-03-11 23:27:38.872164 | controller-1 | Wednesday 11 March 2026  23:27:38 +0000 (0:00:34.344)       0:01:56.582 *******
2026-03-11 23:27:39.203508 | controller-1 | ok: [controller-1]
2026-03-11 23:27:39.203585 | controller-1 | ok: [controller-2]
2026-03-11 23:27:39.203938 | controller-1 | ok: [controller-3]
2026-03-11 23:27:39.203978 | controller-1 |
2026-03-11 23:27:39.203982 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Join cluster] ***************************
2026-03-11 23:27:39.203987 | controller-1 | Wednesday 11 March 2026  23:27:39 +0000 (0:00:00.333)       0:01:56.915 *******
2026-03-11 23:27:39.323804 | controller-1 | skipping: [controller-1]
2026-03-11 23:27:39.323873 | controller-1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes/tasks/join-cluster.yml for controller-2, controller-3
2026-03-11 23:27:39.323888 | controller-1 |
2026-03-11 23:27:39.324001 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Generate control-plane certificates for joining cluster] ***
2026-03-11 23:27:39.324088 | controller-1 | Wednesday 11 March 2026  23:27:39 +0000 (0:00:00.116)       0:01:57.032 *******
2026-03-11 23:27:39.784092 | controller-1 | ok: [controller-2 -> controller-1(199.204.45.3)]
2026-03-11 23:27:39.784118 | controller-1 |
2026-03-11 23:27:39.784124 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Retrieve SHA256 certificate hash] *******
2026-03-11 23:27:39.784129 | controller-1 | Wednesday 11 March 2026  23:27:39 +0000 (0:00:00.463)       0:01:57.496 *******
2026-03-11 23:27:40.310364 | controller-1 | ok: [controller-2 -> controller-1(199.204.45.3)]
2026-03-11 23:27:40.310415 | controller-1 |
2026-03-11 23:27:40.310501 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Generate token for joining cluster] *****
2026-03-11 23:27:40.310588 | controller-1 | Wednesday 11 March 2026  23:27:40 +0000 (0:00:00.526)       0:01:58.022 *******
2026-03-11 23:27:40.691889 | controller-1 | changed: [controller-2 -> controller-1(199.204.45.3)]
2026-03-11 23:27:40.691931 | controller-1 |
2026-03-11 23:27:40.692027 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Upload kubeadm configuration] ***********
2026-03-11 23:27:40.692112 | controller-1 | Wednesday 11 March 2026  23:27:40 +0000 (0:00:00.378)       0:01:58.401 *******
2026-03-11 23:27:41.428244 | controller-1 | changed: [controller-2]
2026-03-11 23:27:41.428300 | controller-1 | changed: [controller-3]
2026-03-11 23:27:41.428310 | controller-1 |
2026-03-11 23:27:41.428523 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Join cluster] ***************************
2026-03-11 23:27:41.428546 | controller-1 | Wednesday 11 March 2026  23:27:41 +0000 (0:00:00.738)       0:01:59.140 *******
2026-03-11 23:28:59.095347 | controller-1 | changed: [controller-2]
2026-03-11 23:28:59.095400 | controller-1 | changed: [controller-3]
2026-03-11 23:28:59.095413 | controller-1 |
2026-03-11 23:28:59.095564 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create folder for admin configuration] ***
2026-03-11 23:28:59.095656 | controller-1 | Wednesday 11 March 2026  23:28:59 +0000 (0:01:17.664)       0:03:16.805 *******
2026-03-11 23:28:59.580042 | controller-1 | changed: [controller-3]
2026-03-11 23:28:59.580123 | controller-1 | changed: [controller-2]
2026-03-11 23:28:59.580202 | controller-1 | changed: [controller-1]
2026-03-11 23:28:59.580311 | controller-1 |
2026-03-11 23:28:59.580483 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Creating a symlink for admin configuration file] ***
2026-03-11 23:28:59.583440 | controller-1 | Wednesday 11 March 2026  23:28:59 +0000 (0:00:00.485)       0:03:17.290 *******
2026-03-11 23:28:59.932193 | controller-1 | changed: [controller-1]
2026-03-11 23:28:59.932374 | controller-1 | changed: [controller-2]
2026-03-11 23:28:59.932548 | controller-1 | changed: [controller-3]
2026-03-11 23:28:59.932712 | controller-1 |
2026-03-11 23:28:59.932903 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Add bash autocomplete for kubectl] ******
2026-03-11 23:28:59.933099 | controller-1 | Wednesday 11 March 2026  23:28:59 +0000 (0:00:00.352)       0:03:17.643 *******
2026-03-11 23:29:00.283221 | controller-1 | changed: [controller-1]
2026-03-11 23:29:00.283288 | controller-1 | changed: [controller-2]
2026-03-11 23:29:00.283476 | controller-1 | changed: [controller-3]
2026-03-11 23:29:00.283629 | controller-1 |
2026-03-11 23:29:00.283752 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Install PIP] ****************************
2026-03-11 23:29:00.283871 | controller-1 | Wednesday 11 March 2026  23:29:00 +0000 (0:00:00.350)       0:03:17.993 *******
2026-03-11 23:29:00.380598 | controller-1 | skipping: [controller-1]
2026-03-11 23:29:00.380727 | controller-1 | skipping: [controller-2]
2026-03-11 23:29:00.380907 | controller-1 | skipping: [controller-3]
2026-03-11 23:29:00.381078 | controller-1 |
2026-03-11 23:29:00.381285 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Install Kubernetes Python package using pip on supported systems] ***
2026-03-11 23:29:00.381475 | controller-1 | Wednesday 11 March 2026  23:29:00 +0000 (0:00:00.098)       0:03:18.092 *******
2026-03-11 23:29:00.458114 | controller-1 | skipping: [controller-1]
2026-03-11 23:29:00.458216 | controller-1 | skipping: [controller-2]
2026-03-11 23:29:00.458335 | controller-1 | skipping: [controller-3]
2026-03-11 23:29:00.458449 | controller-1 |
2026-03-11 23:29:00.458569 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Enable EPEL repository] *****************
2026-03-11 23:29:00.458684 | controller-1 | Wednesday 11 March 2026  23:29:00 +0000 (0:00:00.077)       0:03:18.169 *******
2026-03-11 23:29:00.540924 | controller-1 | skipping: [controller-1]
2026-03-11 23:29:00.541109 | controller-1 | skipping: [controller-2]
2026-03-11 23:29:00.541293 | controller-1 | skipping: [controller-3]
2026-03-11 23:29:00.541504 | controller-1 |
2026-03-11 23:29:00.541718 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Install Kubernetes Python package using package manager on supported systems] ***
2026-03-11 23:29:00.541911 | controller-1 | Wednesday 11 March 2026  23:29:00 +0000 (0:00:00.083)       0:03:18.252 *******
2026-03-11 23:29:11.151421 | controller-1 | changed: [controller-1]
2026-03-11 23:29:11.151574 | controller-1 | changed: [controller-2]
2026-03-11 23:29:11.151862 | controller-1 | changed: [controller-3]
2026-03-11 23:29:11.151988 | controller-1 |
2026-03-11 23:29:11.152227 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Allow workload on control plane node] ***
2026-03-11 23:29:11.152367 | controller-1 | Wednesday 11 March 2026  23:29:11 +0000 (0:00:10.610)       0:03:28.863 *******
2026-03-11 23:29:12.146989 | controller-1 | changed: [controller-1]
2026-03-11 23:29:12.147086 | controller-1 | changed: [controller-3]
2026-03-11 23:29:12.147098 | controller-1 | changed: [controller-2]
2026-03-11 23:29:12.147182 | controller-1 |
2026-03-11 23:29:12.147283 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Remove kube-proxy resources] ************
2026-03-11 23:29:12.147386 | controller-1 | Wednesday 11 March 2026  23:29:12 +0000 (0:00:00.996)       0:03:29.859 *******
2026-03-11 23:29:12.199654 | controller-1 | skipping: [controller-1] => (item=DaemonSet)
2026-03-11 23:29:12.199718 | controller-1 | skipping: [controller-1] => (item=ConfigMap)
2026-03-11 23:29:12.199839 | controller-1 | skipping: [controller-1]
2026-03-11 23:29:12.199955 | controller-1 |
2026-03-11 23:29:12.200104 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Start an upgrade] ***********************
2026-03-11 23:29:12.200244 | controller-1 | Wednesday 11 March 2026  23:29:12 +0000 (0:00:00.052)       0:03:29.911 *******
2026-03-11 23:29:12.244782 | controller-1 | skipping: [controller-1]
2026-03-11 23:29:12.244820 | controller-1 |
2026-03-11 23:29:12.245045 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Check if the Kubernetes API services is up to date] ***
2026-03-11 23:29:12.245232 | controller-1 | Wednesday 11 March 2026  23:29:12 +0000 (0:00:00.044)       0:03:29.956 *******
2026-03-11 23:29:12.319996 | controller-1 | skipping: [controller-1]
2026-03-11 23:29:12.320047 | controller-1 | skipping: [controller-2]
2026-03-11 23:29:12.320171 | controller-1 | skipping: [controller-3]
2026-03-11 23:29:12.320272 | controller-1 |
2026-03-11 23:29:12.320399 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Trigger an upgrade of the Kubernetes API services] ***
2026-03-11 23:29:12.320517 | controller-1 | Wednesday 11 March 2026  23:29:12 +0000 (0:00:00.075)       0:03:30.032 *******
2026-03-11 23:29:12.379518 | controller-1 | skipping: [controller-1]
2026-03-11 23:29:12.413306 | controller-1 | skipping: [controller-2]
2026-03-11 23:29:12.413394 | controller-1 | skipping: [controller-3]
2026-03-11 23:29:12.413514 | controller-1 |
2026-03-11 23:29:12.413629 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Setup nodes] ****************************
2026-03-11 23:29:12.413745 | controller-1 | Wednesday 11 March 2026  23:29:12 +0000 (0:00:00.093)       0:03:30.125 *******
2026-03-11 23:29:12.486447 | controller-1 | skipping: [controller-1]
2026-03-11 23:29:12.486649 | controller-1 | skipping: [controller-2]
2026-03-11 23:29:12.486898 | controller-1 | skipping: [controller-3]
2026-03-11 23:29:12.487092 | controller-1 |
2026-03-11 23:29:12.487307 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Upgrade & restart Kubelet node for upgrade (if needed)] ***
2026-03-11 23:29:12.487515 | controller-1 | Wednesday 11 March 2026  23:29:12 +0000 (0:00:00.072)       0:03:30.198 *******
2026-03-11 23:29:13.366052 | controller-1 | ok: [controller-1]
2026-03-11 23:29:13.786976 | controller-1 | ok: [controller-2]
2026-03-11 23:29:13.787065 | controller-1 | ok: [controller-3]
2026-03-11 23:29:13.787182 | controller-1 |
2026-03-11 23:29:13.787316 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Set node selector for CoreDNS components] ***
2026-03-11 23:29:13.787444 | controller-1 | Wednesday 11 March 2026  23:29:13 +0000 (0:00:01.300)       0:03:31.499 *******
2026-03-11 23:29:15.064943 | controller-1 | changed: [controller-1]
2026-03-11 23:29:15.064980 | controller-1 |
2026-03-11 23:29:15.064989 | controller-1 | PLAY [Install control-plane components] ****************************************
2026-03-11 23:29:15.064997 | controller-1 |
2026-03-11 23:29:15.065005 | controller-1 | TASK [Gathering Facts] *********************************************************
2026-03-11 23:29:15.065012 | controller-1 | Wednesday 11 March 2026  23:29:15 +0000 (0:00:01.277)       0:03:32.776 *******
2026-03-11 23:29:16.939472 | controller-1 | ok: [controller-3]
2026-03-11 23:29:16.942953 | controller-1 | ok: [controller-1]
2026-03-11 23:29:16.943253 | controller-1 | ok: [controller-2]
2026-03-11 23:29:16.943510 | controller-1 |
2026-03-11 23:29:16.943800 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-11 23:29:16.944046 | controller-1 | Wednesday 11 March 2026  23:29:16 +0000 (0:00:01.874)       0:03:34.651 *******
2026-03-11 23:29:17.300836 | controller-1 | ok: [controller-1]
2026-03-11 23:29:17.300886 | controller-1 | ok: [controller-2]
2026-03-11 23:29:17.301055 | controller-1 | ok: [controller-3]
2026-03-11 23:29:17.301081 | controller-1 |
2026-03-11 23:29:17.301250 | controller-1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-11 23:29:17.301275 | controller-1 | Wednesday 11 March 2026  23:29:17 +0000 (0:00:00.361)       0:03:35.012 *******
2026-03-11 23:29:18.339598 | controller-1 | ok: [controller-1]
2026-03-11 23:29:18.339640 | controller-1 | ok: [controller-3]
2026-03-11 23:29:18.339649 | controller-1 | ok: [controller-2]
2026-03-11 23:29:18.339657 | controller-1 |
2026-03-11 23:29:18.339926 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-11 23:29:18.339939 | controller-1 | Wednesday 11 March 2026  23:29:18 +0000 (0:00:01.036)       0:03:36.049 *******
2026-03-11 23:29:18.679901 | controller-1 | ok: [controller-1]
2026-03-11 23:29:18.679944 | controller-1 | ok: [controller-2]
2026-03-11 23:29:18.680029 | controller-1 | ok: [controller-3]
2026-03-11 23:29:18.680125 | controller-1 |
2026-03-11 23:29:18.680235 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:29:18.680304 | controller-1 | Wednesday 11 March 2026  23:29:18 +0000 (0:00:00.340)       0:03:36.390 *******
2026-03-11 23:29:18.741250 | controller-1 | ok: [controller-1] => {
2026-03-11 23:29:18.741354 | controller-1 |     "msg": "https://get.helm.sh/helm-v3.11.2-linux-amd64.tar.gz"
2026-03-11 23:29:18.741476 | controller-1 | }
2026-03-11 23:29:18.741610 | controller-1 | ok: [controller-2] => {
2026-03-11 23:29:18.741743 | controller-1 |     "msg": "https://get.helm.sh/helm-v3.11.2-linux-amd64.tar.gz"
2026-03-11 23:29:18.741912 | controller-1 | }
2026-03-11 23:29:18.743595 | controller-1 | ok: [controller-3] => {
2026-03-11 23:29:18.743626 | controller-1 |     "msg": "https://get.helm.sh/helm-v3.11.2-linux-amd64.tar.gz"
2026-03-11 23:29:18.743632 | controller-1 | }
2026-03-11 23:29:18.743637 | controller-1 |
2026-03-11 23:29:18.743642 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:29:18.743647 | controller-1 | Wednesday 11 March 2026  23:29:18 +0000 (0:00:00.062)       0:03:36.453 *******
2026-03-11 23:29:19.505317 | controller-1 | changed: [controller-1]
2026-03-11 23:29:19.505394 | controller-1 | changed: [controller-3]
2026-03-11 23:29:19.505560 | controller-1 | changed: [controller-2]
2026-03-11 23:29:19.505729 | controller-1 |
2026-03-11 23:29:19.505922 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:29:19.506129 | controller-1 | Wednesday 11 March 2026  23:29:19 +0000 (0:00:00.763)       0:03:37.216 *******
2026-03-11 23:29:21.395319 | controller-1 | changed: [controller-1]
2026-03-11 23:29:21.395360 | controller-1 | changed: [controller-3]
2026-03-11 23:29:21.395369 | controller-1 | changed: [controller-2]
2026-03-11 23:29:21.395378 | controller-1 |
2026-03-11 23:29:21.395387 | controller-1 | TASK [vexxhost.kubernetes.helm : Remove Helm repository] ***********************
2026-03-11 23:29:21.395408 | controller-1 | Wednesday 11 March 2026  23:29:21 +0000 (0:00:01.889)       0:03:39.106 *******
2026-03-11 23:29:21.825580 | controller-1 | ok: [controller-1]
2026-03-11 23:29:21.825774 | controller-1 | ok: [controller-3]
2026-03-11 23:29:21.825927 | controller-1 | ok: [controller-2]
2026-03-11 23:29:21.826068 | controller-1 |
2026-03-11 23:29:21.826224 | controller-1 | TASK [vexxhost.kubernetes.helm : Add bash autocomplete for helm] ***************
2026-03-11 23:29:21.826376 | controller-1 | Wednesday 11 March 2026  23:29:21 +0000 (0:00:00.431)       0:03:39.537 *******
2026-03-11 23:29:22.158302 | controller-1 | changed: [controller-2]
2026-03-11 23:29:22.158610 | controller-1 | changed: [controller-1]
2026-03-11 23:29:22.158871 | controller-1 | changed: [controller-3]
2026-03-11 23:29:22.159117 | controller-1 |
2026-03-11 23:29:22.159452 | controller-1 | TASK [vexxhost.kubernetes.helm : Get Helm plugins dir] *************************
2026-03-11 23:29:22.159764 | controller-1 | Wednesday 11 March 2026  23:29:22 +0000 (0:00:00.332)       0:03:39.870 *******
2026-03-11 23:29:22.544055 | controller-1 | ok: [controller-1]
2026-03-11 23:29:22.544152 | controller-1 | ok: [controller-3]
2026-03-11 23:29:22.544235 | controller-1 | ok: [controller-2]
2026-03-11 23:29:22.544319 | controller-1 |
2026-03-11 23:29:22.544412 | controller-1 | TASK [vexxhost.kubernetes.helm : Create Helm plugins directory if it does not exist] ***
2026-03-11 23:29:22.544498 | controller-1 | Wednesday 11 March 2026  23:29:22 +0000 (0:00:00.385)       0:03:40.255 *******
2026-03-11 23:29:22.879748 | controller-1 | changed: [controller-1]
2026-03-11 23:29:22.879842 | controller-1 | changed: [controller-2]
2026-03-11 23:29:22.879976 | controller-1 | changed: [controller-3]
2026-03-11 23:29:22.880090 | controller-1 |
2026-03-11 23:29:22.880230 | controller-1 | TASK [vexxhost.kubernetes.helm : Remove Helm diff plugin installed by kubernetes.core.helm_plugin] ***
2026-03-11 23:29:22.880357 | controller-1 | Wednesday 11 March 2026  23:29:22 +0000 (0:00:00.335)       0:03:40.591 *******
2026-03-11 23:29:23.211647 | controller-1 | ok: [controller-1]
2026-03-11 23:29:23.211842 | controller-1 | ok: [controller-2]
2026-03-11 23:29:23.212033 | controller-1 | ok: [controller-3]
2026-03-11 23:29:23.212213 | controller-1 |
2026-03-11 23:29:23.212430 | controller-1 | TASK [Install plugin] **********************************************************
2026-03-11 23:29:23.212625 | controller-1 | Wednesday 11 March 2026  23:29:23 +0000 (0:00:00.331)       0:03:40.923 *******
2026-03-11 23:29:23.311785 | controller-1 | included: vexxhost.containers.download_artifact for controller-1, controller-2, controller-3
2026-03-11 23:29:23.311951 | controller-1 |
2026-03-11 23:29:23.312158 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:29:23.312358 | controller-1 | Wednesday 11 March 2026  23:29:23 +0000 (0:00:00.100)       0:03:41.024 *******
2026-03-11 23:29:23.383110 | controller-1 | ok: [controller-1] => {
2026-03-11 23:29:23.383200 | controller-1 |     "msg": "https://github.com/databus23/helm-diff/releases/download/v3.8.1/helm-diff-linux-amd64.tgz"
2026-03-11 23:29:23.383286 | controller-1 | }
2026-03-11 23:29:23.383484 | controller-1 | ok: [controller-2] => {
2026-03-11 23:29:23.383731 | controller-1 |     "msg": "https://github.com/databus23/helm-diff/releases/download/v3.8.1/helm-diff-linux-amd64.tgz"
2026-03-11 23:29:23.383912 | controller-1 | }
2026-03-11 23:29:23.384088 | controller-1 | ok: [controller-3] => {
2026-03-11 23:29:23.384284 | controller-1 |     "msg": "https://github.com/databus23/helm-diff/releases/download/v3.8.1/helm-diff-linux-amd64.tgz"
2026-03-11 23:29:23.384460 | controller-1 | }
2026-03-11 23:29:23.384628 | controller-1 |
2026-03-11 23:29:23.384821 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:29:23.385011 | controller-1 | Wednesday 11 March 2026  23:29:23 +0000 (0:00:00.070)       0:03:41.094 *******
2026-03-11 23:29:25.500757 | controller-1 | changed: [controller-2]
2026-03-11 23:29:25.500973 | controller-1 | changed: [controller-3]
2026-03-11 23:29:25.501152 | controller-1 | changed: [controller-1]
2026-03-11 23:29:25.501338 | controller-1 |
2026-03-11 23:29:25.501548 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:29:25.501750 | controller-1 | Wednesday 11 March 2026  23:29:25 +0000 (0:00:02.117)       0:03:43.212 *******
2026-03-11 23:29:27.638747 | controller-1 | changed: [controller-2]
2026-03-11 23:29:27.638769 | controller-1 | changed: [controller-1]
2026-03-11 23:29:27.638773 | controller-1 | changed: [controller-3]
2026-03-11 23:29:27.638777 | controller-1 |
2026-03-11 23:29:27.638780 | controller-1 | TASK [vexxhost.kubernetes.upload_helm_chart : Include help chart upload method tasks] ***
2026-03-11 23:29:27.638787 | controller-1 | Wednesday 11 March 2026  23:29:27 +0000 (0:00:02.136)       0:03:45.349 *******
2026-03-11 23:29:27.747762 | controller-1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/upload_helm_chart/tasks/synchronize.yml for controller-1, controller-2, controller-3
2026-03-11 23:29:27.747919 | controller-1 |
2026-03-11 23:29:27.748116 | controller-1 | TASK [vexxhost.kubernetes.upload_helm_chart : Upload Helm chart] ***************
2026-03-11 23:29:27.748304 | controller-1 | Wednesday 11 March 2026  23:29:27 +0000 (0:00:00.111)       0:03:45.460 *******
2026-03-11 23:29:28.520331 | controller-1 | changed: [controller-1]
2026-03-11 23:29:28.520503 | controller-1 |
2026-03-11 23:29:28.520732 | controller-1 | TASK [vexxhost.kubernetes.cilium : Get current Kubernetes version] *************
2026-03-11 23:29:28.520960 | controller-1 | Wednesday 11 March 2026  23:29:28 +0000 (0:00:00.772)       0:03:46.232 *******
2026-03-11 23:29:29.433758 | controller-1 | ok: [controller-1]
2026-03-11 23:29:29.433794 | controller-1 |
2026-03-11 23:29:29.433804 | controller-1 | TASK [vexxhost.kubernetes.cilium : Deploy Helm chart] **************************
2026-03-11 23:29:29.433812 | controller-1 | Wednesday 11 March 2026  23:29:29 +0000 (0:00:00.912)       0:03:47.145 *******
2026-03-11 23:29:31.650804 | controller-1 | changed: [controller-1]
2026-03-11 23:29:31.650955 | controller-1 |
2026-03-11 23:29:31.651177 | controller-1 | TASK [vexxhost.kubernetes.upload_helm_chart : Include help chart upload method tasks] ***
2026-03-11 23:29:31.651387 | controller-1 | Wednesday 11 March 2026  23:29:31 +0000 (0:00:02.217)       0:03:49.362 *******
2026-03-11 23:29:31.720461 | controller-1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/upload_helm_chart/tasks/synchronize.yml for controller-1, controller-2, controller-3
2026-03-11 23:29:31.720525 | controller-1 |
2026-03-11 23:29:31.720783 | controller-1 | TASK [vexxhost.kubernetes.upload_helm_chart : Upload Helm chart] ***************
2026-03-11 23:29:31.720971 | controller-1 | Wednesday 11 March 2026  23:29:31 +0000 (0:00:00.070)       0:03:49.432 *******
2026-03-11 23:29:32.379957 | controller-1 | changed: [controller-1]
2026-03-11 23:29:32.380091 | controller-1 |
2026-03-11 23:29:32.380304 | controller-1 | TASK [vexxhost.kubernetes.envoy_gateway : Deploy Helm chart] *******************
2026-03-11 23:29:32.380616 | controller-1 | Wednesday 11 March 2026  23:29:32 +0000 (0:00:00.659)       0:03:50.092 *******
2026-03-11 23:30:19.647040 | controller-1 | changed: [controller-1]
2026-03-11 23:30:19.648225 | controller-1 |
2026-03-11 23:30:19.648272 | controller-1 | TASK [vexxhost.kubernetes.envoy_gateway : Create GatewayClass] *****************
2026-03-11 23:30:19.648281 | controller-1 | Wednesday 11 March 2026  23:30:19 +0000 (0:00:47.266)       0:04:37.358 *******
2026-03-11 23:30:20.452955 | controller-1 | changed: [controller-1]
2026-03-11 23:30:20.453161 | controller-1 |
2026-03-11 23:30:20.453431 | controller-1 | PLAY [Wait for all nodes to become Ready] **************************************
2026-03-11 23:30:20.453655 | controller-1 |
2026-03-11 23:30:20.453897 | controller-1 | TASK [Gathering Facts] *********************************************************
2026-03-11 23:30:20.454176 | controller-1 | Wednesday 11 March 2026  23:30:20 +0000 (0:00:00.806)       0:04:38.165 *******
2026-03-11 23:30:22.429590 | controller-1 | ok: [controller-3]
2026-03-11 23:30:22.429650 | controller-1 | ok: [controller-1]
2026-03-11 23:30:22.429660 | controller-1 | ok: [controller-2]
2026-03-11 23:30:22.429670 | controller-1 |
2026-03-11 23:30:22.429681 | controller-1 | TASK [Wait for node to be Ready] ***********************************************
2026-03-11 23:30:22.429690 | controller-1 | Wednesday 11 March 2026  23:30:22 +0000 (0:00:01.975)       0:04:40.140 *******
2026-03-11 23:30:23.249242 | controller-1 | ok: [controller-2 -> controller-1(199.204.45.3)]
2026-03-11 23:30:23.249421 | controller-1 | ok: [controller-1]
2026-03-11 23:30:23.249605 | controller-1 | ok: [controller-3 -> controller-1(199.204.45.3)]
2026-03-11 23:30:23.249715 | controller-1 |
2026-03-11 23:30:23.249827 | controller-1 | PLAY RECAP *********************************************************************
2026-03-11 23:30:23.249950 | controller-1 | controller-1               : ok=120  changed=54   unreachable=0    failed=0    skipped=34   rescued=0    ignored=3
2026-03-11 23:30:23.250067 | controller-1 | controller-2               : ok=115  changed=49   unreachable=0    failed=0    skipped=31   rescued=0    ignored=2
2026-03-11 23:30:23.250249 | controller-1 | controller-3               : ok=112  changed=48   unreachable=0    failed=0    skipped=31   rescued=0    ignored=2
2026-03-11 23:30:23.250421 | controller-1 |
2026-03-11 23:30:23.250523 | controller-1 |
2026-03-11 23:30:23.250706 | controller-1 | TASKS RECAP ********************************************************************
2026-03-11 23:30:23.250825 | controller-1 | Wednesday 11 March 2026  23:30:23 +0000 (0:00:00.821)       0:04:40.962 *******
2026-03-11 23:30:23.250931 | controller-1 | ===============================================================================
2026-03-11 23:30:23.251045 | controller-1 | vexxhost.kubernetes.kubernetes : Join cluster -------------------------- 77.66s
2026-03-11 23:30:23.251184 | controller-1 | vexxhost.kubernetes.envoy_gateway : Deploy Helm chart ------------------ 47.27s
2026-03-11 23:30:23.251317 | controller-1 | vexxhost.kubernetes.kubernetes : Initialize cluster -------------------- 34.34s
2026-03-11 23:30:23.251440 | controller-1 | vexxhost.kubernetes.kubernetes : Install Kubernetes Python package using package manager on supported systems -- 10.61s
2026-03-11 23:30:23.251573 | controller-1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.33s
2026-03-11 23:30:23.251684 | controller-1 | Install Debian packages ------------------------------------------------- 5.62s
2026-03-11 23:30:23.251793 | controller-1 | vexxhost.kubernetes.kubelet : Reload systemd ---------------------------- 3.43s
2026-03-11 23:30:23.251901 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.14s
2026-03-11 23:30:23.252009 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.01s
2026-03-11 23:30:23.252117 | controller-1 | vexxhost.kubernetes.kubelet : Install additional packages --------------- 2.88s
2026-03-11 23:30:23.252261 | controller-1 | vexxhost.kubernetes.kubelet : Configure sysctl values ------------------- 2.22s
2026-03-11 23:30:23.252371 | controller-1 | vexxhost.kubernetes.cilium : Deploy Helm chart -------------------------- 2.22s
2026-03-11 23:30:23.252540 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.14s
2026-03-11 23:30:23.252732 | controller-1 | vexxhost.containers.download_artifact : Download item ------------------- 2.12s
2026-03-11 23:30:23.252863 | controller-1 | Gathering Facts --------------------------------------------------------- 1.98s
2026-03-11 23:30:23.252975 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.89s
2026-03-11 23:30:23.253083 | controller-1 | Gathering Facts --------------------------------------------------------- 1.87s
2026-03-11 23:30:23.253274 | controller-1 | vexxhost.containers.download_artifact : Download item ------------------- 1.85s
2026-03-11 23:30:23.253393 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.76s
2026-03-11 23:30:23.253528 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.76s
2026-03-11 23:30:23.411369 | controller-1 | INFO     [cluster-upgrade > prepare] Executed: Successful
2026-03-11 23:30:23.418497 | controller-1 | INFO     [cluster-upgrade > converge] Executing
2026-03-11 23:30:24.667781 | controller-1 |
2026-03-11 23:30:24.668084 | controller-1 | PLAY [Configure Kubernetes VIP] ************************************************
2026-03-11 23:30:24.668306 | controller-1 |
2026-03-11 23:30:24.668550 | controller-1 | TASK [Gathering Facts] *********************************************************
2026-03-11 23:30:24.668792 | controller-1 | Wednesday 11 March 2026  23:30:24 +0000 (0:00:00.016)       0:00:00.016 *******
2026-03-11 23:30:25.888145 | controller-1 | [WARNING]: Host 'controller-3' is using the discovered Python interpreter at '/usr/bin/python3.13', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-03-11 23:30:25.913912 | controller-1 | [WARNING]: Host 'controller-1' is using the discovered Python interpreter at '/usr/bin/python3.13', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-03-11 23:30:26.918834 | controller-1 | [WARNING]: Host 'controller-2' is using the discovered Python interpreter at '/usr/bin/python3.13', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-03-11 23:30:26.926910 | controller-1 | ok: [controller-3]
2026-03-11 23:30:26.926955 | controller-1 | ok: [controller-1]
2026-03-11 23:30:26.927113 | controller-1 | ok: [controller-2]
2026-03-11 23:30:26.927334 | controller-1 |
2026-03-11 23:30:26.927473 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/etc/kubernetes/manifests)] ***
2026-03-11 23:30:26.927724 | controller-1 | Wednesday 11 March 2026  23:30:26 +0000 (0:00:02.258)       0:00:02.275 *******
2026-03-11 23:30:27.373133 | controller-1 | ok: [controller-1]
2026-03-11 23:30:27.373296 | controller-1 | ok: [controller-3]
2026-03-11 23:30:27.373482 | controller-1 | ok: [controller-2]
2026-03-11 23:30:27.373684 | controller-1 |
2026-03-11 23:30:27.373849 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack] ****************
2026-03-11 23:30:27.374037 | controller-1 | Wednesday 11 March 2026  23:30:27 +0000 (0:00:00.446)       0:00:02.721 *******
2026-03-11 23:30:28.791776 | controller-1 | ok: [controller-1] => (item=/etc/keepalived/keepalived.conf)
2026-03-11 23:30:28.791893 | controller-1 | ok: [controller-3] => (item=/etc/keepalived/keepalived.conf)
2026-03-11 23:30:28.791976 | controller-1 | ok: [controller-2] => (item=/etc/keepalived/keepalived.conf)
2026-03-11 23:30:28.792092 | controller-1 | ok: [controller-1] => (item=/etc/keepalived/check_apiserver.sh)
2026-03-11 23:30:28.792199 | controller-1 | ok: [controller-3] => (item=/etc/keepalived/check_apiserver.sh)
2026-03-11 23:30:28.792317 | controller-1 | ok: [controller-2] => (item=/etc/keepalived/check_apiserver.sh)
2026-03-11 23:30:28.792434 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes/manifests/keepalived.yaml)
2026-03-11 23:30:28.792557 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes/manifests/keepalived.yaml)
2026-03-11 23:30:28.792677 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes/manifests/keepalived.yaml)
2026-03-11 23:30:28.792804 | controller-1 | ok: [controller-1] => (item=/etc/haproxy/haproxy.cfg)
2026-03-11 23:30:28.792918 | controller-1 | ok: [controller-3] => (item=/etc/haproxy/haproxy.cfg)
2026-03-11 23:30:28.793032 | controller-1 | ok: [controller-2] => (item=/etc/haproxy/haproxy.cfg)
2026-03-11 23:30:28.793147 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes/manifests/haproxy.yaml)
2026-03-11 23:30:28.793264 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes/manifests/haproxy.yaml)
2026-03-11 23:30:28.793385 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes/manifests/haproxy.yaml)
2026-03-11 23:30:28.793490 | controller-1 |
2026-03-11 23:30:28.793611 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Switch API server to run on port 6443] ****
2026-03-11 23:30:28.793728 | controller-1 | Wednesday 11 March 2026  23:30:28 +0000 (0:00:01.415)       0:00:04.136 *******
2026-03-11 23:30:29.723031 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes/manifests/kube-apiserver.yaml)
2026-03-11 23:30:29.723222 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes/manifests/kube-apiserver.yaml)
2026-03-11 23:30:29.723489 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes/manifests/kube-apiserver.yaml)
2026-03-11 23:30:29.723741 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes/controller-manager.conf)
2026-03-11 23:30:29.723899 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes/controller-manager.conf)
2026-03-11 23:30:29.724083 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes/controller-manager.conf)
2026-03-11 23:30:29.724523 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes/scheduler.conf)
2026-03-11 23:30:29.724716 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes/scheduler.conf)
2026-03-11 23:30:29.724934 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes/scheduler.conf)
2026-03-11 23:30:29.725110 | controller-1 |
2026-03-11 23:30:29.725304 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Check if super-admin.conf exists] *********
2026-03-11 23:30:29.725491 | controller-1 | Wednesday 11 March 2026  23:30:29 +0000 (0:00:00.933)       0:00:05.070 *******
2026-03-11 23:30:30.121253 | controller-1 | ok: [controller-1]
2026-03-11 23:30:30.121358 | controller-1 | ok: [controller-3]
2026-03-11 23:30:30.121461 | controller-1 | ok: [controller-2]
2026-03-11 23:30:30.121561 | controller-1 |
2026-03-11 23:30:30.121685 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Check if kubeadm has already run] *********
2026-03-11 23:30:30.121804 | controller-1 | Wednesday 11 March 2026  23:30:30 +0000 (0:00:00.398)       0:00:05.469 *******
2026-03-11 23:30:30.431431 | controller-1 | ok: [controller-1]
2026-03-11 23:30:30.431523 | controller-1 | ok: [controller-2]
2026-03-11 23:30:30.431665 | controller-1 | ok: [controller-3]
2026-03-11 23:30:30.431770 | controller-1 |
2026-03-11 23:30:30.431895 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path] ************
2026-03-11 23:30:30.432021 | controller-1 | Wednesday 11 March 2026  23:30:30 +0000 (0:00:00.308)       0:00:05.778 *******
2026-03-11 23:30:30.492550 | controller-1 | ok: [controller-1]
2026-03-11 23:30:30.492729 | controller-1 | ok: [controller-2]
2026-03-11 23:30:30.492968 | controller-1 | ok: [controller-3]
2026-03-11 23:30:30.493142 | controller-1 |
2026-03-11 23:30:30.493350 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path (with super-admin.conf)] ***
2026-03-11 23:30:30.493543 | controller-1 | Wednesday 11 March 2026  23:30:30 +0000 (0:00:00.062)       0:00:05.840 *******
2026-03-11 23:30:30.551945 | controller-1 | ok: [controller-1]
2026-03-11 23:30:30.552123 | controller-1 | skipping: [controller-2]
2026-03-11 23:30:30.552308 | controller-1 | skipping: [controller-3]
2026-03-11 23:30:30.552492 | controller-1 |
2026-03-11 23:30:30.552689 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Upload Kubernetes manifest] ***************
2026-03-11 23:30:30.552908 | controller-1 | Wednesday 11 March 2026  23:30:30 +0000 (0:00:00.059)       0:00:05.900 *******
2026-03-11 23:30:31.330750 | controller-1 | ok: [controller-1]
2026-03-11 23:30:31.330799 | controller-1 | ok: [controller-3]
2026-03-11 23:30:31.330887 | controller-1 | ok: [controller-2]
2026-03-11 23:30:31.330966 | controller-1 |
2026-03-11 23:30:31.331059 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Ensure kube-vip configuration file] *******
2026-03-11 23:30:31.331137 | controller-1 | Wednesday 11 March 2026  23:30:31 +0000 (0:00:00.776)       0:00:06.676 *******
2026-03-11 23:30:31.707152 | controller-1 | ok: [controller-2]
2026-03-11 23:30:31.707339 | controller-1 | ok: [controller-1]
2026-03-11 23:30:31.707522 | controller-1 | ok: [controller-3]
2026-03-11 23:30:31.707729 | controller-1 |
2026-03-11 23:30:31.707920 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] ***************************
2026-03-11 23:30:31.708106 | controller-1 | Wednesday 11 March 2026  23:30:31 +0000 (0:00:00.317)       0:00:06.994 *******
2026-03-11 23:30:31.708268 | controller-1 |
2026-03-11 23:30:31.708460 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] ***************************
2026-03-11 23:30:31.708649 | controller-1 | Wednesday 11 March 2026  23:30:31 +0000 (0:00:00.004)       0:00:06.998 *******
2026-03-11 23:30:31.708812 | controller-1 |
2026-03-11 23:30:31.709000 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] ***************************
2026-03-11 23:30:31.709183 | controller-1 | Wednesday 11 March 2026  23:30:31 +0000 (0:00:00.002)       0:00:07.001 *******
2026-03-11 23:30:31.709362 | controller-1 |
2026-03-11 23:30:31.709537 | controller-1 | PLAY [Install Kubernetes] ******************************************************
2026-03-11 23:30:31.709700 | controller-1 |
2026-03-11 23:30:31.709910 | controller-1 | TASK [Gathering Facts] *********************************************************
2026-03-11 23:30:31.710102 | controller-1 | Wednesday 11 March 2026  23:30:31 +0000 (0:00:00.054)       0:00:07.055 *******
2026-03-11 23:30:32.717252 | controller-1 | ok: [controller-1]
2026-03-11 23:30:32.717319 | controller-1 | ok: [controller-3]
2026-03-11 23:30:32.717447 | controller-1 | ok: [controller-2]
2026-03-11 23:30:32.717543 | controller-1 |
2026-03-11 23:30:32.717663 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-11 23:30:32.717780 | controller-1 | Wednesday 11 March 2026  23:30:32 +0000 (0:00:01.008)       0:00:08.064 *******
2026-03-11 23:30:33.067613 | controller-1 | ok: [controller-1]
2026-03-11 23:30:33.067796 | controller-1 | ok: [controller-3]
2026-03-11 23:30:33.067975 | controller-1 | ok: [controller-2]
2026-03-11 23:30:33.068145 | controller-1 |
2026-03-11 23:30:33.068334 | controller-1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-11 23:30:33.068520 | controller-1 | Wednesday 11 March 2026  23:30:33 +0000 (0:00:00.351)       0:00:08.415 *******
2026-03-11 23:30:33.141489 | controller-1 | skipping: [controller-1]
2026-03-11 23:30:33.141656 | controller-1 | skipping: [controller-2]
2026-03-11 23:30:33.141860 | controller-1 | skipping: [controller-3]
2026-03-11 23:30:33.142025 | controller-1 |
2026-03-11 23:30:33.142216 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-11 23:30:33.142400 | controller-1 | Wednesday 11 March 2026  23:30:33 +0000 (0:00:00.073)       0:00:08.489 *******
2026-03-11 23:30:33.494186 | controller-1 | ok: [controller-1]
2026-03-11 23:30:33.494357 | controller-1 | ok: [controller-3]
2026-03-11 23:30:33.494537 | controller-1 | ok: [controller-2]
2026-03-11 23:30:33.494706 | controller-1 |
2026-03-11 23:30:33.494897 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:30:33.495082 | controller-1 | Wednesday 11 March 2026  23:30:33 +0000 (0:00:00.352)       0:00:08.842 *******
2026-03-11 23:30:33.582685 | controller-1 | ok: [controller-1] => {
2026-03-11 23:30:33.582858 | controller-1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-11 23:30:33.583035 | controller-1 | }
2026-03-11 23:30:33.583247 | controller-1 | ok: [controller-2] => {
2026-03-11 23:30:33.583445 | controller-1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-11 23:30:33.583693 | controller-1 | }
2026-03-11 23:30:33.583872 | controller-1 | ok: [controller-3] => {
2026-03-11 23:30:33.584061 | controller-1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-11 23:30:33.584231 | controller-1 | }
2026-03-11 23:30:33.584397 | controller-1 |
2026-03-11 23:30:33.584589 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:30:33.584773 | controller-1 | Wednesday 11 March 2026  23:30:33 +0000 (0:00:00.088)       0:00:08.930 *******
2026-03-11 23:30:34.128598 | controller-1 | ok: [controller-1]
2026-03-11 23:30:34.128780 | controller-1 | ok: [controller-3]
2026-03-11 23:30:34.128973 | controller-1 | ok: [controller-2]
2026-03-11 23:30:34.129148 | controller-1 |
2026-03-11 23:30:34.129344 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:30:34.129525 | controller-1 | Wednesday 11 March 2026  23:30:34 +0000 (0:00:00.545)       0:00:09.476 *******
2026-03-11 23:30:34.210217 | controller-1 | skipping: [controller-1]
2026-03-11 23:30:34.210274 | controller-1 | skipping: [controller-2]
2026-03-11 23:30:34.210452 | controller-1 | skipping: [controller-3]
2026-03-11 23:30:34.210512 | controller-1 |
2026-03-11 23:30:34.210699 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-11 23:30:34.210746 | controller-1 | Wednesday 11 March 2026  23:30:34 +0000 (0:00:00.081)       0:00:09.558 *******
2026-03-11 23:30:34.556743 | controller-1 | ok: [controller-1]
2026-03-11 23:30:34.556883 | controller-1 | ok: [controller-2]
2026-03-11 23:30:34.557071 | controller-1 | ok: [controller-3]
2026-03-11 23:30:34.557240 | controller-1 |
2026-03-11 23:30:34.557435 | controller-1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-11 23:30:34.557622 | controller-1 | Wednesday 11 March 2026  23:30:34 +0000 (0:00:00.345)       0:00:09.904 *******
2026-03-11 23:30:35.597832 | controller-1 | ok: [controller-1]
2026-03-11 23:30:35.598017 | controller-1 | ok: [controller-2]
2026-03-11 23:30:35.598201 | controller-1 | ok: [controller-3]
2026-03-11 23:30:35.598370 | controller-1 |
2026-03-11 23:30:35.598565 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:30:35.598754 | controller-1 | Wednesday 11 March 2026  23:30:35 +0000 (0:00:01.041)       0:00:10.946 *******
2026-03-11 23:30:35.693271 | controller-1 | ok: [controller-1] => {
2026-03-11 23:30:35.693478 | controller-1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-11 23:30:35.693690 | controller-1 | }
2026-03-11 23:30:35.693895 | controller-1 | ok: [controller-2] => {
2026-03-11 23:30:35.694102 | controller-1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-11 23:30:35.694283 | controller-1 | }
2026-03-11 23:30:35.694471 | controller-1 | ok: [controller-3] => {
2026-03-11 23:30:35.694676 | controller-1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-11 23:30:35.694857 | controller-1 | }
2026-03-11 23:30:35.695030 | controller-1 |
2026-03-11 23:30:35.695226 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:30:35.695417 | controller-1 | Wednesday 11 March 2026  23:30:35 +0000 (0:00:00.094)       0:00:11.040 *******
2026-03-11 23:30:36.185063 | controller-1 | ok: [controller-1]
2026-03-11 23:30:36.185285 | controller-1 | ok: [controller-2]
2026-03-11 23:30:36.185526 | controller-1 | ok: [controller-3]
2026-03-11 23:30:36.185756 | controller-1 |
2026-03-11 23:30:36.186009 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:30:36.186271 | controller-1 | Wednesday 11 March 2026  23:30:36 +0000 (0:00:00.492)       0:00:11.533 *******
2026-03-11 23:30:38.513439 | controller-1 | ok: [controller-1]
2026-03-11 23:30:38.513618 | controller-1 | ok: [controller-2]
2026-03-11 23:30:38.513829 | controller-1 | ok: [controller-3]
2026-03-11 23:30:38.513997 | controller-1 |
2026-03-11 23:30:38.514180 | controller-1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-11 23:30:38.514368 | controller-1 | Wednesday 11 March 2026  23:30:38 +0000 (0:00:02.328)       0:00:13.861 *******
2026-03-11 23:30:38.576242 | controller-1 | skipping: [controller-1]
2026-03-11 23:30:38.576412 | controller-1 | skipping: [controller-2]
2026-03-11 23:30:38.576594 | controller-1 | skipping: [controller-3]
2026-03-11 23:30:38.577101 | controller-1 |
2026-03-11 23:30:38.577485 | controller-1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-11 23:30:38.577671 | controller-1 | Wednesday 11 March 2026  23:30:38 +0000 (0:00:00.062)       0:00:13.924 *******
2026-03-11 23:30:38.640270 | controller-1 | skipping: [controller-1]
2026-03-11 23:30:38.640515 | controller-1 | skipping: [controller-2]
2026-03-11 23:30:38.640712 | controller-1 | skipping: [controller-3]
2026-03-11 23:30:38.640879 | controller-1 |
2026-03-11 23:30:38.641067 | controller-1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-11 23:30:38.641250 | controller-1 | Wednesday 11 March 2026  23:30:38 +0000 (0:00:00.064)       0:00:13.988 *******
2026-03-11 23:30:38.701850 | controller-1 | skipping: [controller-1]
2026-03-11 23:30:38.702017 | controller-1 | skipping: [controller-2]
2026-03-11 23:30:38.702199 | controller-1 | skipping: [controller-3]
2026-03-11 23:30:38.702366 | controller-1 |
2026-03-11 23:30:38.702555 | controller-1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-11 23:30:38.702738 | controller-1 | Wednesday 11 March 2026  23:30:38 +0000 (0:00:00.061)       0:00:14.049 *******
2026-03-11 23:30:39.590353 | controller-1 | ok: [controller-1]
2026-03-11 23:30:39.590511 | controller-1 | ok: [controller-2]
2026-03-11 23:30:39.590690 | controller-1 | ok: [controller-3]
2026-03-11 23:30:39.590906 | controller-1 |
2026-03-11 23:30:39.591111 | controller-1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-11 23:30:39.591343 | controller-1 | Wednesday 11 March 2026  23:30:39 +0000 (0:00:00.888)       0:00:14.938 *******
2026-03-11 23:30:40.273396 | controller-1 | ok: [controller-1]
2026-03-11 23:30:40.273447 | controller-1 | ok: [controller-2]
2026-03-11 23:30:40.273455 | controller-1 | ok: [controller-3]
2026-03-11 23:30:40.273463 | controller-1 |
2026-03-11 23:30:40.273472 | controller-1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-11 23:30:40.273479 | controller-1 | Wednesday 11 March 2026  23:30:40 +0000 (0:00:00.682)       0:00:15.620 *******
2026-03-11 23:30:41.718943 | controller-1 | ok: [controller-1] => (item={'path': '/etc/containerd'})
2026-03-11 23:30:41.719003 | controller-1 | ok: [controller-2] => (item={'path': '/etc/containerd'})
2026-03-11 23:30:41.719109 | controller-1 | ok: [controller-3] => (item={'path': '/etc/containerd'})
2026-03-11 23:30:41.719194 | controller-1 | ok: [controller-1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-11 23:30:41.719280 | controller-1 | ok: [controller-2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-11 23:30:41.719363 | controller-1 | ok: [controller-3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-11 23:30:41.719448 | controller-1 | ok: [controller-1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-11 23:30:41.719525 | controller-1 | ok: [controller-2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-11 23:30:41.719669 | controller-1 | ok: [controller-3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-11 23:30:41.719757 | controller-1 | ok: [controller-1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-11 23:30:41.719932 | controller-1 | ok: [controller-2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-11 23:30:41.720113 | controller-1 | ok: [controller-3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-11 23:30:41.720371 | controller-1 | ok: [controller-1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-11 23:30:41.720581 | controller-1 | ok: [controller-2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-11 23:30:41.720778 | controller-1 | ok: [controller-3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-11 23:30:41.720931 | controller-1 |
2026-03-11 23:30:41.721116 | controller-1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-11 23:30:41.721304 | controller-1 | Wednesday 11 March 2026  23:30:41 +0000 (0:00:01.446)       0:00:17.067 *******
2026-03-11 23:30:42.491145 | controller-1 | ok: [controller-1]
2026-03-11 23:30:42.491187 | controller-1 | ok: [controller-3]
2026-03-11 23:30:42.491279 | controller-1 | ok: [controller-2]
2026-03-11 23:30:42.491367 | controller-1 |
2026-03-11 23:30:42.491461 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-11 23:30:42.491652 | controller-1 | Wednesday 11 March 2026  23:30:42 +0000 (0:00:00.755)       0:00:17.823 *******
2026-03-11 23:30:42.491688 | controller-1 |
2026-03-11 23:30:42.491746 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-11 23:30:42.491829 | controller-1 | Wednesday 11 March 2026  23:30:42 +0000 (0:00:00.006)       0:00:17.829 *******
2026-03-11 23:30:42.491905 | controller-1 |
2026-03-11 23:30:42.491996 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-11 23:30:42.492069 | controller-1 | Wednesday 11 March 2026  23:30:42 +0000 (0:00:00.004)       0:00:17.834 *******
2026-03-11 23:30:42.492144 | controller-1 |
2026-03-11 23:30:42.492229 | controller-1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-11 23:30:42.492312 | controller-1 | Wednesday 11 March 2026  23:30:42 +0000 (0:00:00.005)       0:00:17.839 *******
2026-03-11 23:30:44.194801 | controller-1 | ok: [controller-2]
2026-03-11 23:30:44.194981 | controller-1 | ok: [controller-3]
2026-03-11 23:30:44.195172 | controller-1 | ok: [controller-1]
2026-03-11 23:30:44.195345 | controller-1 |
2026-03-11 23:30:44.195604 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the "kubeadm-config" ConfigMap] ***
2026-03-11 23:30:44.195822 | controller-1 | Wednesday 11 March 2026  23:30:44 +0000 (0:00:01.703)       0:00:19.543 *******
2026-03-11 23:30:45.089948 | controller-1 | ok: [controller-1]
2026-03-11 23:30:45.090117 | controller-1 |
2026-03-11 23:30:45.090332 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Parse the ClusterConfiguration] ***
2026-03-11 23:30:45.090528 | controller-1 | Wednesday 11 March 2026  23:30:45 +0000 (0:00:00.894)       0:00:20.437 *******
2026-03-11 23:30:45.140483 | controller-1 | ok: [controller-1]
2026-03-11 23:30:45.140677 | controller-1 |
2026-03-11 23:30:45.140884 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the current Kubernetes version] ***
2026-03-11 23:30:45.141080 | controller-1 | Wednesday 11 March 2026  23:30:45 +0000 (0:00:00.050)       0:00:20.488 *******
2026-03-11 23:30:45.188664 | controller-1 | ok: [controller-1]
2026-03-11 23:30:45.188850 | controller-1 |
2026-03-11 23:30:45.189060 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Extract major, minor, and patch versions] ***
2026-03-11 23:30:45.189253 | controller-1 | Wednesday 11 March 2026  23:30:45 +0000 (0:00:00.048)       0:00:20.536 *******
2026-03-11 23:30:45.241212 | controller-1 | ok: [controller-1]
2026-03-11 23:30:45.241357 | controller-1 |
2026-03-11 23:30:45.241562 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Fail if we're jumping more than one minor version] ***
2026-03-11 23:30:45.241751 | controller-1 | Wednesday 11 March 2026  23:30:45 +0000 (0:00:00.052)       0:00:20.589 *******
2026-03-11 23:30:45.308013 | controller-1 | skipping: [controller-1]
2026-03-11 23:30:45.308180 | controller-1 | skipping: [controller-2]
2026-03-11 23:30:45.308360 | controller-1 | skipping: [controller-3]
2026-03-11 23:30:45.308525 | controller-1 |
2026-03-11 23:30:45.308727 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Set fact if we need to upgrade] ***
2026-03-11 23:30:45.308915 | controller-1 | Wednesday 11 March 2026  23:30:45 +0000 (0:00:00.066)       0:00:20.656 *******
2026-03-11 23:30:45.391033 | controller-1 | ok: [controller-1]
2026-03-11 23:30:45.391078 | controller-1 | ok: [controller-2]
2026-03-11 23:30:45.391165 | controller-1 | ok: [controller-3]
2026-03-11 23:30:45.391241 | controller-1 |
2026-03-11 23:30:45.391327 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-11 23:30:45.391413 | controller-1 | Wednesday 11 March 2026  23:30:45 +0000 (0:00:00.081)       0:00:20.737 *******
2026-03-11 23:30:45.737718 | controller-1 | ok: [controller-1]
2026-03-11 23:30:45.737767 | controller-1 | ok: [controller-2]
2026-03-11 23:30:45.737872 | controller-1 | ok: [controller-3]
2026-03-11 23:30:45.737929 | controller-1 |
2026-03-11 23:30:45.738025 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:30:45.738113 | controller-1 | Wednesday 11 March 2026  23:30:45 +0000 (0:00:00.348)       0:00:21.086 *******
2026-03-11 23:30:45.814699 | controller-1 | ok: [controller-1] => {
2026-03-11 23:30:45.814911 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.34.0/bin/linux/amd64/kubeadm"
2026-03-11 23:30:45.815080 | controller-1 | }
2026-03-11 23:30:45.815263 | controller-1 | ok: [controller-2] => {
2026-03-11 23:30:45.815454 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.34.0/bin/linux/amd64/kubeadm"
2026-03-11 23:30:45.815671 | controller-1 | }
2026-03-11 23:30:45.815845 | controller-1 | ok: [controller-3] => {
2026-03-11 23:30:45.816034 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.34.0/bin/linux/amd64/kubeadm"
2026-03-11 23:30:45.816205 | controller-1 | }
2026-03-11 23:30:45.816369 | controller-1 |
2026-03-11 23:30:45.816559 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:30:45.816746 | controller-1 | Wednesday 11 March 2026  23:30:45 +0000 (0:00:00.076)       0:00:21.162 *******
2026-03-11 23:30:47.595348 | controller-1 | changed: [controller-1]
2026-03-11 23:30:47.595403 | controller-1 | changed: [controller-2]
2026-03-11 23:30:47.595496 | controller-1 | changed: [controller-3]
2026-03-11 23:30:47.597335 | controller-1 |
2026-03-11 23:30:47.597365 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:30:47.597461 | controller-1 | Wednesday 11 March 2026  23:30:47 +0000 (0:00:01.778)       0:00:22.941 *******
2026-03-11 23:30:47.687798 | controller-1 | skipping: [controller-1]
2026-03-11 23:30:47.687992 | controller-1 | skipping: [controller-2]
2026-03-11 23:30:47.688194 | controller-1 | skipping: [controller-3]
2026-03-11 23:30:47.688362 | controller-1 |
2026-03-11 23:30:47.688553 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-11 23:30:47.688742 | controller-1 | Wednesday 11 March 2026  23:30:47 +0000 (0:00:00.094)       0:00:23.036 *******
2026-03-11 23:30:48.027898 | controller-1 | ok: [controller-2]
2026-03-11 23:30:48.027943 | controller-1 | ok: [controller-1]
2026-03-11 23:30:48.028028 | controller-1 | ok: [controller-3]
2026-03-11 23:30:48.028120 | controller-1 |
2026-03-11 23:30:48.028201 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:30:48.030343 | controller-1 | Wednesday 11 March 2026  23:30:48 +0000 (0:00:00.338)       0:00:23.374 *******
2026-03-11 23:30:48.105729 | controller-1 | ok: [controller-1] => {
2026-03-11 23:30:48.105813 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.34.0/bin/linux/amd64/kubectl"
2026-03-11 23:30:48.106060 | controller-1 | }
2026-03-11 23:30:48.106194 | controller-1 | ok: [controller-2] => {
2026-03-11 23:30:48.106319 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.34.0/bin/linux/amd64/kubectl"
2026-03-11 23:30:48.106674 | controller-1 | }
2026-03-11 23:30:48.106779 | controller-1 | ok: [controller-3] => {
2026-03-11 23:30:48.107026 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.34.0/bin/linux/amd64/kubectl"
2026-03-11 23:30:48.107156 | controller-1 | }
2026-03-11 23:30:48.107266 | controller-1 |
2026-03-11 23:30:48.107393 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:30:48.107516 | controller-1 | Wednesday 11 March 2026  23:30:48 +0000 (0:00:00.078)       0:00:23.453 *******
2026-03-11 23:30:49.444537 | controller-1 | changed: [controller-1]
2026-03-11 23:30:49.444699 | controller-1 | changed: [controller-3]
2026-03-11 23:30:49.444917 | controller-1 | changed: [controller-2]
2026-03-11 23:30:49.445091 | controller-1 |
2026-03-11 23:30:49.445285 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:30:49.445478 | controller-1 | Wednesday 11 March 2026  23:30:49 +0000 (0:00:01.338)       0:00:24.792 *******
2026-03-11 23:30:49.558491 | controller-1 | skipping: [controller-1]
2026-03-11 23:30:49.558557 | controller-1 | skipping: [controller-2]
2026-03-11 23:30:49.558672 | controller-1 | skipping: [controller-3]
2026-03-11 23:30:49.558781 | controller-1 |
2026-03-11 23:30:49.558908 | controller-1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-11 23:30:49.559036 | controller-1 | Wednesday 11 March 2026  23:30:49 +0000 (0:00:00.114)       0:00:24.906 *******
2026-03-11 23:30:49.624971 | controller-1 | skipping: [controller-1]
2026-03-11 23:30:49.625119 | controller-1 | skipping: [controller-2]
2026-03-11 23:30:49.625297 | controller-1 | skipping: [controller-3]
2026-03-11 23:30:49.625464 | controller-1 |
2026-03-11 23:30:49.625654 | controller-1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-11 23:30:49.625843 | controller-1 | Wednesday 11 March 2026  23:30:49 +0000 (0:00:00.066)       0:00:24.973 *******
2026-03-11 23:30:49.686857 | controller-1 | skipping: [controller-1]
2026-03-11 23:30:49.687035 | controller-1 | skipping: [controller-2]
2026-03-11 23:30:49.687214 | controller-1 | skipping: [controller-3]
2026-03-11 23:30:49.687407 | controller-1 |
2026-03-11 23:30:49.687640 | controller-1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-11 23:30:49.687838 | controller-1 | Wednesday 11 March 2026  23:30:49 +0000 (0:00:00.061)       0:00:25.034 *******
2026-03-11 23:30:49.750440 | controller-1 | skipping: [controller-1]
2026-03-11 23:30:49.750639 | controller-1 | skipping: [controller-2]
2026-03-11 23:30:49.750811 | controller-1 | skipping: [controller-3]
2026-03-11 23:30:49.750975 | controller-1 |
2026-03-11 23:30:49.751164 | controller-1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-11 23:30:49.751342 | controller-1 | Wednesday 11 March 2026  23:30:49 +0000 (0:00:00.063)       0:00:25.098 *******
2026-03-11 23:30:50.636007 | controller-1 | ok: [controller-3]
2026-03-11 23:30:50.636173 | controller-1 | ok: [controller-2]
2026-03-11 23:30:50.636364 | controller-1 | ok: [controller-1]
2026-03-11 23:30:50.636534 | controller-1 |
2026-03-11 23:30:50.636741 | controller-1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-11 23:30:50.636923 | controller-1 | Wednesday 11 March 2026  23:30:50 +0000 (0:00:00.885)       0:00:25.983 *******
2026-03-11 23:30:51.324046 | controller-1 | ok: [controller-2]
2026-03-11 23:30:51.324194 | controller-1 | ok: [controller-1]
2026-03-11 23:30:51.324391 | controller-1 | ok: [controller-3]
2026-03-11 23:30:51.324552 | controller-1 |
2026-03-11 23:30:51.324743 | controller-1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-11 23:30:51.324935 | controller-1 | Wednesday 11 March 2026  23:30:51 +0000 (0:00:00.688)       0:00:26.671 *******
2026-03-11 23:30:52.763209 | controller-1 | ok: [controller-1] => (item={'path': '/etc/containerd'})
2026-03-11 23:30:52.763292 | controller-1 | ok: [controller-2] => (item={'path': '/etc/containerd'})
2026-03-11 23:30:52.763400 | controller-1 | ok: [controller-3] => (item={'path': '/etc/containerd'})
2026-03-11 23:30:52.763528 | controller-1 | ok: [controller-1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-11 23:30:52.763719 | controller-1 | ok: [controller-2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-11 23:30:52.763849 | controller-1 | ok: [controller-3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-11 23:30:52.763964 | controller-1 | ok: [controller-1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-11 23:30:52.764107 | controller-1 | ok: [controller-3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-11 23:30:52.764211 | controller-1 | ok: [controller-2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-11 23:30:52.764342 | controller-1 | ok: [controller-1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-11 23:30:52.764470 | controller-1 | ok: [controller-2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-11 23:30:52.764595 | controller-1 | ok: [controller-3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-11 23:30:52.764756 | controller-1 | ok: [controller-1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-11 23:30:52.764888 | controller-1 | ok: [controller-3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-11 23:30:52.765021 | controller-1 | ok: [controller-2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-11 23:30:52.765131 | controller-1 |
2026-03-11 23:30:52.765281 | controller-1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-11 23:30:52.765377 | controller-1 | Wednesday 11 March 2026  23:30:52 +0000 (0:00:01.439)       0:00:28.111 *******
2026-03-11 23:30:53.593011 | controller-1 | ok: [controller-1]
2026-03-11 23:30:53.593165 | controller-1 | ok: [controller-3]
2026-03-11 23:30:53.593343 | controller-1 | ok: [controller-2]
2026-03-11 23:30:53.593510 | controller-1 |
2026-03-11 23:30:53.593700 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-11 23:30:53.593890 | controller-1 | Wednesday 11 March 2026  23:30:53 +0000 (0:00:00.814)       0:00:28.925 *******
2026-03-11 23:30:53.594473 | controller-1 |
2026-03-11 23:30:53.594677 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-11 23:30:53.594868 | controller-1 | Wednesday 11 March 2026  23:30:53 +0000 (0:00:00.006)       0:00:28.931 *******
2026-03-11 23:30:53.595092 | controller-1 |
2026-03-11 23:30:53.595287 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-11 23:30:53.595476 | controller-1 | Wednesday 11 March 2026  23:30:53 +0000 (0:00:00.004)       0:00:28.936 *******
2026-03-11 23:30:53.595670 | controller-1 |
2026-03-11 23:30:53.595857 | controller-1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-11 23:30:53.596040 | controller-1 | Wednesday 11 March 2026  23:30:53 +0000 (0:00:00.005)       0:00:28.941 *******
2026-03-11 23:30:54.164863 | controller-1 | ok: [controller-1]
2026-03-11 23:30:54.164902 | controller-1 | ok: [controller-3]
2026-03-11 23:30:54.165159 | controller-1 | ok: [controller-2]
2026-03-11 23:30:54.165403 | controller-1 |
2026-03-11 23:30:54.165659 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-11 23:30:54.165905 | controller-1 | Wednesday 11 March 2026  23:30:54 +0000 (0:00:00.570)       0:00:29.512 *******
2026-03-11 23:30:54.515849 | controller-1 | ok: [controller-1]
2026-03-11 23:30:54.516048 | controller-1 | ok: [controller-3]
2026-03-11 23:30:54.516239 | controller-1 | ok: [controller-2]
2026-03-11 23:30:54.516455 | controller-1 |
2026-03-11 23:30:54.516649 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:30:54.516922 | controller-1 | Wednesday 11 March 2026  23:30:54 +0000 (0:00:00.349)       0:00:29.862 *******
2026-03-11 23:30:54.609288 | controller-1 | ok: [controller-1] => {
2026-03-11 23:30:54.609490 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/crictl-v1.34.0-linux-amd64.tar.gz"
2026-03-11 23:30:54.609674 | controller-1 | }
2026-03-11 23:30:54.609864 | controller-1 | ok: [controller-2] => {
2026-03-11 23:30:54.610064 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/crictl-v1.34.0-linux-amd64.tar.gz"
2026-03-11 23:30:54.610239 | controller-1 | }
2026-03-11 23:30:54.610422 | controller-1 | ok: [controller-3] => {
2026-03-11 23:30:54.610619 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/crictl-v1.34.0-linux-amd64.tar.gz"
2026-03-11 23:30:54.610793 | controller-1 | }
2026-03-11 23:30:54.610953 | controller-1 |
2026-03-11 23:30:54.611143 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:30:54.611327 | controller-1 | Wednesday 11 March 2026  23:30:54 +0000 (0:00:00.095)       0:00:29.957 *******
2026-03-11 23:30:55.070898 | controller-1 | ok: [controller-1]
2026-03-11 23:30:55.071122 | controller-1 | ok: [controller-2]
2026-03-11 23:30:55.071370 | controller-1 | ok: [controller-3]
2026-03-11 23:30:55.071643 | controller-1 |
2026-03-11 23:30:55.071918 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:30:55.072159 | controller-1 | Wednesday 11 March 2026  23:30:55 +0000 (0:00:00.461)       0:00:30.418 *******
2026-03-11 23:30:56.529408 | controller-1 | ok: [controller-3]
2026-03-11 23:30:56.529601 | controller-1 | ok: [controller-2]
2026-03-11 23:30:56.529787 | controller-1 | ok: [controller-1]
2026-03-11 23:30:56.529960 | controller-1 |
2026-03-11 23:30:56.530157 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:30:56.530347 | controller-1 | Wednesday 11 March 2026  23:30:56 +0000 (0:00:01.459)       0:00:31.877 *******
2026-03-11 23:30:56.624551 | controller-1 | ok: [controller-1] => {
2026-03-11 23:30:56.624767 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/critest-v1.34.0-linux-amd64.tar.gz"
2026-03-11 23:30:56.624954 | controller-1 | }
2026-03-11 23:30:56.625142 | controller-1 | ok: [controller-2] => {
2026-03-11 23:30:56.625340 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/critest-v1.34.0-linux-amd64.tar.gz"
2026-03-11 23:30:56.625516 | controller-1 | }
2026-03-11 23:30:56.625688 | controller-1 | ok: [controller-3] => {
2026-03-11 23:30:56.625880 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/critest-v1.34.0-linux-amd64.tar.gz"
2026-03-11 23:30:56.626055 | controller-1 | }
2026-03-11 23:30:56.626220 | controller-1 |
2026-03-11 23:30:56.626412 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:30:56.626598 | controller-1 | Wednesday 11 March 2026  23:30:56 +0000 (0:00:00.094)       0:00:31.972 *******
2026-03-11 23:30:57.142138 | controller-1 | ok: [controller-1]
2026-03-11 23:30:57.142411 | controller-1 | ok: [controller-3]
2026-03-11 23:30:57.142656 | controller-1 | ok: [controller-2]
2026-03-11 23:30:57.142851 | controller-1 |
2026-03-11 23:30:57.143070 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:30:57.143280 | controller-1 | Wednesday 11 March 2026  23:30:57 +0000 (0:00:00.517)       0:00:32.489 *******
2026-03-11 23:30:58.561925 | controller-1 | ok: [controller-3]
2026-03-11 23:30:58.562096 | controller-1 | ok: [controller-2]
2026-03-11 23:30:58.562284 | controller-1 | ok: [controller-1]
2026-03-11 23:30:58.562461 | controller-1 |
2026-03-11 23:30:58.562664 | controller-1 | TASK [vexxhost.containers.cri_tools : Create crictl config] ********************
2026-03-11 23:30:58.562858 | controller-1 | Wednesday 11 March 2026  23:30:58 +0000 (0:00:01.420)       0:00:33.910 *******
2026-03-11 23:30:59.238431 | controller-1 | ok: [controller-2]
2026-03-11 23:30:59.238475 | controller-1 | ok: [controller-1]
2026-03-11 23:30:59.238570 | controller-1 | ok: [controller-3]
2026-03-11 23:30:59.238650 | controller-1 |
2026-03-11 23:30:59.238744 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/opt/cni/bin)] *********
2026-03-11 23:30:59.239592 | controller-1 | Wednesday 11 March 2026  23:30:59 +0000 (0:00:00.674)       0:00:34.584 *******
2026-03-11 23:30:59.593312 | controller-1 | ok: [controller-1]
2026-03-11 23:30:59.593349 | controller-1 | ok: [controller-2]
2026-03-11 23:30:59.593357 | controller-1 | ok: [controller-3]
2026-03-11 23:30:59.593365 | controller-1 |
2026-03-11 23:30:59.593373 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-11 23:30:59.593381 | controller-1 | Wednesday 11 March 2026  23:30:59 +0000 (0:00:00.355)       0:00:34.940 *******
2026-03-11 23:30:59.922201 | controller-1 | ok: [controller-1]
2026-03-11 23:30:59.922550 | controller-1 | ok: [controller-2]
2026-03-11 23:30:59.922807 | controller-1 | ok: [controller-3]
2026-03-11 23:30:59.923047 | controller-1 |
2026-03-11 23:30:59.923308 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:30:59.923599 | controller-1 | Wednesday 11 March 2026  23:30:59 +0000 (0:00:00.329)       0:00:35.270 *******
2026-03-11 23:31:00.019100 | controller-1 | ok: [controller-1] => {
2026-03-11 23:31:00.019393 | controller-1 |     "msg": "https://github.com/containernetworking/plugins/releases/download/v1.8.0/cni-plugins-linux-amd64-v1.8.0.tgz"
2026-03-11 23:31:00.019673 | controller-1 | }
2026-03-11 23:31:00.019924 | controller-1 | ok: [controller-2] => {
2026-03-11 23:31:00.020182 | controller-1 |     "msg": "https://github.com/containernetworking/plugins/releases/download/v1.8.0/cni-plugins-linux-amd64-v1.8.0.tgz"
2026-03-11 23:31:00.020420 | controller-1 | }
2026-03-11 23:31:00.020662 | controller-1 | ok: [controller-3] => {
2026-03-11 23:31:00.020916 | controller-1 |     "msg": "https://github.com/containernetworking/plugins/releases/download/v1.8.0/cni-plugins-linux-amd64-v1.8.0.tgz"
2026-03-11 23:31:00.021147 | controller-1 | }
2026-03-11 23:31:00.021372 | controller-1 |
2026-03-11 23:31:00.021619 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:31:00.021860 | controller-1 | Wednesday 11 March 2026  23:31:00 +0000 (0:00:00.096)       0:00:35.367 *******
2026-03-11 23:31:00.506038 | controller-1 | ok: [controller-1]
2026-03-11 23:31:00.506332 | controller-1 | ok: [controller-3]
2026-03-11 23:31:00.506584 | controller-1 | ok: [controller-2]
2026-03-11 23:31:00.506850 | controller-1 |
2026-03-11 23:31:00.507113 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:31:00.507368 | controller-1 | Wednesday 11 March 2026  23:31:00 +0000 (0:00:00.486)       0:00:35.854 *******
2026-03-11 23:31:02.854686 | controller-1 | ok: [controller-1]
2026-03-11 23:31:02.855446 | controller-1 | ok: [controller-3]
2026-03-11 23:31:02.855459 | controller-1 | ok: [controller-2]
2026-03-11 23:31:02.855465 | controller-1 |
2026-03-11 23:31:02.855471 | controller-1 | TASK [vexxhost.containers.cni_plugins : Gather variables for each operating system] ***
2026-03-11 23:31:02.855476 | controller-1 | Wednesday 11 March 2026  23:31:02 +0000 (0:00:02.348)       0:00:38.203 *******
2026-03-11 23:31:02.933999 | controller-1 | ok: [controller-1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers/roles/cni_plugins/vars/debian.yml)
2026-03-11 23:31:02.934322 | controller-1 | ok: [controller-2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers/roles/cni_plugins/vars/debian.yml)
2026-03-11 23:31:02.934671 | controller-1 | ok: [controller-3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers/roles/cni_plugins/vars/debian.yml)
2026-03-11 23:31:02.934902 | controller-1 |
2026-03-11 23:31:02.935149 | controller-1 | TASK [vexxhost.containers.cni_plugins : Install additional packages] ***********
2026-03-11 23:31:02.935388 | controller-1 | Wednesday 11 March 2026  23:31:02 +0000 (0:00:00.079)       0:00:38.282 *******
2026-03-11 23:31:03.842540 | controller-1 | ok: [controller-2]
2026-03-11 23:31:03.842815 | controller-1 | ok: [controller-3]
2026-03-11 23:31:03.843047 | controller-1 | ok: [controller-1]
2026-03-11 23:31:03.843264 | controller-1 |
2026-03-11 23:31:03.843505 | controller-1 | TASK [vexxhost.containers.cni_plugins : Ensure IPv6 is enabled] ****************
2026-03-11 23:31:03.843789 | controller-1 | Wednesday 11 March 2026  23:31:03 +0000 (0:00:00.908)       0:00:39.190 *******
2026-03-11 23:31:04.315130 | controller-1 | ok: [controller-3]
2026-03-11 23:31:04.315404 | controller-1 | ok: [controller-1]
2026-03-11 23:31:04.315687 | controller-1 | ok: [controller-2]
2026-03-11 23:31:04.315909 | controller-1 |
2026-03-11 23:31:04.316150 | controller-1 | TASK [vexxhost.containers.cni_plugins : Enable kernel modules on-boot] *********
2026-03-11 23:31:04.316406 | controller-1 | Wednesday 11 March 2026  23:31:04 +0000 (0:00:00.472)       0:00:39.662 *******
2026-03-11 23:31:04.987449 | controller-1 | ok: [controller-1]
2026-03-11 23:31:04.987703 | controller-1 | ok: [controller-2]
2026-03-11 23:31:04.987872 | controller-1 | ok: [controller-3]
2026-03-11 23:31:04.988026 | controller-1 |
2026-03-11 23:31:04.988193 | controller-1 | TASK [vexxhost.containers.cni_plugins : Enable kernel modules in runtime] ******
2026-03-11 23:31:04.988358 | controller-1 | Wednesday 11 March 2026  23:31:04 +0000 (0:00:00.672)       0:00:40.335 *******
2026-03-11 23:31:06.267652 | controller-1 | ok: [controller-1] => (item=br_netfilter)
2026-03-11 23:31:06.267726 | controller-1 | ok: [controller-3] => (item=br_netfilter)
2026-03-11 23:31:06.267746 | controller-1 | ok: [controller-2] => (item=br_netfilter)
2026-03-11 23:31:06.267937 | controller-1 | ok: [controller-3] => (item=ip_tables)
2026-03-11 23:31:06.268124 | controller-1 | ok: [controller-1] => (item=ip_tables)
2026-03-11 23:31:06.268313 | controller-1 | ok: [controller-2] => (item=ip_tables)
2026-03-11 23:31:06.268498 | controller-1 | ok: [controller-1] => (item=ip6_tables)
2026-03-11 23:31:06.268711 | controller-1 | ok: [controller-3] => (item=ip6_tables)
2026-03-11 23:31:06.268889 | controller-1 | ok: [controller-2] => (item=ip6_tables)
2026-03-11 23:31:06.269071 | controller-1 | ok: [controller-1] => (item=nf_conntrack)
2026-03-11 23:31:06.269254 | controller-1 | ok: [controller-3] => (item=nf_conntrack)
2026-03-11 23:31:06.269496 | controller-1 | ok: [controller-2] => (item=nf_conntrack)
2026-03-11 23:31:06.269686 | controller-1 |
2026-03-11 23:31:06.269875 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-11 23:31:06.270065 | controller-1 | Wednesday 11 March 2026  23:31:06 +0000 (0:00:01.280)       0:00:41.615 *******
2026-03-11 23:31:06.634483 | controller-1 | ok: [controller-2]
2026-03-11 23:31:06.634622 | controller-1 | ok: [controller-1]
2026-03-11 23:31:06.634806 | controller-1 | ok: [controller-3]
2026-03-11 23:31:06.634980 | controller-1 |
2026-03-11 23:31:06.635173 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:31:06.635390 | controller-1 | Wednesday 11 March 2026  23:31:06 +0000 (0:00:00.367)       0:00:41.982 *******
2026-03-11 23:31:06.722933 | controller-1 | ok: [controller-1] => {
2026-03-11 23:31:06.723118 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.34.0/bin/linux/amd64/kubelet"
2026-03-11 23:31:06.723296 | controller-1 | }
2026-03-11 23:31:06.723632 | controller-1 | ok: [controller-2] => {
2026-03-11 23:31:06.723823 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.34.0/bin/linux/amd64/kubelet"
2026-03-11 23:31:06.723997 | controller-1 | }
2026-03-11 23:31:06.724273 | controller-1 | ok: [controller-3] => {
2026-03-11 23:31:06.724643 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.34.0/bin/linux/amd64/kubelet"
2026-03-11 23:31:06.724868 | controller-1 | }
2026-03-11 23:31:06.725038 | controller-1 |
2026-03-11 23:31:06.725231 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:31:06.725433 | controller-1 | Wednesday 11 March 2026  23:31:06 +0000 (0:00:00.088)       0:00:42.070 *******
2026-03-11 23:31:08.039259 | controller-1 | changed: [controller-2]
2026-03-11 23:31:08.039311 | controller-1 | changed: [controller-1]
2026-03-11 23:31:08.039339 | controller-1 | changed: [controller-3]
2026-03-11 23:31:08.039437 | controller-1 |
2026-03-11 23:31:08.039565 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:31:08.039658 | controller-1 | Wednesday 11 March 2026  23:31:08 +0000 (0:00:01.316)       0:00:43.387 *******
2026-03-11 23:31:08.121878 | controller-1 | skipping: [controller-1]
2026-03-11 23:31:08.122068 | controller-1 | skipping: [controller-2]
2026-03-11 23:31:08.122252 | controller-1 | skipping: [controller-3]
2026-03-11 23:31:08.122424 | controller-1 |
2026-03-11 23:31:08.122628 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Gather variables for each operating system] ***
2026-03-11 23:31:08.122816 | controller-1 | Wednesday 11 March 2026  23:31:08 +0000 (0:00:00.082)       0:00:43.470 *******
2026-03-11 23:31:08.207870 | controller-1 | ok: [controller-1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/vars/debian.yml)
2026-03-11 23:31:08.207896 | controller-1 | ok: [controller-2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/vars/debian.yml)
2026-03-11 23:31:08.207904 | controller-1 | ok: [controller-3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/vars/debian.yml)
2026-03-11 23:31:08.207912 | controller-1 |
2026-03-11 23:31:08.207989 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Install coreutils] *************************
2026-03-11 23:31:08.207999 | controller-1 | Wednesday 11 March 2026  23:31:08 +0000 (0:00:00.083)       0:00:43.553 *******
2026-03-11 23:31:08.264049 | controller-1 | skipping: [controller-1]
2026-03-11 23:31:08.264231 | controller-1 | skipping: [controller-2]
2026-03-11 23:31:08.264436 | controller-1 | skipping: [controller-3]
2026-03-11 23:31:08.264611 | controller-1 |
2026-03-11 23:31:08.264799 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Install additional packages] ***************
2026-03-11 23:31:08.264979 | controller-1 | Wednesday 11 March 2026  23:31:08 +0000 (0:00:00.058)       0:00:43.612 *******
2026-03-11 23:31:09.154570 | controller-1 | ok: [controller-2]
2026-03-11 23:31:09.154688 | controller-1 | ok: [controller-1]
2026-03-11 23:31:09.154817 | controller-1 | ok: [controller-3]
2026-03-11 23:31:09.154934 | controller-1 |
2026-03-11 23:31:09.155068 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Configure sysctl values] *******************
2026-03-11 23:31:09.155195 | controller-1 | Wednesday 11 March 2026  23:31:09 +0000 (0:00:00.890)       0:00:44.502 *******
2026-03-11 23:31:11.372602 | controller-1 | ok: [controller-3] => (item={'name': 'net.ipv4.ip_forward', 'value': 1})
2026-03-11 23:31:11.372771 | controller-1 | ok: [controller-2] => (item={'name': 'net.ipv4.ip_forward', 'value': 1})
2026-03-11 23:31:11.372979 | controller-1 | ok: [controller-1] => (item={'name': 'net.ipv4.ip_forward', 'value': 1})
2026-03-11 23:31:11.373190 | controller-1 | ok: [controller-3] => (item={'name': 'net.bridge.bridge-nf-call-iptables', 'value': 1})
2026-03-11 23:31:11.373440 | controller-1 | ok: [controller-1] => (item={'name': 'net.bridge.bridge-nf-call-iptables', 'value': 1})
2026-03-11 23:31:11.373620 | controller-1 | ok: [controller-2] => (item={'name': 'net.bridge.bridge-nf-call-iptables', 'value': 1})
2026-03-11 23:31:11.373812 | controller-1 | ok: [controller-3] => (item={'name': 'net.bridge.bridge-nf-call-ip6tables', 'value': 1})
2026-03-11 23:31:11.374019 | controller-1 | ok: [controller-1] => (item={'name': 'net.bridge.bridge-nf-call-ip6tables', 'value': 1})
2026-03-11 23:31:11.374250 | controller-1 | ok: [controller-2] => (item={'name': 'net.bridge.bridge-nf-call-ip6tables', 'value': 1})
2026-03-11 23:31:11.374450 | controller-1 | ok: [controller-1] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 0})
2026-03-11 23:31:11.374686 | controller-1 | ok: [controller-3] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 0})
2026-03-11 23:31:11.374871 | controller-1 | ok: [controller-2] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 0})
2026-03-11 23:31:11.375092 | controller-1 | ok: [controller-1] => (item={'name': 'fs.inotify.max_queued_events', 'value': 1048576})
2026-03-11 23:31:11.375280 | controller-1 | ok: [controller-3] => (item={'name': 'fs.inotify.max_queued_events', 'value': 1048576})
2026-03-11 23:31:11.375487 | controller-1 | ok: [controller-2] => (item={'name': 'fs.inotify.max_queued_events', 'value': 1048576})
2026-03-11 23:31:11.375779 | controller-1 | ok: [controller-1] => (item={'name': 'fs.inotify.max_user_instances', 'value': 8192})
2026-03-11 23:31:11.375994 | controller-1 | ok: [controller-3] => (item={'name': 'fs.inotify.max_user_instances', 'value': 8192})
2026-03-11 23:31:11.376199 | controller-1 | ok: [controller-2] => (item={'name': 'fs.inotify.max_user_instances', 'value': 8192})
2026-03-11 23:31:11.376407 | controller-1 | ok: [controller-1] => (item={'name': 'fs.inotify.max_user_watches', 'value': 1048576})
2026-03-11 23:31:11.376612 | controller-1 | ok: [controller-3] => (item={'name': 'fs.inotify.max_user_watches', 'value': 1048576})
2026-03-11 23:31:11.376817 | controller-1 | ok: [controller-2] => (item={'name': 'fs.inotify.max_user_watches', 'value': 1048576})
2026-03-11 23:31:11.376987 | controller-1 |
2026-03-11 23:31:11.377190 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Create folders for kubernetes configuration] ***
2026-03-11 23:31:11.377385 | controller-1 | Wednesday 11 March 2026  23:31:11 +0000 (0:00:02.217)       0:00:46.720 *******
2026-03-11 23:31:12.261878 | controller-1 | ok: [controller-1] => (item=/etc/systemd/system/kubelet.service.d)
2026-03-11 23:31:12.262356 | controller-1 | ok: [controller-2] => (item=/etc/systemd/system/kubelet.service.d)
2026-03-11 23:31:12.262633 | controller-1 | ok: [controller-3] => (item=/etc/systemd/system/kubelet.service.d)
2026-03-11 23:31:12.262843 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes)
2026-03-11 23:31:12.263213 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes)
2026-03-11 23:31:12.263408 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes)
2026-03-11 23:31:12.263657 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes/manifests)
2026-03-11 23:31:12.263874 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes/manifests)
2026-03-11 23:31:12.264063 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes/manifests)
2026-03-11 23:31:12.264252 | controller-1 |
2026-03-11 23:31:12.264464 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Add kubelet systemd service config] ********
2026-03-11 23:31:12.264672 | controller-1 | Wednesday 11 March 2026  23:31:12 +0000 (0:00:00.889)       0:00:47.609 *******
2026-03-11 23:31:12.950022 | controller-1 | ok: [controller-1]
2026-03-11 23:31:12.950125 | controller-1 | ok: [controller-2]
2026-03-11 23:31:12.950247 | controller-1 | ok: [controller-3]
2026-03-11 23:31:12.950362 | controller-1 |
2026-03-11 23:31:12.950500 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Add kubeadm dropin for kubelet systemd service config] ***
2026-03-11 23:31:12.950621 | controller-1 | Wednesday 11 March 2026  23:31:12 +0000 (0:00:00.688)       0:00:48.298 *******
2026-03-11 23:31:13.659413 | controller-1 | ok: [controller-1]
2026-03-11 23:31:13.659555 | controller-1 | ok: [controller-2]
2026-03-11 23:31:13.659804 | controller-1 | ok: [controller-3]
2026-03-11 23:31:13.659973 | controller-1 |
2026-03-11 23:31:13.660164 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Check swap status] *************************
2026-03-11 23:31:13.660353 | controller-1 | Wednesday 11 March 2026  23:31:13 +0000 (0:00:00.709)       0:00:49.007 *******
2026-03-11 23:31:14.082335 | controller-1 | ok: [controller-1]
2026-03-11 23:31:14.082513 | controller-1 | ok: [controller-2]
2026-03-11 23:31:14.082690 | controller-1 | ok: [controller-3]
2026-03-11 23:31:14.082869 | controller-1 |
2026-03-11 23:31:14.083078 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Disable swap] ******************************
2026-03-11 23:31:14.083260 | controller-1 | Wednesday 11 March 2026  23:31:14 +0000 (0:00:00.422)       0:00:49.430 *******
2026-03-11 23:31:14.118533 | controller-1 | [ERROR]: Task failed: Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result.
2026-03-11 23:31:14.118716 | controller-1 |
2026-03-11 23:31:14.118983 | controller-1 | Task failed.
2026-03-11 23:31:14.119274 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:78:7
2026-03-11 23:31:14.119652 | controller-1 |
2026-03-11 23:31:14.119925 | controller-1 | 76       register: kubelet_swapon
2026-03-11 23:31:14.120166 | controller-1 | 77
2026-03-11 23:31:14.120434 | controller-1 | 78     - name: Disable swap
2026-03-11 23:31:14.120635 | controller-1 |          ^ column 7
2026-03-11 23:31:14.120784 | controller-1 |
2026-03-11 23:31:14.120949 | controller-1 | <<< caused by >>>
2026-03-11 23:31:14.121096 | controller-1 |
2026-03-11 23:31:14.121283 | controller-1 | Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result.
2026-03-11 23:31:14.121454 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11
2026-03-11 23:31:14.121604 | controller-1 |
2026-03-11 23:31:14.121766 | controller-1 | 81       ignore_errors: "{{ ansible_check_mode }}"
2026-03-11 23:31:14.121922 | controller-1 | 82       when:
2026-03-11 23:31:14.122074 | controller-1 | 83         - kubelet_swapon.stdout
2026-03-11 23:31:14.122220 | controller-1 |              ^ column 11
2026-03-11 23:31:14.122356 | controller-1 |
2026-03-11 23:31:14.122533 | controller-1 | Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option.
2026-03-11 23:31:14.122679 | controller-1 |
2026-03-11 23:31:14.122955 | controller-1 | fatal: [controller-1]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result."}
2026-03-11 23:31:14.123159 | controller-1 | fatal: [controller-2]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result."}
2026-03-11 23:31:14.134154 | controller-1 | fatal: [controller-3]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result."}
2026-03-11 23:31:14.148137 | controller-1 | ...ignoring
2026-03-11 23:31:14.148248 | controller-1 | ...ignoring
2026-03-11 23:31:14.148448 | controller-1 | ...ignoring
2026-03-11 23:31:14.148534 | controller-1 |
2026-03-11 23:31:14.148818 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Remove swapfile from /etc/fstab] ***********
2026-03-11 23:31:14.149016 | controller-1 | Wednesday 11 March 2026  23:31:14 +0000 (0:00:00.066)       0:00:49.496 *******
2026-03-11 23:31:14.924146 | controller-1 | ok: [controller-1] => (item=swap)
2026-03-11 23:31:14.924344 | controller-1 | ok: [controller-3] => (item=swap)
2026-03-11 23:31:14.924560 | controller-1 | ok: [controller-2] => (item=swap)
2026-03-11 23:31:14.924727 | controller-1 | ok: [controller-1] => (item=none)
2026-03-11 23:31:14.924915 | controller-1 | ok: [controller-3] => (item=none)
2026-03-11 23:31:14.925082 | controller-1 | ok: [controller-2] => (item=none)
2026-03-11 23:31:14.925250 | controller-1 |
2026-03-11 23:31:14.925472 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Create noswap systemd service config file] ***
2026-03-11 23:31:14.925660 | controller-1 | Wednesday 11 March 2026  23:31:14 +0000 (0:00:00.775)       0:00:50.272 *******
2026-03-11 23:31:16.635568 | controller-1 | ok: [controller-1]
2026-03-11 23:31:16.635593 | controller-1 | ok: [controller-3]
2026-03-11 23:31:16.635597 | controller-1 | ok: [controller-2]
2026-03-11 23:31:16.635601 | controller-1 |
2026-03-11 23:31:16.635605 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Enable noswap service] *********************
2026-03-11 23:31:16.635609 | controller-1 | Wednesday 11 March 2026  23:31:16 +0000 (0:00:01.709)       0:00:51.981 *******
2026-03-11 23:31:17.186557 | controller-1 | ok: [controller-1]
2026-03-11 23:31:17.186596 | controller-1 | ok: [controller-2]
2026-03-11 23:31:17.186604 | controller-1 | ok: [controller-3]
2026-03-11 23:31:17.186735 | controller-1 |
2026-03-11 23:31:17.186927 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Force any restarts if necessary] ***********
2026-03-11 23:31:17.187110 | controller-1 | Wednesday 11 March 2026  23:31:17 +0000 (0:00:00.534)       0:00:52.516 *******
2026-03-11 23:31:17.187391 | controller-1 |
2026-03-11 23:31:17.187610 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Force any restarts if necessary] ***********
2026-03-11 23:31:17.187797 | controller-1 | Wednesday 11 March 2026  23:31:17 +0000 (0:00:00.007)       0:00:52.523 *******
2026-03-11 23:31:17.187959 | controller-1 |
2026-03-11 23:31:17.188143 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Force any restarts if necessary] ***********
2026-03-11 23:31:17.188324 | controller-1 | Wednesday 11 March 2026  23:31:17 +0000 (0:00:00.005)       0:00:52.528 *******
2026-03-11 23:31:17.188485 | controller-1 |
2026-03-11 23:31:17.188671 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Enable and start kubelet service] **********
2026-03-11 23:31:17.188852 | controller-1 | Wednesday 11 March 2026  23:31:17 +0000 (0:00:00.005)       0:00:52.534 *******
2026-03-11 23:31:17.721861 | controller-1 | ok: [controller-1]
2026-03-11 23:31:17.722089 | controller-1 | ok: [controller-3]
2026-03-11 23:31:17.722328 | controller-1 | ok: [controller-2]
2026-03-11 23:31:17.722539 | controller-1 |
2026-03-11 23:31:17.722784 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Ensure availability of dbus on Debian] *****
2026-03-11 23:31:17.723024 | controller-1 | Wednesday 11 March 2026  23:31:17 +0000 (0:00:00.535)       0:00:53.069 *******
2026-03-11 23:31:18.844965 | controller-1 | ok: [controller-1]
2026-03-11 23:31:18.845039 | controller-1 | ok: [controller-2]
2026-03-11 23:31:18.845051 | controller-1 | ok: [controller-3]
2026-03-11 23:31:18.845060 | controller-1 |
2026-03-11 23:31:18.845069 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Configure short hostname] ******************
2026-03-11 23:31:18.845077 | controller-1 | Wednesday 11 March 2026  23:31:18 +0000 (0:00:01.121)       0:00:54.191 *******
2026-03-11 23:31:19.790746 | controller-1 | ok: [controller-3]
2026-03-11 23:31:19.791047 | controller-1 | ok: [controller-1]
2026-03-11 23:31:19.791365 | controller-1 | ok: [controller-2]
2026-03-11 23:31:19.791696 | controller-1 |
2026-03-11 23:31:19.791981 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Ensure hostname inside hosts file] *********
2026-03-11 23:31:19.792303 | controller-1 | Wednesday 11 March 2026  23:31:19 +0000 (0:00:00.946)       0:00:55.138 *******
2026-03-11 23:31:20.217296 | controller-1 | ok: [controller-2]
2026-03-11 23:31:20.217572 | controller-1 | ok: [controller-1]
2026-03-11 23:31:20.217845 | controller-1 | ok: [controller-3]
2026-03-11 23:31:20.218065 | controller-1 |
2026-03-11 23:31:20.218306 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Remove kubernetes repository] ***********
2026-03-11 23:31:20.218543 | controller-1 | Wednesday 11 March 2026  23:31:20 +0000 (0:00:00.426)       0:00:55.565 *******
2026-03-11 23:31:20.734668 | controller-1 | ok: [controller-1]
2026-03-11 23:31:20.735092 | controller-1 | ok: [controller-2]
2026-03-11 23:31:20.735357 | controller-1 | ok: [controller-3]
2026-03-11 23:31:20.735646 | controller-1 |
2026-03-11 23:31:20.735826 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Setup control plane] ********************
2026-03-11 23:31:20.735981 | controller-1 | Wednesday 11 March 2026  23:31:20 +0000 (0:00:00.517)       0:00:56.082 *******
2026-03-11 23:31:20.856544 | controller-1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes/tasks/control-plane.yml for controller-1, controller-2, controller-3
2026-03-11 23:31:20.856802 | controller-1 |
2026-03-11 23:31:20.857183 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Bootstrap cluster] **********************
2026-03-11 23:31:20.857432 | controller-1 | Wednesday 11 March 2026  23:31:20 +0000 (0:00:00.122)       0:00:56.204 *******
2026-03-11 23:31:20.976901 | controller-1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes/tasks/bootstrap-cluster.yml for controller-1, controller-2, controller-3
2026-03-11 23:31:20.977157 | controller-1 |
2026-03-11 23:31:20.977422 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Check if any control plane is bootstrapped] ***
2026-03-11 23:31:20.977665 | controller-1 | Wednesday 11 March 2026  23:31:20 +0000 (0:00:00.120)       0:00:56.325 *******
2026-03-11 23:31:22.887783 | controller-1 | ok: [controller-2 -> controller-1(199.204.45.3)] => (item=controller-1)
2026-03-11 23:31:22.888107 | controller-1 | ok: [controller-1] => (item=controller-1)
2026-03-11 23:31:22.888366 | controller-1 | ok: [controller-3 -> controller-1(199.204.45.3)] => (item=controller-1)
2026-03-11 23:31:22.888611 | controller-1 | ok: [controller-2] => (item=controller-2)
2026-03-11 23:31:22.888858 | controller-1 | ok: [controller-1 -> controller-2(162.253.55.195)] => (item=controller-2)
2026-03-11 23:31:22.889103 | controller-1 | ok: [controller-3 -> controller-2(162.253.55.195)] => (item=controller-2)
2026-03-11 23:31:22.889348 | controller-1 | ok: [controller-1 -> controller-3(199.204.45.242)] => (item=controller-3)
2026-03-11 23:31:22.889586 | controller-1 | ok: [controller-3] => (item=controller-3)
2026-03-11 23:31:22.889834 | controller-1 | ok: [controller-2 -> controller-3(199.204.45.242)] => (item=controller-3)
2026-03-11 23:31:22.890057 | controller-1 |
2026-03-11 23:31:22.890307 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Pick node from pre-existing cluster] ****
2026-03-11 23:31:22.890546 | controller-1 | Wednesday 11 March 2026  23:31:22 +0000 (0:00:01.910)       0:00:58.235 *******
2026-03-11 23:31:22.969522 | controller-1 | ok: [controller-1]
2026-03-11 23:31:22.969806 | controller-1 | ok: [controller-2]
2026-03-11 23:31:22.970052 | controller-1 | ok: [controller-3]
2026-03-11 23:31:22.970294 | controller-1 |
2026-03-11 23:31:22.970567 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Select first node to initialize cluster] ***
2026-03-11 23:31:22.970815 | controller-1 | Wednesday 11 March 2026  23:31:22 +0000 (0:00:00.081)       0:00:58.317 *******
2026-03-11 23:31:23.038742 | controller-1 | skipping: [controller-1]
2026-03-11 23:31:23.038781 | controller-1 | skipping: [controller-2]
2026-03-11 23:31:23.038789 | controller-1 | skipping: [controller-3]
2026-03-11 23:31:23.038797 | controller-1 |
2026-03-11 23:31:23.038805 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Print selected bootstrap node] **********
2026-03-11 23:31:23.038813 | controller-1 | Wednesday 11 March 2026  23:31:23 +0000 (0:00:00.068)       0:00:58.385 *******
2026-03-11 23:31:23.111925 | controller-1 | ok: [controller-1] => {
2026-03-11 23:31:23.112288 | controller-1 |     "msg": "controller-1"
2026-03-11 23:31:23.112550 | controller-1 | }
2026-03-11 23:31:23.112775 | controller-1 | ok: [controller-2] => {
2026-03-11 23:31:23.112931 | controller-1 |     "msg": "controller-1"
2026-03-11 23:31:23.113082 | controller-1 | }
2026-03-11 23:31:23.113237 | controller-1 | ok: [controller-3] => {
2026-03-11 23:31:23.113392 | controller-1 |     "msg": "controller-1"
2026-03-11 23:31:23.113556 | controller-1 | }
2026-03-11 23:31:23.113702 | controller-1 |
2026-03-11 23:31:23.113870 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Upload cluster configuration for bootstrap node] ***
2026-03-11 23:31:23.114028 | controller-1 | Wednesday 11 March 2026  23:31:23 +0000 (0:00:00.073)       0:00:58.459 *******
2026-03-11 23:31:23.895095 | controller-1 | skipping: [controller-2]
2026-03-11 23:31:23.895117 | controller-1 | skipping: [controller-3]
2026-03-11 23:31:23.895121 | controller-1 | changed: [controller-1]
2026-03-11 23:31:23.895125 | controller-1 |
2026-03-11 23:31:23.895129 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create pki folder] **********************
2026-03-11 23:31:23.895133 | controller-1 | Wednesday 11 March 2026  23:31:23 +0000 (0:00:00.781)       0:00:59.241 *******
2026-03-11 23:31:23.961260 | controller-1 | skipping: [controller-1]
2026-03-11 23:31:23.961398 | controller-1 | skipping: [controller-2]
2026-03-11 23:31:23.961510 | controller-1 | skipping: [controller-3]
2026-03-11 23:31:23.961851 | controller-1 |
2026-03-11 23:31:23.962087 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create kubernetes ca key] ***************
2026-03-11 23:31:23.963472 | controller-1 | Wednesday 11 March 2026  23:31:23 +0000 (0:00:00.067)       0:00:59.309 *******
2026-03-11 23:31:24.028906 | controller-1 | skipping: [controller-1]
2026-03-11 23:31:24.029108 | controller-1 | skipping: [controller-2]
2026-03-11 23:31:24.029309 | controller-1 | skipping: [controller-3]
2026-03-11 23:31:24.029508 | controller-1 |
2026-03-11 23:31:24.029738 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create kubernetes ca cert] **************
2026-03-11 23:31:24.029925 | controller-1 | Wednesday 11 March 2026  23:31:24 +0000 (0:00:00.067)       0:00:59.376 *******
2026-03-11 23:31:24.104450 | controller-1 | skipping: [controller-1]
2026-03-11 23:31:24.104671 | controller-1 | skipping: [controller-2]
2026-03-11 23:31:24.104875 | controller-1 | skipping: [controller-3]
2026-03-11 23:31:24.105057 | controller-1 |
2026-03-11 23:31:24.105272 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create etcd-ca key] *********************
2026-03-11 23:31:24.105477 | controller-1 | Wednesday 11 March 2026  23:31:24 +0000 (0:00:00.075)       0:00:59.452 *******
2026-03-11 23:31:24.172141 | controller-1 | skipping: [controller-1]
2026-03-11 23:31:24.172330 | controller-1 | skipping: [controller-2]
2026-03-11 23:31:24.172521 | controller-1 | skipping: [controller-3]
2026-03-11 23:31:24.172722 | controller-1 |
2026-03-11 23:31:24.172920 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create etcd-ca cert] ********************
2026-03-11 23:31:24.173111 | controller-1 | Wednesday 11 March 2026  23:31:24 +0000 (0:00:00.068)       0:00:59.520 *******
2026-03-11 23:31:24.240400 | controller-1 | skipping: [controller-1]
2026-03-11 23:31:24.240572 | controller-1 | skipping: [controller-2]
2026-03-11 23:31:24.240808 | controller-1 | skipping: [controller-3]
2026-03-11 23:31:24.240976 | controller-1 |
2026-03-11 23:31:24.241167 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create front-proxy-ca key] **************
2026-03-11 23:31:24.241370 | controller-1 | Wednesday 11 March 2026  23:31:24 +0000 (0:00:00.068)       0:00:59.588 *******
2026-03-11 23:31:24.310476 | controller-1 | skipping: [controller-1]
2026-03-11 23:31:24.310546 | controller-1 | skipping: [controller-2]
2026-03-11 23:31:24.310634 | controller-1 | skipping: [controller-3]
2026-03-11 23:31:24.310712 | controller-1 |
2026-03-11 23:31:24.310800 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create front-proxy-ca cert] *************
2026-03-11 23:31:24.310892 | controller-1 | Wednesday 11 March 2026  23:31:24 +0000 (0:00:00.069)       0:00:59.658 *******
2026-03-11 23:31:24.377841 | controller-1 | skipping: [controller-1]
2026-03-11 23:31:24.378025 | controller-1 | skipping: [controller-2]
2026-03-11 23:31:24.378212 | controller-1 | skipping: [controller-3]
2026-03-11 23:31:24.378383 | controller-1 |
2026-03-11 23:31:24.378577 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Initialize cluster] *********************
2026-03-11 23:31:24.378765 | controller-1 | Wednesday 11 March 2026  23:31:24 +0000 (0:00:00.067)       0:00:59.725 *******
2026-03-11 23:31:24.681207 | controller-1 | ok: [controller-1]
2026-03-11 23:31:24.714243 | controller-1 | skipping: [controller-2]
2026-03-11 23:31:24.714300 | controller-1 | skipping: [controller-3]
2026-03-11 23:31:24.714435 | controller-1 |
2026-03-11 23:31:24.714568 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Check if the node is already part of the cluster] ***
2026-03-11 23:31:24.714695 | controller-1 | Wednesday 11 March 2026  23:31:24 +0000 (0:00:00.336)       0:01:00.062 *******
2026-03-11 23:31:25.051928 | controller-1 | ok: [controller-1]
2026-03-11 23:31:25.051988 | controller-1 | ok: [controller-2]
2026-03-11 23:31:25.052054 | controller-1 | ok: [controller-3]
2026-03-11 23:31:25.052132 | controller-1 |
2026-03-11 23:31:25.052223 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Join cluster] ***************************
2026-03-11 23:31:25.052313 | controller-1 | Wednesday 11 March 2026  23:31:25 +0000 (0:00:00.335)       0:01:00.398 *******
2026-03-11 23:31:25.129776 | controller-1 | skipping: [controller-1]
2026-03-11 23:31:25.129900 | controller-1 | skipping: [controller-2]
2026-03-11 23:31:25.130059 | controller-1 | skipping: [controller-3]
2026-03-11 23:31:25.130221 | controller-1 |
2026-03-11 23:31:25.130428 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create folder for admin configuration] ***
2026-03-11 23:31:25.130613 | controller-1 | Wednesday 11 March 2026  23:31:25 +0000 (0:00:00.078)       0:01:00.476 *******
2026-03-11 23:31:25.472479 | controller-1 | ok: [controller-1]
2026-03-11 23:31:25.472655 | controller-1 | ok: [controller-2]
2026-03-11 23:31:25.472851 | controller-1 | ok: [controller-3]
2026-03-11 23:31:25.473045 | controller-1 |
2026-03-11 23:31:25.473253 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Creating a symlink for admin configuration file] ***
2026-03-11 23:31:25.473531 | controller-1 | Wednesday 11 March 2026  23:31:25 +0000 (0:00:00.343)       0:01:00.819 *******
2026-03-11 23:31:25.818842 | controller-1 | ok: [controller-1]
2026-03-11 23:31:25.818866 | controller-1 | ok: [controller-2]
2026-03-11 23:31:25.818870 | controller-1 | ok: [controller-3]
2026-03-11 23:31:25.818873 | controller-1 |
2026-03-11 23:31:25.818877 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Add bash autocomplete for kubectl] ******
2026-03-11 23:31:25.818881 | controller-1 | Wednesday 11 March 2026  23:31:25 +0000 (0:00:00.345)       0:01:01.165 *******
2026-03-11 23:31:26.154126 | controller-1 | ok: [controller-2]
2026-03-11 23:31:26.154275 | controller-1 | ok: [controller-1]
2026-03-11 23:31:26.154443 | controller-1 | ok: [controller-3]
2026-03-11 23:31:26.154595 | controller-1 |
2026-03-11 23:31:26.154768 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Install PIP] ****************************
2026-03-11 23:31:26.154971 | controller-1 | Wednesday 11 March 2026  23:31:26 +0000 (0:00:00.336)       0:01:01.501 *******
2026-03-11 23:31:26.226076 | controller-1 | skipping: [controller-1]
2026-03-11 23:31:26.226346 | controller-1 | skipping: [controller-2]
2026-03-11 23:31:26.226622 | controller-1 | skipping: [controller-3]
2026-03-11 23:31:26.226875 | controller-1 |
2026-03-11 23:31:26.227191 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Install Kubernetes Python package using pip on supported systems] ***
2026-03-11 23:31:26.227515 | controller-1 | Wednesday 11 March 2026  23:31:26 +0000 (0:00:00.071)       0:01:01.573 *******
2026-03-11 23:31:26.297015 | controller-1 | skipping: [controller-1]
2026-03-11 23:31:26.297222 | controller-1 | skipping: [controller-2]
2026-03-11 23:31:26.297431 | controller-1 | skipping: [controller-3]
2026-03-11 23:31:26.297633 | controller-1 |
2026-03-11 23:31:26.297882 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Enable EPEL repository] *****************
2026-03-11 23:31:26.298121 | controller-1 | Wednesday 11 March 2026  23:31:26 +0000 (0:00:00.071)       0:01:01.644 *******
2026-03-11 23:31:26.371968 | controller-1 | skipping: [controller-1]
2026-03-11 23:31:26.372074 | controller-1 | skipping: [controller-2]
2026-03-11 23:31:26.372193 | controller-1 | skipping: [controller-3]
2026-03-11 23:31:26.372303 | controller-1 |
2026-03-11 23:31:26.372440 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Install Kubernetes Python package using package manager on supported systems] ***
2026-03-11 23:31:26.372582 | controller-1 | Wednesday 11 March 2026  23:31:26 +0000 (0:00:00.075)       0:01:01.719 *******
2026-03-11 23:31:27.351331 | controller-1 | ok: [controller-1]
2026-03-11 23:31:27.351515 | controller-1 | ok: [controller-3]
2026-03-11 23:31:27.352046 | controller-1 | ok: [controller-2]
2026-03-11 23:31:27.352289 | controller-1 |
2026-03-11 23:31:27.352508 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Allow workload on control plane node] ***
2026-03-11 23:31:27.352699 | controller-1 | Wednesday 11 March 2026  23:31:27 +0000 (0:00:00.979)       0:01:02.699 *******
2026-03-11 23:31:28.149584 | controller-1 | ok: [controller-3]
2026-03-11 23:31:28.149607 | controller-1 | ok: [controller-1]
2026-03-11 23:31:28.149611 | controller-1 | ok: [controller-2]
2026-03-11 23:31:28.149615 | controller-1 |
2026-03-11 23:31:28.149619 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Remove kube-proxy resources] ************
2026-03-11 23:31:28.149651 | controller-1 | Wednesday 11 March 2026  23:31:28 +0000 (0:00:00.797)       0:01:03.496 *******
2026-03-11 23:31:28.193237 | controller-1 | skipping: [controller-1] => (item=DaemonSet)
2026-03-11 23:31:28.193415 | controller-1 | skipping: [controller-1] => (item=ConfigMap)
2026-03-11 23:31:28.193605 | controller-1 | skipping: [controller-1]
2026-03-11 23:31:28.193775 | controller-1 |
2026-03-11 23:31:28.193970 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Start an upgrade] ***********************
2026-03-11 23:31:28.194168 | controller-1 | Wednesday 11 March 2026  23:31:28 +0000 (0:00:00.044)       0:01:03.541 *******
2026-03-11 23:35:02.496740 | controller-1 | changed: [controller-1]
2026-03-11 23:35:02.496862 | controller-1 |
2026-03-11 23:35:02.497091 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Check if the Kubernetes API services is up to date] ***
2026-03-11 23:35:02.497311 | controller-1 | Wednesday 11 March 2026  23:35:02 +0000 (0:03:34.302)       0:04:37.843 *******
2026-03-11 23:35:03.003574 | controller-1 | [ERROR]: Task failed: Module failed: non-zero return code
2026-03-11 23:35:03.003602 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes/tasks/control-plane.yml:95:7
2026-03-11 23:35:03.003606 | controller-1 |
2026-03-11 23:35:03.003611 | controller-1 | 93         kubeadm upgrade apply --v=5 --yes v{{ kubernetes_version }}
2026-03-11 23:35:03.003615 | controller-1 | 94
2026-03-11 23:35:03.003618 | controller-1 | 95     - name: Check if the Kubernetes API services is up to date
2026-03-11 23:35:03.003621 | controller-1 |          ^ column 7
2026-03-11 23:35:03.003625 | controller-1 |
2026-03-11 23:35:03.003784 | controller-1 | fatal: [controller-2]: FAILED! => {"changed": false, "cmd": ["grep", "-q", "v1.34.0", "/etc/kubernetes/manifests/kube-apiserver.yaml"], "delta": "0:00:00.007544", "end": "2026-03-11 23:35:02.958007", "msg": "non-zero return code", "rc": 1, "start": "2026-03-11 23:35:02.950463", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
2026-03-11 23:35:03.050896 | controller-1 | fatal: [controller-3]: FAILED! => {"changed": false, "cmd": ["grep", "-q", "v1.34.0", "/etc/kubernetes/manifests/kube-apiserver.yaml"], "delta": "0:00:00.007895", "end": "2026-03-11 23:35:03.014378", "msg": "non-zero return code", "rc": 1, "start": "2026-03-11 23:35:03.006483", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
2026-03-11 23:35:03.064684 | controller-1 | ok: [controller-1]
2026-03-11 23:35:03.064893 | controller-1 | ...ignoring
2026-03-11 23:35:03.065079 | controller-1 | ...ignoring
2026-03-11 23:35:03.065289 | controller-1 |
2026-03-11 23:35:03.065537 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Trigger an upgrade of the Kubernetes API services] ***
2026-03-11 23:35:03.065743 | controller-1 | Wednesday 11 March 2026  23:35:03 +0000 (0:00:00.568)       0:04:38.412 *******
2026-03-11 23:37:46.310413 | controller-1 | skipping: [controller-1]
2026-03-11 23:40:24.862119 | controller-1 | changed: [controller-2]
2026-03-11 23:40:24.862168 | controller-1 | changed: [controller-3]
2026-03-11 23:40:24.862448 | controller-1 |
2026-03-11 23:40:24.862482 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Setup nodes] ****************************
2026-03-11 23:40:24.862622 | controller-1 | Wednesday 11 March 2026  23:40:24 +0000 (0:05:21.797)       0:10:00.209 *******
2026-03-11 23:40:24.901546 | controller-1 | skipping: [controller-1]
2026-03-11 23:40:24.940027 | controller-1 | skipping: [controller-2]
2026-03-11 23:40:24.940104 | controller-1 | skipping: [controller-3]
2026-03-11 23:40:24.940221 | controller-1 |
2026-03-11 23:40:24.940351 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Upgrade & restart Kubelet node for upgrade (if needed)] ***
2026-03-11 23:40:24.940471 | controller-1 | Wednesday 11 March 2026  23:40:24 +0000 (0:00:00.078)       0:10:00.287 *******
2026-03-11 23:40:34.916607 | controller-1 | changed: [controller-1]
2026-03-11 23:40:34.926322 | controller-1 | [ERROR]: Task failed: Module failed: non-zero return code
2026-03-11 23:40:34.926348 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes/tasks/main.yml:19:3
2026-03-11 23:40:34.926353 | controller-1 |
2026-03-11 23:40:34.926357 | controller-1 | 17   ansible.builtin.include_tasks: nodes.yml
2026-03-11 23:40:34.926361 | controller-1 | 18
2026-03-11 23:40:34.926365 | controller-1 | 19 - name: Upgrade & restart Kubelet node for upgrade (if needed)
2026-03-11 23:40:34.926368 | controller-1 |      ^ column 3
2026-03-11 23:40:34.926371 | controller-1 |
2026-03-11 23:40:34.927792 | controller-1 | fatal: [controller-2]: FAILED! => {"changed": true, "cmd": ["kubeadm", "upgrade", "node"], "delta": "0:00:02.664362", "end": "2026-03-11 23:40:34.871054", "msg": "non-zero return code", "rc": 1, "start": "2026-03-11 23:40:32.206692", "stderr": "W0311 23:40:32.293827    8554 initconfiguration.go:125] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme \"unix\" to the \"criSocket\" with value \"/run/containerd/containerd.sock\". Please update your configuration!\nW0311 23:40:32.701609    8554 postupgrade.go:116] Using temporary directory /etc/kubernetes/tmp/kubeadm-kubelet-config147592040 for kubelet config. To override it set the environment variable KUBEADM_UPGRADE_DRYRUN_DIR\nerror: error execution phase kubelet-config: could not remove the CRI socket annotation from Node \"controller-2\": error patching Node \"controller-2\": Patch \"https://199.204.45.3:6443/api/v1/nodes/controller-2?timeout=10s\": unexpected EOF\nTo see the stack trace of this error execute with --v=5 or higher", "stderr_lines": ["W0311 23:40:32.293827    8554 initconfiguration.go:125] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme \"unix\" to the \"criSocket\" with value \"/run/containerd/containerd.sock\". Please update your configuration!", "W0311 23:40:32.701609    8554 postupgrade.go:116] Using temporary directory /etc/kubernetes/tmp/kubeadm-kubelet-config147592040 for kubelet config. To override it set the environment variable KUBEADM_UPGRADE_DRYRUN_DIR", "error: error execution phase kubelet-config: could not remove the CRI socket annotation from Node \"controller-2\": error patching Node \"controller-2\": Patch \"https://199.204.45.3:6443/api/v1/nodes/controller-2?timeout=10s\": unexpected EOF", "To see the stack trace of this error execute with --v=5 or higher"], "stdout": "[upgrade] Reading configuration from the \"kubeadm-config\" ConfigMap in namespace \"kube-system\"...\n[upgrade] Use 'kubeadm init phase upload-config kubeadm --config your-config-file' to re-upload it.\n[upgrade/preflight] Running pre-flight checks\n[upgrade/preflight] Pulling images required for setting up a Kubernetes cluster\n[upgrade/preflight] This might take a minute or two, depending on the speed of your internet connection\n[upgrade/preflight] You can also perform this action beforehand using 'kubeadm config images pull'\n[upgrade/control-plane] Upgrading your Static Pod-hosted control plane instance to version \"v1.34.0\"...\n[upgrade/staticpods] Writing new Static Pod manifests to \"/etc/kubernetes/tmp/kubeadm-upgraded-manifests2322931291\"\n[upgrade/staticpods] Preparing for \"etcd\" upgrade\n[upgrade/staticpods] Current and new manifests of etcd are equal, skipping upgrade\n[upgrade/etcd] Waiting for etcd to become available\n[upgrade/staticpods] Preparing for \"kube-apiserver\" upgrade\n[upgrade/staticpods] Current and new manifests of kube-apiserver are equal, skipping upgrade\n[upgrade/staticpods] Preparing for \"kube-controller-manager\" upgrade\n[upgrade/staticpods] Current and new manifests of kube-controller-manager are equal, skipping upgrade\n[upgrade/staticpods] Preparing for \"kube-scheduler\" upgrade\n[upgrade/staticpods] Current and new manifests of kube-scheduler are equal, skipping upgrade\n[upgrade/control-plane] The control plane instance for this node was successfully upgraded!\n[upgrade/kubeconfig] The kubeconfig files for this node were successfully upgraded!\n[upgrade] Backing up kubelet config file to /etc/kubernetes/tmp/kubeadm-kubelet-config147592040/config.yaml\n[patches] Applied patch of type \"application/strategic-merge-patch+json\" to target \"kubeletconfiguration\"\n[kubelet-start] Writing kubelet configuration to file \"/var/lib/kubelet/config.yaml\"", "stdout_lines": ["[upgrade] Reading configuration from the \"kubeadm-config\" ConfigMap in namespace \"kube-system\"...", "[upgrade] Use 'kubeadm init phase upload-config kubeadm --config your-config-file' to re-upload it.", "[upgrade/preflight] Running pre-flight checks", "[upgrade/preflight] Pulling images required for setting up a Kubernetes cluster", "[upgrade/preflight] This might take a minute or two, depending on the speed of your internet connection", "[upgrade/preflight] You can also perform this action beforehand using 'kubeadm config images pull'", "[upgrade/control-plane] Upgrading your Static Pod-hosted control plane instance to version \"v1.34.0\"...", "[upgrade/staticpods] Writing new Static Pod manifests to \"/etc/kubernetes/tmp/kubeadm-upgraded-manifests2322931291\"", "[upgrade/staticpods] Preparing for \"etcd\" upgrade", "[upgrade/staticpods] Current and new manifests of etcd are equal, skipping upgrade", "[upgrade/etcd] Waiting for etcd to become available", "[upgrade/staticpods] Preparing for \"kube-apiserver\" upgrade", "[upgrade/staticpods] Current and new manifests of kube-apiserver are equal, skipping upgrade", "[upgrade/staticpods] Preparing for \"kube-controller-manager\" upgrade", "[upgrade/staticpods] Current and new manifests of kube-controller-manager are equal, skipping upgrade", "[upgrade/staticpods] Preparing for \"kube-scheduler\" upgrade", "[upgrade/staticpods] Current and new manifests of kube-scheduler are equal, skipping upgrade", "[upgrade/control-plane] The control plane instance for this node was successfully upgraded!", "[upgrade/kubeconfig] The kubeconfig files for this node were successfully upgraded!", "[upgrade] Backing up kubelet config file to /etc/kubernetes/tmp/kubeadm-kubelet-config147592040/config.yaml", "[patches] Applied patch of type \"application/strategic-merge-patch+json\" to target \"kubeletconfiguration\"", "[kubelet-start] Writing kubelet configuration to file \"/var/lib/kubelet/config.yaml\""]}
2026-03-11 23:40:58.751285 | controller-1 | changed: [controller-3]
2026-03-11 23:40:58.755372 | controller-1 |
2026-03-11 23:40:58.755387 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Set node selector for CoreDNS components] ***
2026-03-11 23:40:58.755391 | controller-1 | Wednesday 11 March 2026  23:40:58 +0000 (0:00:33.811)       0:10:34.099 *******
2026-03-11 23:40:59.787198 | controller-1 | changed: [controller-1]
2026-03-11 23:40:59.787227 | controller-1 |
2026-03-11 23:40:59.787232 | controller-1 | PLAY [Install control-plane components] ****************************************
2026-03-11 23:40:59.787235 | controller-1 |
2026-03-11 23:40:59.787239 | controller-1 | TASK [Gathering Facts] *********************************************************
2026-03-11 23:40:59.787243 | controller-1 | Wednesday 11 March 2026  23:40:59 +0000 (0:00:01.036)       0:10:35.135 *******
2026-03-11 23:41:00.841033 | controller-1 | ok: [controller-3]
2026-03-11 23:41:00.841250 | controller-1 | ok: [controller-1]
2026-03-11 23:41:00.841756 | controller-1 |
2026-03-11 23:41:00.841777 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-11 23:41:00.841786 | controller-1 | Wednesday 11 March 2026  23:41:00 +0000 (0:00:01.053)       0:10:36.189 *******
2026-03-11 23:41:01.187587 | controller-1 | ok: [controller-1]
2026-03-11 23:41:01.187626 | controller-1 | ok: [controller-3]
2026-03-11 23:41:01.187632 | controller-1 |
2026-03-11 23:41:01.187638 | controller-1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-11 23:41:01.187650 | controller-1 | Wednesday 11 March 2026  23:41:01 +0000 (0:00:00.346)       0:10:36.535 *******
2026-03-11 23:41:02.149070 | controller-1 | ok: [controller-1]
2026-03-11 23:41:02.149108 | controller-1 | ok: [controller-3]
2026-03-11 23:41:02.149131 | controller-1 |
2026-03-11 23:41:02.149140 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-11 23:41:02.149147 | controller-1 | Wednesday 11 March 2026  23:41:02 +0000 (0:00:00.959)       0:10:37.495 *******
2026-03-11 23:41:02.483708 | controller-1 | ok: [controller-1]
2026-03-11 23:41:02.485160 | controller-1 | ok: [controller-3]
2026-03-11 23:41:02.485250 | controller-1 |
2026-03-11 23:41:02.485345 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:41:02.485432 | controller-1 | Wednesday 11 March 2026  23:41:02 +0000 (0:00:00.336)       0:10:37.831 *******
2026-03-11 23:41:02.537243 | controller-1 | ok: [controller-1] => {
2026-03-11 23:41:02.537353 | controller-1 |     "msg": "https://get.helm.sh/helm-v3.11.2-linux-amd64.tar.gz"
2026-03-11 23:41:02.537469 | controller-1 | }
2026-03-11 23:41:02.537590 | controller-1 | ok: [controller-3] => {
2026-03-11 23:41:02.537710 | controller-1 |     "msg": "https://get.helm.sh/helm-v3.11.2-linux-amd64.tar.gz"
2026-03-11 23:41:02.537814 | controller-1 | }
2026-03-11 23:41:02.537923 | controller-1 |
2026-03-11 23:41:02.538058 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:41:02.538174 | controller-1 | Wednesday 11 March 2026  23:41:02 +0000 (0:00:00.053)       0:10:37.885 *******
2026-03-11 23:41:02.959438 | controller-1 | ok: [controller-1]
2026-03-11 23:41:02.959692 | controller-1 | ok: [controller-3]
2026-03-11 23:41:02.959790 | controller-1 |
2026-03-11 23:41:02.960008 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:41:02.960247 | controller-1 | Wednesday 11 March 2026  23:41:02 +0000 (0:00:00.421)       0:10:38.306 *******
2026-03-11 23:41:05.413874 | controller-1 | ok: [controller-1]
2026-03-11 23:41:05.414008 | controller-1 | ok: [controller-3]
2026-03-11 23:41:05.414175 | controller-1 |
2026-03-11 23:41:05.414394 | controller-1 | TASK [vexxhost.kubernetes.helm : Remove Helm repository] ***********************
2026-03-11 23:41:05.414576 | controller-1 | Wednesday 11 March 2026  23:41:05 +0000 (0:00:02.454)       0:10:40.761 *******
2026-03-11 23:41:05.823950 | controller-1 | ok: [controller-3]
2026-03-11 23:41:05.824078 | controller-1 | ok: [controller-1]
2026-03-11 23:41:05.824245 | controller-1 |
2026-03-11 23:41:05.824445 | controller-1 | TASK [vexxhost.kubernetes.helm : Add bash autocomplete for helm] ***************
2026-03-11 23:41:05.824630 | controller-1 | Wednesday 11 March 2026  23:41:05 +0000 (0:00:00.409)       0:10:41.171 *******
2026-03-11 23:41:06.148413 | controller-1 | ok: [controller-1]
2026-03-11 23:41:06.148608 | controller-1 | ok: [controller-3]
2026-03-11 23:41:06.148781 | controller-1 |
2026-03-11 23:41:06.148980 | controller-1 | TASK [vexxhost.kubernetes.helm : Get Helm plugins dir] *************************
2026-03-11 23:41:06.149167 | controller-1 | Wednesday 11 March 2026  23:41:06 +0000 (0:00:00.324)       0:10:41.496 *******
2026-03-11 23:41:06.508772 | controller-1 | ok: [controller-1]
2026-03-11 23:41:06.508810 | controller-1 | ok: [controller-3]
2026-03-11 23:41:06.508820 | controller-1 |
2026-03-11 23:41:06.508829 | controller-1 | TASK [vexxhost.kubernetes.helm : Create Helm plugins directory if it does not exist] ***
2026-03-11 23:41:06.508837 | controller-1 | Wednesday 11 March 2026  23:41:06 +0000 (0:00:00.359)       0:10:41.855 *******
2026-03-11 23:41:06.820142 | controller-1 | ok: [controller-1]
2026-03-11 23:41:06.820206 | controller-1 | ok: [controller-3]
2026-03-11 23:41:06.820220 | controller-1 |
2026-03-11 23:41:06.820358 | controller-1 | TASK [vexxhost.kubernetes.helm : Remove Helm diff plugin installed by kubernetes.core.helm_plugin] ***
2026-03-11 23:41:06.820445 | controller-1 | Wednesday 11 March 2026  23:41:06 +0000 (0:00:00.307)       0:10:42.163 *******
2026-03-11 23:41:07.139127 | controller-1 | ok: [controller-1]
2026-03-11 23:41:07.139186 | controller-1 | ok: [controller-3]
2026-03-11 23:41:07.139240 | controller-1 |
2026-03-11 23:41:07.139328 | controller-1 | TASK [Install plugin] **********************************************************
2026-03-11 23:41:07.139414 | controller-1 | Wednesday 11 March 2026  23:41:07 +0000 (0:00:00.323)       0:10:42.486 *******
2026-03-11 23:41:07.231448 | controller-1 | included: vexxhost.containers.download_artifact for controller-1, controller-3
2026-03-11 23:41:07.231509 | controller-1 |
2026-03-11 23:41:07.231519 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-11 23:41:07.231712 | controller-1 | Wednesday 11 March 2026  23:41:07 +0000 (0:00:00.092)       0:10:42.579 *******
2026-03-11 23:41:07.298960 | controller-1 | ok: [controller-1] => {
2026-03-11 23:41:07.299003 | controller-1 |     "msg": "https://github.com/databus23/helm-diff/releases/download/v3.8.1/helm-diff-linux-amd64.tgz"
2026-03-11 23:41:07.299071 | controller-1 | }
2026-03-11 23:41:07.299152 | controller-1 | ok: [controller-3] => {
2026-03-11 23:41:07.299581 | controller-1 |     "msg": "https://github.com/databus23/helm-diff/releases/download/v3.8.1/helm-diff-linux-amd64.tgz"
2026-03-11 23:41:07.299591 | controller-1 | }
2026-03-11 23:41:07.299596 | controller-1 |
2026-03-11 23:41:07.299600 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-11 23:41:07.299603 | controller-1 | Wednesday 11 March 2026  23:41:07 +0000 (0:00:00.066)       0:10:42.645 *******
2026-03-11 23:41:07.739747 | controller-1 | ok: [controller-3]
2026-03-11 23:41:07.739942 | controller-1 | ok: [controller-1]
2026-03-11 23:41:07.740097 | controller-1 |
2026-03-11 23:41:07.740264 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-11 23:41:07.740435 | controller-1 | Wednesday 11 March 2026  23:41:07 +0000 (0:00:00.441)       0:10:43.087 *******
2026-03-11 23:41:09.399905 | controller-1 | ok: [controller-1]
2026-03-11 23:41:09.399952 | controller-1 | ok: [controller-3]
2026-03-11 23:41:09.400029 | controller-1 |
2026-03-11 23:41:09.400123 | controller-1 | TASK [vexxhost.kubernetes.upload_helm_chart : Include help chart upload method tasks] ***
2026-03-11 23:41:09.400210 | controller-1 | Wednesday 11 March 2026  23:41:09 +0000 (0:00:01.658)       0:10:44.746 *******
2026-03-11 23:41:09.498630 | controller-1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/upload_helm_chart/tasks/synchronize.yml for controller-1, controller-3
2026-03-11 23:41:09.498683 | controller-1 |
2026-03-11 23:41:09.498765 | controller-1 | TASK [vexxhost.kubernetes.upload_helm_chart : Upload Helm chart] ***************
2026-03-11 23:41:09.498860 | controller-1 | Wednesday 11 March 2026  23:41:09 +0000 (0:00:00.100)       0:10:44.847 *******
2026-03-11 23:41:10.239943 | controller-1 | ok: [controller-1]
2026-03-11 23:41:10.239994 | controller-1 |
2026-03-11 23:41:10.240085 | controller-1 | TASK [vexxhost.kubernetes.cilium : Get current Kubernetes version] *************
2026-03-11 23:41:10.240178 | controller-1 | Wednesday 11 March 2026  23:41:10 +0000 (0:00:00.739)       0:10:45.586 *******
2026-03-11 23:41:11.207628 | controller-1 | ok: [controller-1]
2026-03-11 23:41:11.208235 | controller-1 |
2026-03-11 23:41:11.208268 | controller-1 | TASK [vexxhost.kubernetes.cilium : Deploy Helm chart] **************************
2026-03-11 23:41:11.208279 | controller-1 | Wednesday 11 March 2026  23:41:11 +0000 (0:00:00.969)       0:10:46.555 *******
2026-03-11 23:41:14.052127 | controller-1 | ok: [controller-1]
2026-03-11 23:41:14.052149 | controller-1 |
2026-03-11 23:41:14.052153 | controller-1 | TASK [vexxhost.kubernetes.upload_helm_chart : Include help chart upload method tasks] ***
2026-03-11 23:41:14.052157 | controller-1 | Wednesday 11 March 2026  23:41:14 +0000 (0:00:02.842)       0:10:49.398 *******
2026-03-11 23:41:14.104677 | controller-1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/upload_helm_chart/tasks/synchronize.yml for controller-1, controller-3
2026-03-11 23:41:14.104699 | controller-1 |
2026-03-11 23:41:14.104703 | controller-1 | TASK [vexxhost.kubernetes.upload_helm_chart : Upload Helm chart] ***************
2026-03-11 23:41:14.104707 | controller-1 | Wednesday 11 March 2026  23:41:14 +0000 (0:00:00.054)       0:10:49.452 *******
2026-03-11 23:41:14.723203 | controller-1 | ok: [controller-1]
2026-03-11 23:41:14.723226 | controller-1 |
2026-03-11 23:41:14.723230 | controller-1 | TASK [vexxhost.kubernetes.envoy_gateway : Deploy Helm chart] *******************
2026-03-11 23:41:14.723234 | controller-1 | Wednesday 11 March 2026  23:41:14 +0000 (0:00:00.616)       0:10:50.069 *******
2026-03-11 23:41:16.580059 | controller-1 | ok: [controller-1]
2026-03-11 23:41:16.580108 | controller-1 |
2026-03-11 23:41:16.580245 | controller-1 | TASK [vexxhost.kubernetes.envoy_gateway : Create GatewayClass] *****************
2026-03-11 23:41:16.580369 | controller-1 | Wednesday 11 March 2026  23:41:16 +0000 (0:00:01.858)       0:10:51.927 *******
2026-03-11 23:41:17.402908 | controller-1 | ok: [controller-1]
2026-03-11 23:41:17.402943 | controller-1 |
2026-03-11 23:41:17.402952 | controller-1 | PLAY RECAP *********************************************************************
2026-03-11 23:41:17.402961 | controller-1 | controller-1               : ok=119  changed=7    unreachable=0    failed=0    skipped=28   rescued=0    ignored=1
2026-03-11 23:41:17.402969 | controller-1 | controller-2               : ok=86   changed=4    unreachable=0    failed=1    skipped=29   rescued=0    ignored=2
2026-03-11 23:41:17.402986 | controller-1 | controller-3               : ok=105  changed=5    unreachable=0    failed=0    skipped=29   rescued=0    ignored=2
2026-03-11 23:41:17.402994 | controller-1 |
2026-03-11 23:41:17.403001 | controller-1 |
2026-03-11 23:41:17.403009 | controller-1 | TASKS RECAP ********************************************************************
2026-03-11 23:41:17.403016 | controller-1 | Wednesday 11 March 2026  23:41:17 +0000 (0:00:00.818)       0:10:52.746 *******
2026-03-11 23:41:17.403023 | controller-1 | ===============================================================================
2026-03-11 23:41:17.403030 | controller-1 | vexxhost.kubernetes.kubernetes : Trigger an upgrade of the Kubernetes API services - 321.80s
2026-03-11 23:41:17.403037 | controller-1 | vexxhost.kubernetes.kubernetes : Start an upgrade --------------------- 214.30s
2026-03-11 23:41:17.403045 | controller-1 | vexxhost.kubernetes.kubernetes : Upgrade & restart Kubelet node for upgrade (if needed) -- 33.81s
2026-03-11 23:41:17.403052 | controller-1 | vexxhost.kubernetes.cilium : Deploy Helm chart -------------------------- 2.84s
2026-03-11 23:41:17.403059 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.45s
2026-03-11 23:41:17.403279 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.35s
2026-03-11 23:41:17.403595 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.33s
2026-03-11 23:41:17.403903 | controller-1 | Gathering Facts --------------------------------------------------------- 2.26s
2026-03-11 23:41:17.404252 | controller-1 | vexxhost.kubernetes.kubelet : Configure sysctl values ------------------- 2.22s
2026-03-11 23:41:17.404497 | controller-1 | vexxhost.kubernetes.kubernetes : Check if any control plane is bootstrapped --- 1.91s
2026-03-11 23:41:17.404743 | controller-1 | vexxhost.kubernetes.envoy_gateway : Deploy Helm chart ------------------- 1.86s
2026-03-11 23:41:17.404983 | controller-1 | vexxhost.containers.download_artifact : Download item ------------------- 1.78s
2026-03-11 23:41:17.405228 | controller-1 | vexxhost.kubernetes.kubelet : Create noswap systemd service config file --- 1.71s
2026-03-11 23:41:17.405463 | controller-1 | vexxhost.containers.containerd : Enable and start service --------------- 1.70s
2026-03-11 23:41:17.405696 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.66s
2026-03-11 23:41:17.405942 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.46s
2026-03-11 23:41:17.406178 | controller-1 | vexxhost.containers.containerd : Create folders for configuration ------- 1.45s
2026-03-11 23:41:17.406412 | controller-1 | vexxhost.containers.containerd : Create folders for configuration ------- 1.44s
2026-03-11 23:41:17.406645 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.42s
2026-03-11 23:41:17.406885 | controller-1 | vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack ---------------- 1.42s
2026-03-11 23:41:17.561874 | controller-1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.Bs5j.cluster-upgrade/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/extensions/molecule/cluster-upgrade/converge.yml
2026-03-11 23:41:17.562110 | controller-1 | ERROR    [cluster-upgrade > converge] Executed: Failed
2026-03-11 23:41:17.562274 | controller-1 | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.Bs5j.cluster-upgrade/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/extensions/molecule/cluster-upgrade/converge.yml
2026-03-11 23:41:18.061820 | controller-1 | ERROR
2026-03-11 23:41:18.062146 | controller-1 | {
2026-03-11 23:41:18.062212 | controller-1 |   "delta": "0:16:02.806913",
2026-03-11 23:41:18.062274 | controller-1 |   "end": "2026-03-11 23:41:17.645744",
2026-03-11 23:41:18.062327 | controller-1 |   "msg": "non-zero return code",
2026-03-11 23:41:18.062378 | controller-1 |   "rc": 2,
2026-03-11 23:41:18.062435 | controller-1 |   "start": "2026-03-11 23:25:14.838831"
2026-03-11 23:41:18.062472 | controller-1 | }
failure
2026-03-11 23:41:18.085117 | 
2026-03-11 23:41:18.085166 | PLAY RECAP
2026-03-11 23:41:18.085210 | controller-1 | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-03-11 23:41:18.085232 | 
2026-03-11 23:41:18.206080 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-11 23:41:18.212386 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-11 23:41:18.841032 | 
2026-03-11 23:41:18.841189 | PLAY [all]
2026-03-11 23:41:18.852478 | 
2026-03-11 23:41:18.852551 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-11 23:41:18.910503 | controller-1 | ok
2026-03-11 23:41:18.916001 | controller-2 | ok
2026-03-11 23:41:18.920004 | controller-3 | ok
2026-03-11 23:41:18.924373 | 
2026-03-11 23:41:18.924468 | TASK [fetch-output : Set log path for single node]
2026-03-11 23:41:18.955043 | controller-1 | skipping: Conditional result was False
2026-03-11 23:41:18.966416 | controller-2 | skipping: Conditional result was False
2026-03-11 23:41:18.966864 | controller-3 | skipping: Conditional result was False
2026-03-11 23:41:18.974206 | 
2026-03-11 23:41:18.974300 | LOOP [fetch-output : Ensure local output dirs]
2026-03-11 23:41:19.358605 | controller-2 -> localhost | changed: "/var/lib/zuul/builds/d29727a84a3048eb896d3409f707b006/work/logs/controller-2"
2026-03-11 23:41:19.376100 | controller-3 -> localhost | changed: "/var/lib/zuul/builds/d29727a84a3048eb896d3409f707b006/work/logs/controller-3"
2026-03-11 23:41:19.377680 | controller-1 -> localhost | changed: "/var/lib/zuul/builds/d29727a84a3048eb896d3409f707b006/work/logs/controller-1"
2026-03-11 23:41:19.577290 | controller-3 -> localhost | ok: "/var/lib/zuul/builds/d29727a84a3048eb896d3409f707b006/work/artifacts"
2026-03-11 23:41:19.579853 | controller-2 -> localhost | changed: "/var/lib/zuul/builds/d29727a84a3048eb896d3409f707b006/work/artifacts"
2026-03-11 23:41:19.587980 | controller-1 -> localhost | ok: "/var/lib/zuul/builds/d29727a84a3048eb896d3409f707b006/work/artifacts"
2026-03-11 23:41:19.787235 | controller-3 -> localhost | changed: "/var/lib/zuul/builds/d29727a84a3048eb896d3409f707b006/work/docs"
2026-03-11 23:41:19.788701 | controller-2 -> localhost | ok: "/var/lib/zuul/builds/d29727a84a3048eb896d3409f707b006/work/docs"
2026-03-11 23:41:19.831308 | controller-1 -> localhost | ok: "/var/lib/zuul/builds/d29727a84a3048eb896d3409f707b006/work/docs"
2026-03-11 23:41:19.831437 | controller-1 -> localhost | changed: All items complete
2026-03-11 23:41:19.831492 | 
2026-03-11 23:41:19.844793 | 
2026-03-11 23:41:19.844986 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-11 23:41:20.483173 | controller-1 | changed: .d..t...... ./
2026-03-11 23:41:20.489138 | controller-3 | changed: .d..t...... ./
2026-03-11 23:41:20.512660 | controller-2 | changed: .d..t...... ./
2026-03-11 23:41:20.949434 | controller-3 | changed: .d..t...... ./
2026-03-11 23:41:20.966716 | controller-1 | ok
2026-03-11 23:41:21.013780 | controller-2 | ok
2026-03-11 23:41:21.426268 | controller-3 | changed: .d..t...... ./
2026-03-11 23:41:21.437469 | controller-1 | ok
2026-03-11 23:41:21.502434 | controller-2 | ok
2026-03-11 23:41:21.502516 | controller-2 | changed: All items complete
2026-03-11 23:41:21.502550 | 
2026-03-11 23:41:21.527392 | 
2026-03-11 23:41:21.527531 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-03-11 23:41:21.970238 | controller-1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008921
2026-03-11 23:41:22.204516 | controller-1 -> localhost | ok: Item: docs Runtime: 0:00:00.007784
2026-03-11 23:41:22.232536 | 
2026-03-11 23:41:22.232604 | PLAY [all]
2026-03-11 23:41:22.237671 | 
2026-03-11 23:41:22.237733 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-03-11 23:41:22.694935 | controller-1 | changed
2026-03-11 23:41:22.915308 | controller-2 | changed
2026-03-11 23:41:22.932252 | controller-3 | changed
2026-03-11 23:41:22.944478 | 
2026-03-11 23:41:22.944529 | PLAY RECAP
2026-03-11 23:41:22.944573 | controller-1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-11 23:41:22.944601 | controller-2 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-11 23:41:22.944626 | controller-3 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-11 23:41:22.944644 | 
2026-03-11 23:41:23.071575 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-11 23:41:23.076677 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-03-11 23:41:23.614682 | 
2026-03-11 23:41:23.614812 | PLAY [localhost]
2026-03-11 23:41:23.624775 | 
2026-03-11 23:41:23.624847 | TASK [Generate Zuul manifest]
2026-03-11 23:41:23.646177 | localhost | ok
2026-03-11 23:41:23.661818 | 
2026-03-11 23:41:23.661894 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-03-11 23:41:24.046768 | localhost | changed
2026-03-11 23:41:24.058086 | 
2026-03-11 23:41:24.058160 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-03-11 23:41:24.089135 | localhost | ok
2026-03-11 23:41:24.098895 | 
2026-03-11 23:41:24.098978 | TASK [Upload logs]
2026-03-11 23:41:24.119831 | localhost | ok
2026-03-11 23:41:24.176766 | 
2026-03-11 23:41:24.176851 | TASK [Set zuul-log-path fact]
2026-03-11 23:41:24.197757 | localhost | ok
2026-03-11 23:41:24.212668 | 
2026-03-11 23:41:24.212732 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-11 23:41:24.243764 | localhost | ok
2026-03-11 23:41:24.254862 | 
2026-03-11 23:41:24.254927 | TASK [upload-logs : Create log directories]
2026-03-11 23:41:24.650890 | localhost | changed
2026-03-11 23:41:24.660047 | 
2026-03-11 23:41:24.660114 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-03-11 23:41:25.057518 | localhost -> localhost | ok: Runtime: 0:00:00.005584
2026-03-11 23:41:25.065015 | 
2026-03-11 23:41:25.065078 | TASK [upload-logs : Upload logs to log server]
2026-03-11 23:41:25.506338 | localhost | Output suppressed because no_log was given
2026-03-11 23:41:25.509960 | 
2026-03-11 23:41:25.510026 | LOOP [upload-logs : Compress console log and json output]
2026-03-11 23:41:25.555676 | localhost | skipping: Conditional result was False
2026-03-11 23:41:25.562966 | localhost | skipping: Conditional result was False
2026-03-11 23:41:25.575769 | 
2026-03-11 23:41:25.576034 | LOOP [upload-logs : Upload compressed console log and json output]
2026-03-11 23:41:25.617880 | localhost | skipping: Conditional result was False
2026-03-11 23:41:25.618241 | 
2026-03-11 23:41:25.622052 | localhost | skipping: Conditional result was False
2026-03-11 23:41:25.629868 | 
2026-03-11 23:41:25.630054 | LOOP [upload-logs : Upload console log and json output]