2026-09-08 22:43:55.576885 | Job console starting
2026-09-08 22:43:55.588885 | Updating git repos
2026-09-08 22:44:00.472148 | Cloning repos into workspace
2026-09-08 22:44:16.508821 | Restoring repo states
2026-09-08 22:44:26.121445 | Merging changes
2026-09-08 22:44:27.483279 | Checking out repos
2026-09-08 22:44:29.445535 | Preparing playbooks
2026-09-08 22:44:31.729481 | Running Ansible setup
2026-09-08 22:44:35.443647 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-09-08 22:44:36.137011 | 
2026-09-08 22:44:36.137186 | PLAY [localhost]
2026-09-08 22:44:36.146059 | 
2026-09-08 22:44:36.146156 | TASK [Gathering Facts]
2026-09-08 22:44:37.166104 | localhost | ok
2026-09-08 22:44:37.172155 | 
2026-09-08 22:44:37.172224 | TASK [Setup log path fact]
2026-09-08 22:44:37.190970 | localhost | ok
2026-09-08 22:44:37.200701 | 
2026-09-08 22:44:37.200769 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-09-08 22:44:37.237343 | localhost | ok
2026-09-08 22:44:37.243515 | 
2026-09-08 22:44:37.243596 | TASK [emit-job-header : Print job information]
2026-09-08 22:44:37.292289 | # Job Information
2026-09-08 22:44:37.292543 | Ansible Version: 2.16.18
2026-09-08 22:44:37.292603 | Job: atmosphere-molecule-csi-rbd
2026-09-08 22:44:37.292634 | Pipeline: check
2026-09-08 22:44:37.292660 | Executor: 2d72f0692154
2026-09-08 22:44:37.292685 | Triggered by: https://github.com/vexxhost/atmosphere/pull/4092
2026-09-08 22:44:37.292714 | Event ID: 29a53540-abd6-11f1-8396-acece912b4bf
2026-09-08 22:44:37.296511 | 
2026-09-08 22:44:37.296630 | LOOP [emit-job-header : Print node information]
2026-09-08 22:44:37.404966 | localhost | ok:
2026-09-08 22:44:37.405293 | localhost | # Node Information
2026-09-08 22:44:37.405362 | localhost | Inventory Hostname: instance
2026-09-08 22:44:37.405473 | localhost | Hostname: np0000192274
2026-09-08 22:44:37.405524 | localhost | Username: zuul
2026-09-08 22:44:37.405643 | localhost | Distro: Ubuntu 22.04
2026-09-08 22:44:37.405895 | localhost | Provider: yul1
2026-09-08 22:44:37.405955 | localhost | Region: ca-ymq-1
2026-09-08 22:44:37.405994 | localhost | Label: ubuntu-jammy
2026-09-08 22:44:37.406030 | localhost | Product Name: OpenStack Nova
2026-09-08 22:44:37.406120 | localhost | Interface IP: 162.253.55.136
2026-09-08 22:44:37.427151 | 
2026-09-08 22:44:37.427373 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-09-08 22:44:37.920660 | localhost -> localhost | changed
2026-09-08 22:44:37.928408 | 
2026-09-08 22:44:37.933109 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-09-08 22:44:38.883857 | localhost -> localhost | changed
2026-09-08 22:44:38.894963 | 
2026-09-08 22:44:38.895065 | PLAY [all]
2026-09-08 22:44:38.917255 | 
2026-09-08 22:44:38.917341 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-09-08 22:44:39.172187 | instance -> localhost | ok
2026-09-08 22:44:39.185652 | 
2026-09-08 22:44:39.185792 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-09-08 22:44:39.231161 | instance | ok
2026-09-08 22:44:39.257357 | instance | included: /var/lib/zuul/builds/71349fc8cd694333ada3a1c33b287b61/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-09-08 22:44:39.265497 | 
2026-09-08 22:44:39.265584 | TASK [add-build-sshkey : Create Temp SSH key]
2026-09-08 22:44:39.977481 | instance -> localhost | Generating public/private rsa key pair.
2026-09-08 22:44:39.982694 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/71349fc8cd694333ada3a1c33b287b61/work/71349fc8cd694333ada3a1c33b287b61_id_rsa
2026-09-08 22:44:39.982784 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/71349fc8cd694333ada3a1c33b287b61/work/71349fc8cd694333ada3a1c33b287b61_id_rsa.pub
2026-09-08 22:44:39.982834 | instance -> localhost | The key fingerprint is:
2026-09-08 22:44:39.982877 | instance -> localhost | SHA256:077XwG+hp3wAKZbefawOPoaIC+N6IExucD+1ErBn8vg zuul-build-sshkey
2026-09-08 22:44:39.982941 | instance -> localhost | The key's randomart image is:
2026-09-08 22:44:39.982983 | instance -> localhost | +---[RSA 3072]----+
2026-09-08 22:44:39.983029 | instance -> localhost | |                 |
2026-09-08 22:44:39.983070 | instance -> localhost | |  .              |
2026-09-08 22:44:39.983108 | instance -> localhost | |   o     . .     |
2026-09-08 22:44:39.983146 | instance -> localhost | |..+ + . +.o      |
2026-09-08 22:44:39.983182 | instance -> localhost | |=. B o +So.+ .   |
2026-09-08 22:44:39.983219 | instance -> localhost | |o+. = . .o. = +  |
2026-09-08 22:44:39.983255 | instance -> localhost | |o.o. + . .o  O . |
2026-09-08 22:44:39.983292 | instance -> localhost | | ..oE . ..o++ *  |
2026-09-08 22:44:39.983334 | instance -> localhost | |.o. ..   .o++=   |
2026-09-08 22:44:39.983371 | instance -> localhost | +----[SHA256]-----+
2026-09-08 22:44:39.983463 | instance -> localhost | ok: Runtime: 0:00:00.295127
2026-09-08 22:44:39.994894 | 
2026-09-08 22:44:39.995017 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-09-08 22:44:40.029009 | instance | ok
2026-09-08 22:44:40.044913 | instance | included: /var/lib/zuul/builds/71349fc8cd694333ada3a1c33b287b61/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-09-08 22:44:40.062995 | 
2026-09-08 22:44:40.063843 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-09-08 22:44:40.090527 | instance | skipping: Conditional result was False
2026-09-08 22:44:40.102403 | 
2026-09-08 22:44:40.104840 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-09-08 22:44:40.632959 | instance | changed
2026-09-08 22:44:40.645012 | 
2026-09-08 22:44:40.645141 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-09-08 22:44:40.863413 | instance | ok
2026-09-08 22:44:40.874433 | 
2026-09-08 22:44:40.894289 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-09-08 22:44:41.447117 | instance | changed
2026-09-08 22:44:41.453770 | 
2026-09-08 22:44:41.453892 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-09-08 22:44:41.971390 | instance | changed
2026-09-08 22:44:42.009572 | 
2026-09-08 22:44:42.009832 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-09-08 22:44:42.046579 | instance | skipping: Conditional result was False
2026-09-08 22:44:42.061592 | 
2026-09-08 22:44:42.061802 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-09-08 22:44:42.523681 | instance -> localhost | changed
2026-09-08 22:44:42.536553 | 
2026-09-08 22:44:42.536668 | TASK [add-build-sshkey : Add back temp key]
2026-09-08 22:44:42.890391 | instance -> localhost | Identity added: /var/lib/zuul/builds/71349fc8cd694333ada3a1c33b287b61/work/71349fc8cd694333ada3a1c33b287b61_id_rsa (zuul-build-sshkey)
2026-09-08 22:44:42.890662 | instance -> localhost | ok: Runtime: 0:00:00.017364
2026-09-08 22:44:42.896752 | 
2026-09-08 22:44:42.896833 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-09-08 22:44:43.223422 | instance | ok
2026-09-08 22:44:43.227966 | 
2026-09-08 22:44:43.228030 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-09-08 22:44:43.262522 | instance | skipping: Conditional result was False
2026-09-08 22:44:43.274368 | 
2026-09-08 22:44:43.274463 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-09-08 22:44:43.657741 | instance | ok
2026-09-08 22:44:43.742924 | 
2026-09-08 22:44:43.743118 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-09-08 22:44:47.439361 | instance | Output suppressed because no_log was given
2026-09-08 22:44:47.449591 | 
2026-09-08 22:44:47.449680 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-09-08 22:44:47.702725 | instance | ok: "logs"
2026-09-08 22:44:47.703001 | instance | ok: All items complete
2026-09-08 22:44:47.703035 | 
2026-09-08 22:44:47.888457 | instance | ok: "artifacts"
2026-09-08 22:44:48.060792 | instance | ok: "docs"
2026-09-08 22:44:48.079260 | 
2026-09-08 22:44:48.079508 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-09-08 22:44:48.266803 | instance | changed: "logs"
2026-09-08 22:44:48.431869 | instance | changed: "artifacts"
2026-09-08 22:44:48.613327 | instance | changed: "docs"
2026-09-08 22:44:48.628798 | 
2026-09-08 22:44:48.628955 | PLAY RECAP
2026-09-08 22:44:48.629042 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-09-08 22:44:48.629100 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-09-08 22:44:48.629143 | 
2026-09-08 22:44:48.775075 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-09-08 22:44:48.779121 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-09-08 22:44:49.349621 | 
2026-09-08 22:44:49.350160 | PLAY [all]
2026-09-08 22:44:49.363513 | 
2026-09-08 22:44:49.363678 | TASK [setup-uv : Extract archive]
2026-09-08 22:44:51.792255 | instance | changed
2026-09-08 22:44:51.807070 | 
2026-09-08 22:44:51.807256 | TASK [setup-uv : Print version]
2026-09-08 22:44:52.218008 | instance | uv 0.8.13
2026-09-08 22:44:52.349231 | instance | ok: Runtime: 0:00:00.013518
2026-09-08 22:44:52.372348 | 
2026-09-08 22:44:52.372543 | TASK [Install Ansible collection siblings]
2026-09-08 22:45:01.832411 | instance | changed:
2026-09-08 22:45:01.832765 | instance | Sibling collection ansible.netcommon at /home/zuul/src/github.com/ansible-collections/ansible.netcommon
2026-09-08 22:45:01.832839 | instance | Sibling collection ansible.posix at /home/zuul/src/github.com/ansible-collections/ansible.posix
2026-09-08 22:45:01.832904 | instance | Sibling collection ansible.utils at /home/zuul/src/github.com/ansible-collections/ansible.utils
2026-09-08 22:45:01.832959 | instance | Sibling collection community.crypto at /home/zuul/src/github.com/ansible-collections/community.crypto
2026-09-08 22:45:01.832999 | instance | Sibling collection community.general at /home/zuul/src/github.com/ansible-collections/community.general
2026-09-08 22:45:01.833047 | instance | Sibling collection community.mysql at /home/zuul/src/github.com/ansible-collections/community.mysql
2026-09-08 22:45:01.833088 | instance | Sibling collection kubernetes.core at /home/zuul/src/github.com/ansible-collections/kubernetes.core
2026-09-08 22:45:01.833131 | instance | Sibling collection vexxhost.ceph at /home/zuul/src/github.com/vexxhost/ansible-collection-ceph
2026-09-08 22:45:01.833169 | instance | Sibling collection vexxhost.containers at /home/zuul/src/github.com/vexxhost/ansible-collection-containers
2026-09-08 22:45:01.833206 | instance | Sibling collection vexxhost.kubernetes at /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes
2026-09-08 22:45:01.833243 | instance | Sibling collection atmosphere.common at /home/zuul/src/github.com/vexxhost/atmosphere.common
2026-09-08 22:45:01.833279 | instance | Sibling collection openstack.cloud at /home/zuul/src/opendev.org/openstack/ansible-collections-openstack
2026-09-08 22:45:01.833313 | instance | Resolved ansible.netcommon to 1.2.0 for 1.2.0
2026-09-08 22:45:01.833348 | instance | Resolved ansible.posix to 1.6.0 for 1.6.0
2026-09-08 22:45:01.833704 | instance | Resolved ansible.utils to v6.1.0 for >=2.9.0
2026-09-08 22:45:01.833799 | instance | Resolved community.crypto to 2.2.3 for 2.2.3
2026-09-08 22:45:01.833843 | instance | Resolved community.general to 7.3.0 for 7.3.0
2026-09-08 22:45:01.833909 | instance | Resolved community.mysql to 3.6.0 for 3.6.0
2026-09-08 22:45:01.834068 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0
2026-09-08 22:45:01.834150 | instance | Resolved openstack.cloud to 2.6.0 for >=2.0.0
2026-09-08 22:45:01.834193 | instance | Resolved vexxhost.ceph to v4.2.0 for >=3.2.0
2026-09-08 22:45:01.834232 | instance | Resolved atmosphere.common to v0.7.0 for >=0.7.0
2026-09-08 22:45:01.834274 | instance | Resolved vexxhost.kubernetes to v3.3.0 for >=3.3.0,>=2.5.0
2026-09-08 22:45:01.834361 | instance | Resolved community.general to 7.3.0 for 7.3.0,>=4.5.0
2026-09-08 22:45:01.834404 | instance | Resolved ansible.utils to v6.1.0 for >=2.9.0,>=6.0.0
2026-09-08 22:45:01.834457 | instance | Resolved vexxhost.containers to v1.6.8 for >=1.1.1,>=1.6.0
2026-09-08 22:45:01.834497 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0,>=2.4.0,>=2.3.2
2026-09-08 22:45:01.834532 | instance | Resolved vexxhost.kubernetes to v3.3.0 for >=3.3.0,>=2.5.0
2026-09-08 22:45:01.834584 | instance | Resolved ansible.posix to 1.6.0 for 1.6.0,>=1.6.0
2026-09-08 22:45:01.834620 | instance | Resolved community.crypto to 2.2.3 for 2.2.3,>=2.2.3
2026-09-08 22:45:01.834655 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0,>=2.4.0,>=2.3.2
2026-09-08 22:45:01.834723 | instance | Resolved vexxhost.containers to v1.6.8 for >=1.1.1,>=1.6.0
2026-09-08 22:45:01.834763 | instance | Checked out ansible.netcommon to 1.2.0
2026-09-08 22:45:01.834799 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.netcommon
2026-09-08 22:45:01.834846 | instance | Starting galaxy collection install process
2026-09-08 22:45:01.834882 | instance | Process install dependency map
2026-09-08 22:45:01.834916 | instance | Starting collection install process
2026-09-08 22:45:01.834951 | instance | Installing 'ansible.netcommon:*' to '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon'
2026-09-08 22:45:01.834986 | instance | Created collection for ansible.netcommon:* at /home/zuul/.ansible/collections/ansible_collections/ansible/netcommon
2026-09-08 22:45:01.835020 | instance | ansible.netcommon:* was installed successfully
2026-09-08 22:45:01.835054 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-09-08 22:45:01.835102 | instance | Creating virtual environment at: .venv
2026-09-08 22:45:01.835159 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-09-08 22:45:01.835199 | instance | Downloading kubernetes (1.9MiB)
2026-09-08 22:45:01.835234 | instance | Downloading ansible-core (2.1MiB)
2026-09-08 22:45:01.835278 | instance | Downloading setuptools (1.1MiB)
2026-09-08 22:45:01.835315 | instance | Downloading pygments (1.2MiB)
2026-09-08 22:45:01.835351 | instance | Downloading cryptography (4.2MiB)
2026-09-08 22:45:01.835386 | instance | Downloading rjsonnet (1.2MiB)
2026-09-08 22:45:01.835421 | instance | Downloading netaddr (2.2MiB)
2026-09-08 22:45:01.835455 | instance | Downloading openstacksdk (1.7MiB)
2026-09-08 22:45:01.835489 | instance |    Building pyperclip==1.9.0
2026-09-08 22:45:01.835523 | instance |  Downloading rjsonnet
2026-09-08 22:45:01.835561 | instance |  Downloading netaddr
2026-09-08 22:45:01.835596 | instance |  Downloading pygments
2026-09-08 22:45:01.835630 | instance |  Downloading cryptography
2026-09-08 22:45:01.835664 | instance |  Downloading setuptools
2026-09-08 22:45:01.835727 | instance |  Downloading kubernetes
2026-09-08 22:45:01.835968 | instance |  Downloading ansible-core
2026-09-08 22:45:01.836026 | instance |  Downloading openstacksdk
2026-09-08 22:45:01.836064 | instance |       Built pyperclip==1.9.0
2026-09-08 22:45:01.836102 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-09-08 22:45:01.836138 | instance | Installed 79 packages in 69ms
2026-09-08 22:45:01.836174 | instance | Checked out ansible.posix to 1.6.0
2026-09-08 22:45:01.836258 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.posix
2026-09-08 22:45:01.836315 | instance | Starting galaxy collection install process
2026-09-08 22:45:01.836352 | instance | Process install dependency map
2026-09-08 22:45:01.836386 | instance | Starting collection install process
2026-09-08 22:45:01.836421 | instance | Installing 'ansible.posix:1.6.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/posix'
2026-09-08 22:45:01.836522 | instance | Created collection for ansible.posix:1.6.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/posix
2026-09-08 22:45:01.836589 | instance | ansible.posix:1.6.0 was installed successfully
2026-09-08 22:45:01.836650 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-08 22:45:01.836715 | instance | 2.17.12
2026-09-08 22:45:01.836753 | instance | Checked out ansible.utils to v6.1.0
2026-09-08 22:45:01.836791 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.utils
2026-09-08 22:45:01.836828 | instance | Starting galaxy collection install process
2026-09-08 22:45:01.836863 | instance | Process install dependency map
2026-09-08 22:45:01.836897 | instance | Starting collection install process
2026-09-08 22:45:01.836931 | instance | Installing 'ansible.utils:6.1.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/utils'
2026-09-08 22:45:01.836965 | instance | Created collection for ansible.utils:6.1.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/utils
2026-09-08 22:45:01.836999 | instance | ansible.utils:6.1.0 was installed successfully
2026-09-08 22:45:01.837034 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-08 22:45:01.837068 | instance | 2.17.12
2026-09-08 22:45:01.837103 | instance | Checked out atmosphere.common to v0.7.0
2026-09-08 22:45:01.837139 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/atmosphere.common
2026-09-08 22:45:01.837174 | instance | Starting galaxy collection install process
2026-09-08 22:45:01.837208 | instance | Process install dependency map
2026-09-08 22:45:01.837241 | instance | Starting collection install process
2026-09-08 22:45:01.837274 | instance | Installing 'atmosphere.common:0.7.0' to '/home/zuul/.ansible/collections/ansible_collections/atmosphere/common'
2026-09-08 22:45:01.837311 | instance | Created collection for atmosphere.common:0.7.0 at /home/zuul/.ansible/collections/ansible_collections/atmosphere/common
2026-09-08 22:45:01.837365 | instance | atmosphere.common:0.7.0 was installed successfully
2026-09-08 22:45:01.837415 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-08 22:45:01.837450 | instance | 2.17.12
2026-09-08 22:45:01.837483 | instance | Checked out community.crypto to 2.2.3
2026-09-08 22:45:01.837516 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.crypto
2026-09-08 22:45:01.837550 | instance | Starting galaxy collection install process
2026-09-08 22:45:01.837582 | instance | Process install dependency map
2026-09-08 22:45:01.837615 | instance | Starting collection install process
2026-09-08 22:45:01.837648 | instance | Installing 'community.crypto:2.2.3' to '/home/zuul/.ansible/collections/ansible_collections/community/crypto'
2026-09-08 22:45:01.837703 | instance | Created collection for community.crypto:2.2.3 at /home/zuul/.ansible/collections/ansible_collections/community/crypto
2026-09-08 22:45:01.837740 | instance | community.crypto:2.2.3 was installed successfully
2026-09-08 22:45:01.837775 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-08 22:45:01.837810 | instance | 2.17.12
2026-09-08 22:45:01.837843 | instance | Checked out community.general to 7.3.0
2026-09-08 22:45:01.837877 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.general
2026-09-08 22:45:01.837912 | instance | Starting galaxy collection install process
2026-09-08 22:45:01.837958 | instance | Process install dependency map
2026-09-08 22:45:01.837992 | instance | Starting collection install process
2026-09-08 22:45:01.838026 | instance | Installing 'community.general:7.3.0' to '/home/zuul/.ansible/collections/ansible_collections/community/general'
2026-09-08 22:45:01.838059 | instance | Created collection for community.general:7.3.0 at /home/zuul/.ansible/collections/ansible_collections/community/general
2026-09-08 22:45:01.838092 | instance | community.general:7.3.0 was installed successfully
2026-09-08 22:45:01.838124 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-08 22:45:01.838158 | instance | 2.17.12
2026-09-08 22:45:01.838191 | instance | Checked out community.mysql to 3.6.0
2026-09-08 22:45:01.838226 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.mysql
2026-09-08 22:45:01.838263 | instance | Starting galaxy collection install process
2026-09-08 22:45:01.838301 | instance | Process install dependency map
2026-09-08 22:45:01.838336 | instance | Starting collection install process
2026-09-08 22:45:01.838370 | instance | Installing 'community.mysql:3.6.0' to '/home/zuul/.ansible/collections/ansible_collections/community/mysql'
2026-09-08 22:45:01.838404 | instance | Created collection for community.mysql:3.6.0 at /home/zuul/.ansible/collections/ansible_collections/community/mysql
2026-09-08 22:45:01.838438 | instance | community.mysql:3.6.0 was installed successfully
2026-09-08 22:45:01.838472 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-08 22:45:01.838505 | instance | 2.17.12
2026-09-08 22:45:01.838539 | instance | Checked out kubernetes.core to 2.4.0
2026-09-08 22:45:01.838573 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/kubernetes.core
2026-09-08 22:45:01.838607 | instance | Starting galaxy collection install process
2026-09-08 22:45:01.838641 | instance | Process install dependency map
2026-09-08 22:45:01.838693 | instance | Starting collection install process
2026-09-08 22:45:01.838738 | instance | Installing 'kubernetes.core:2.4.0' to '/home/zuul/.ansible/collections/ansible_collections/kubernetes/core'
2026-09-08 22:45:01.838775 | instance | Created collection for kubernetes.core:2.4.0 at /home/zuul/.ansible/collections/ansible_collections/kubernetes/core
2026-09-08 22:45:01.838809 | instance | kubernetes.core:2.4.0 was installed successfully
2026-09-08 22:45:01.838843 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-08 22:45:01.838877 | instance | 2.17.12
2026-09-08 22:45:01.838912 | instance | Checked out openstack.cloud to 2.6.0
2026-09-08 22:45:01.838949 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/opendev.org/openstack/ansible-collections-openstack
2026-09-08 22:45:01.838985 | instance | Starting galaxy collection install process
2026-09-08 22:45:01.839018 | instance | Process install dependency map
2026-09-08 22:45:01.839050 | instance | Starting collection install process
2026-09-08 22:45:01.839084 | instance | Installing 'openstack.cloud:2.6.0' to '/home/zuul/.ansible/collections/ansible_collections/openstack/cloud'
2026-09-08 22:45:01.839119 | instance | Created collection for openstack.cloud:2.6.0 at /home/zuul/.ansible/collections/ansible_collections/openstack/cloud
2026-09-08 22:45:01.839152 | instance | openstack.cloud:2.6.0 was installed successfully
2026-09-08 22:45:01.839185 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-08 22:45:01.839218 | instance | 2.17.12
2026-09-08 22:45:01.839250 | instance | Checked out vexxhost.ceph to v4.2.0
2026-09-08 22:45:01.839283 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-ceph
2026-09-08 22:45:01.839327 | instance | Starting galaxy collection install process
2026-09-08 22:45:01.839362 | instance | Process install dependency map
2026-09-08 22:45:01.839395 | instance | Starting collection install process
2026-09-08 22:45:01.839428 | instance | Installing 'vexxhost.ceph:4.2.0' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph'
2026-09-08 22:45:01.839462 | instance | Created collection for vexxhost.ceph:4.2.0 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph
2026-09-08 22:45:01.839494 | instance | vexxhost.ceph:4.2.0 was installed successfully
2026-09-08 22:45:01.839528 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-08 22:45:01.839561 | instance | 2.17.12
2026-09-08 22:45:01.839594 | instance | Checked out vexxhost.containers to v1.6.8
2026-09-08 22:45:01.839628 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-containers
2026-09-08 22:45:01.839660 | instance | Starting galaxy collection install process
2026-09-08 22:45:01.839750 | instance | Process install dependency map
2026-09-08 22:45:01.839805 | instance | Starting collection install process
2026-09-08 22:45:01.839843 | instance | Installing 'vexxhost.containers:1.6.8' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers'
2026-09-08 22:45:01.839878 | instance | Created collection for vexxhost.containers:1.6.8 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/containers
2026-09-08 22:45:01.839912 | instance | vexxhost.containers:1.6.8 was installed successfully
2026-09-08 22:45:01.839946 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-08 22:45:01.839979 | instance | 2.17.12
2026-09-08 22:45:01.840012 | instance | Checked out vexxhost.kubernetes to v3.3.0
2026-09-08 22:45:01.840045 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes
2026-09-08 22:45:01.840079 | instance | Starting galaxy collection install process
2026-09-08 22:45:01.840111 | instance | Process install dependency map
2026-09-08 22:45:01.840143 | instance | Starting collection install process
2026-09-08 22:45:01.840176 | instance | Installing 'vexxhost.kubernetes:3.3.0' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes'
2026-09-08 22:45:01.840209 | instance | Created collection for vexxhost.kubernetes:3.3.0 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes
2026-09-08 22:45:01.840242 | instance | vexxhost.kubernetes:3.3.0 was installed successfully
2026-09-08 22:45:01.840275 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-08 22:45:01.840308 | instance | 2.17.12
2026-09-08 22:45:01.853967 | 
2026-09-08 22:45:01.854060 | PLAY RECAP
2026-09-08 22:45:01.854142 | instance | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-09-08 22:45:01.854182 | 
2026-09-08 22:45:02.016111 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-09-08 22:45:02.017962 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/pre.yml@main]
2026-09-08 22:45:02.740868 | 
2026-09-08 22:45:02.741061 | PLAY [all]
2026-09-08 22:45:02.753323 | 
2026-09-08 22:45:02.753524 | TASK [Install "jq" for log collection]
2026-09-08 22:45:12.072112 | instance | changed
2026-09-08 22:45:12.075861 | 
2026-09-08 22:45:12.076046 | PLAY RECAP
2026-09-08 22:45:12.076166 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-09-08 22:45:12.076288 | 
2026-09-08 22:45:12.209188 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/pre.yml@main]
2026-09-08 22:45:12.211091 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-09-08 22:45:12.846708 | 
2026-09-08 22:45:12.846833 | PLAY [all]
2026-09-08 22:45:12.856904 | 
2026-09-08 22:45:12.856991 | LOOP [Check inventory directories]
2026-09-08 22:45:13.224584 | instance | ok: "src/github.com/vexxhost/atmosphere"
2026-09-08 22:45:13.409568 | instance | ok: "src/github.com/vexxhost/atmosphere/molecule/csi/inventory"
2026-09-08 22:45:13.587552 | instance | ok: "src/github.com/vexxhost/atmosphere/extensions/molecule/csi/inventory"
2026-09-08 22:45:13.599488 | 
2026-09-08 22:45:13.599735 | LOOP [Copy inventory file for Zuul]
2026-09-08 22:45:14.519068 | instance | changed:
2026-09-08 22:45:14.519240 | instance | {
2026-09-08 22:45:14.519265 | instance |   "ansible_loop_var": "item",
2026-09-08 22:45:14.519286 | instance |   "changed": false,
2026-09-08 22:45:14.519303 | instance |   "failed": false,
2026-09-08 22:45:14.519325 | instance |   "invocation": {
2026-09-08 22:45:14.519342 | instance |     "module_args": {
2026-09-08 22:45:14.519358 | instance |       "checksum_algorithm": "sha1",
2026-09-08 22:45:14.519374 | instance |       "follow": true,
2026-09-08 22:45:14.519390 | instance |       "get_attributes": true,
2026-09-08 22:45:14.519423 | instance |       "get_checksum": true,
2026-09-08 22:45:14.519456 | instance |       "get_mime": true,
2026-09-08 22:45:14.519474 | instance |       "path": "src/github.com/vexxhost/atmosphere"
2026-09-08 22:45:14.519490 | instance |     }
2026-09-08 22:45:14.519505 | instance |   },
2026-09-08 22:45:14.519520 | instance |   "item": "src/github.com/vexxhost/atmosphere",
2026-09-08 22:45:14.519551 | instance |   "stat": {
2026-09-08 22:45:14.519588 | instance |     "atime": 1788907494.7195952,
2026-09-08 22:45:14.519616 | instance |     "attr_flags": "e",
2026-09-08 22:45:14.519641 | instance |     "attributes": [
2026-09-08 22:45:14.519992 | instance |       "extents"
2026-09-08 22:45:14.520012 | instance |     ],
2026-09-08 22:45:14.520027 | instance |     "block_size": 4096,
2026-09-08 22:45:14.520042 | instance |     "blocks": 8,
2026-09-08 22:45:14.520058 | instance |     "charset": "unknown",
2026-09-08 22:45:14.520075 | instance |     "ctime": 1788907493.3115466,
2026-09-08 22:45:14.520090 | instance |     "dev": 64513,
2026-09-08 22:45:14.520105 | instance |     "device_type": 0,
2026-09-08 22:45:14.520119 | instance |     "executable": true,
2026-09-08 22:45:14.520134 | instance |     "exists": true,
2026-09-08 22:45:14.520148 | instance |     "gid": 1000,
2026-09-08 22:45:14.520163 | instance |     "gr_name": "zuul",
2026-09-08 22:45:14.520177 | instance |     "inode": 1048655,
2026-09-08 22:45:14.520192 | instance |     "isblk": false,
2026-09-08 22:45:14.520207 | instance |     "ischr": false,
2026-09-08 22:45:14.520221 | instance |     "isdir": true,
2026-09-08 22:45:14.520235 | instance |     "isfifo": false,
2026-09-08 22:45:14.520251 | instance |     "isgid": false,
2026-09-08 22:45:14.520265 | instance |     "islnk": false,
2026-09-08 22:45:14.520280 | instance |     "isreg": false,
2026-09-08 22:45:14.520294 | instance |     "issock": false,
2026-09-08 22:45:14.520308 | instance |     "isuid": false,
2026-09-08 22:45:14.520321 | instance |     "mimetype": "unknown",
2026-09-08 22:45:14.520335 | instance |     "mode": "0755",
2026-09-08 22:45:14.520349 | instance |     "mtime": 1788907493.3115466,
2026-09-08 22:45:14.520364 | instance |     "nlink": 21,
2026-09-08 22:45:14.520378 | instance |     "path": "src/github.com/vexxhost/atmosphere",
2026-09-08 22:45:14.520392 | instance |     "pw_name": "zuul",
2026-09-08 22:45:14.520407 | instance |     "readable": true,
2026-09-08 22:45:14.520421 | instance |     "rgrp": true,
2026-09-08 22:45:14.520435 | instance |     "roth": true,
2026-09-08 22:45:14.520450 | instance |     "rusr": true,
2026-09-08 22:45:14.520465 | instance |     "size": 4096,
2026-09-08 22:45:14.520668 | instance |     "uid": 1000,
2026-09-08 22:45:14.520749 | instance |     "version": "3184713170",
2026-09-08 22:45:14.520775 | instance |     "wgrp": false,
2026-09-08 22:45:14.520795 | instance |     "woth": false,
2026-09-08 22:45:14.520811 | instance |     "writeable": true,
2026-09-08 22:45:14.520826 | instance |     "wusr": true,
2026-09-08 22:45:14.520841 | instance |     "xgrp": true,
2026-09-08 22:45:14.520855 | instance |     "xoth": true,
2026-09-08 22:45:14.520870 | instance |     "xusr": true
2026-09-08 22:45:14.520900 | instance |   }
2026-09-08 22:45:14.520935 | instance | }
2026-09-08 22:45:14.520971 | instance | ok: All items complete
2026-09-08 22:45:14.520990 | 
2026-09-08 22:45:14.524799 | instance | skipping: Conditional result was False
2026-09-08 22:45:14.533643 | instance | skipping: Conditional result was False
2026-09-08 22:45:14.554051 | 
2026-09-08 22:45:14.554365 | LOOP [Switch "ansible_host" to private IP]
2026-09-08 22:45:14.962785 | instance | changed: 1 replacements made
2026-09-08 22:45:14.965075 | instance | skipping: Conditional result was False
2026-09-08 22:45:14.973825 | instance | skipping: Conditional result was False
2026-09-08 22:45:14.997687 | 
2026-09-08 22:45:14.997986 | TASK [Run Molecule scenario]
2026-09-08 22:45:15.993365 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-09-08 22:45:16.408814 | instance | INFO     [csi > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-09-08 22:45:16.408948 | instance | INFO     [csi > prerun] Performing prerun with role_name_check=0...
2026-09-08 22:45:27.106777 | instance | INFO     [csi > dependency] Executing
2026-09-08 22:45:27.107120 | instance | WARNING  [csi > dependency] Missing roles requirements file: requirements.yml
2026-09-08 22:45:27.107565 | instance | WARNING  [csi > dependency] Missing collections requirements file: collections.yml
2026-09-08 22:45:27.107803 | instance | WARNING  [csi > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-09-08 22:45:27.122838 | instance | INFO     [csi > cleanup] Executing
2026-09-08 22:45:27.123504 | instance | WARNING  [csi > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-09-08 22:45:27.136465 | instance | INFO     [csi > destroy] Executing
2026-09-08 22:45:27.136560 | instance | WARNING  [csi > destroy] Skipping, '--destroy=never' requested.
2026-09-08 22:45:27.136667 | instance | INFO     [csi > destroy] Executed: Successful
2026-09-08 22:45:27.145828 | instance | INFO     [csi > syntax] Executing
2026-09-08 22:45:28.633469 | instance |
2026-09-08 22:45:28.633745 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-09-08 22:45:28.699781 | instance | INFO     [csi > syntax] Executed: Successful
2026-09-08 22:45:28.716004 | instance | INFO     [csi > create] Executing
2026-09-08 22:45:28.719903 | instance | WARNING  [csi > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-09-08 22:45:28.736146 | instance | INFO     [csi > prepare] Executing
2026-09-08 22:45:29.439750 | instance |
2026-09-08 22:45:29.439859 | instance | PLAY [Prepare] *****************************************************************
2026-09-08 22:45:29.439974 | instance |
2026-09-08 22:45:29.440165 | instance | TASK [Gathering Facts] *********************************************************
2026-09-08 22:45:29.440358 | instance | Tuesday 08 September 2026  22:45:29 +0000 (0:00:00.023)       0:00:00.023 *****
2026-09-08 22:45:30.774822 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-09-08 22:45:30.775859 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-09-08 22:45:30.775946 | instance | interpreter could change the meaning of that path. See
2026-09-08 22:45:30.775957 | instance | https://docs.ansible.com/ansible-
2026-09-08 22:45:30.775967 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-09-08 22:45:30.787497 | instance | ok: [instance]
2026-09-08 22:45:30.787843 | instance |
2026-09-08 22:45:30.787861 | instance | TASK [Configure short hostname] ************************************************
2026-09-08 22:45:30.787874 | instance | Tuesday 08 September 2026  22:45:30 +0000 (0:00:01.347)       0:00:01.370 *****
2026-09-08 22:45:31.545663 | instance | changed: [instance]
2026-09-08 22:45:31.546034 | instance |
2026-09-08 22:45:31.546329 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-09-08 22:45:31.546590 | instance | Tuesday 08 September 2026  22:45:31 +0000 (0:00:00.758)       0:00:02.129 *****
2026-09-08 22:45:31.842687 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-09-08 22:45:31.842785 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-09-08 22:45:31.842796 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-09-08 22:45:31.846251 | instance | changed: [instance]
2026-09-08 22:45:31.846284 | instance |
2026-09-08 22:45:31.846300 | instance | TASK [Purge "snapd" package] ***************************************************
2026-09-08 22:45:31.846314 | instance | Tuesday 08 September 2026  22:45:31 +0000 (0:00:00.300)       0:00:02.429 *****
2026-09-08 22:45:32.706933 | instance | ok: [instance]
2026-09-08 22:45:32.707199 | instance |
2026-09-08 22:45:32.707211 | instance | PLAY [Create devices for Ceph] *************************************************
2026-09-08 22:45:32.707221 | instance |
2026-09-08 22:45:32.707230 | instance | TASK [Gathering Facts] *********************************************************
2026-09-08 22:45:32.707268 | instance | Tuesday 08 September 2026  22:45:32 +0000 (0:00:00.859)       0:00:03.289 *****
2026-09-08 22:45:33.435179 | instance | ok: [instance]
2026-09-08 22:45:33.435246 | instance |
2026-09-08 22:45:33.435258 | instance | TASK [Install depedencies] *****************************************************
2026-09-08 22:45:33.435268 | instance | Tuesday 08 September 2026  22:45:33 +0000 (0:00:00.728)       0:00:04.017 *****
2026-09-08 22:45:57.709347 | instance | changed: [instance]
2026-09-08 22:45:57.709443 | instance |
2026-09-08 22:45:57.709456 | instance | TASK [Start up service] ********************************************************
2026-09-08 22:45:57.709467 | instance | Tuesday 08 September 2026  22:45:57 +0000 (0:00:24.274)       0:00:28.291 *****
2026-09-08 22:45:58.273586 | instance | ok: [instance]
2026-09-08 22:45:58.273656 | instance |
2026-09-08 22:45:58.273669 | instance | TASK [Generate lvm.conf] *******************************************************
2026-09-08 22:45:58.273679 | instance | Tuesday 08 September 2026  22:45:58 +0000 (0:00:00.564)       0:00:28.856 *****
2026-09-08 22:45:58.591481 | instance | ok: [instance]
2026-09-08 22:45:58.591560 | instance |
2026-09-08 22:45:58.591709 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-09-08 22:45:58.591964 | instance | Tuesday 08 September 2026  22:45:58 +0000 (0:00:00.318)       0:00:29.174 *****
2026-09-08 22:45:59.317331 | instance | changed: [instance]
2026-09-08 22:45:59.317394 | instance |
2026-09-08 22:45:59.317406 | instance | TASK [Get list of all loopback devices] ****************************************
2026-09-08 22:45:59.317417 | instance | Tuesday 08 September 2026  22:45:59 +0000 (0:00:00.725)       0:00:29.900 *****
2026-09-08 22:45:59.550160 | instance | ok: [instance]
2026-09-08 22:45:59.550244 | instance |
2026-09-08 22:45:59.550578 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-09-08 22:45:59.550595 | instance | Tuesday 08 September 2026  22:45:59 +0000 (0:00:00.234)       0:00:30.134 *****
2026-09-08 22:45:59.574284 | instance | skipping: [instance]
2026-09-08 22:45:59.574490 | instance |
2026-09-08 22:45:59.574917 | instance | TASK [Create devices for Ceph] *************************************************
2026-09-08 22:45:59.574940 | instance | Tuesday 08 September 2026  22:45:59 +0000 (0:00:00.024)       0:00:30.158 *****
2026-09-08 22:46:00.178598 | instance | changed: [instance] => (item=osd0)
2026-09-08 22:46:00.179504 | instance | changed: [instance] => (item=osd1)
2026-09-08 22:46:00.179710 | instance | changed: [instance] => (item=osd2)
2026-09-08 22:46:00.179722 | instance |
2026-09-08 22:46:00.179732 | instance | TASK [Set permissions on loopback devices] *************************************
2026-09-08 22:46:00.179742 | instance | Tuesday 08 September 2026  22:46:00 +0000 (0:00:00.603)       0:00:30.762 *****
2026-09-08 22:46:00.855021 | instance | changed: [instance] => (item=osd0)
2026-09-08 22:46:00.856899 | instance | changed: [instance] => (item=osd1)
2026-09-08 22:46:00.856961 | instance | changed: [instance] => (item=osd2)
2026-09-08 22:46:00.856977 | instance |
2026-09-08 22:46:00.856991 | instance | TASK [Start loop devices] ******************************************************
2026-09-08 22:46:00.857005 | instance | Tuesday 08 September 2026  22:46:00 +0000 (0:00:00.676)       0:00:31.438 *****
2026-09-08 22:46:01.674890 | instance | changed: [instance] => (item=osd0)
2026-09-08 22:46:01.675470 | instance | changed: [instance] => (item=osd1)
2026-09-08 22:46:01.675565 | instance | changed: [instance] => (item=osd2)
2026-09-08 22:46:01.675584 | instance |
2026-09-08 22:46:01.676130 | instance | TASK [Create a volume group for each loop device] ******************************
2026-09-08 22:46:01.676201 | instance | Tuesday 08 September 2026  22:46:01 +0000 (0:00:00.819)       0:00:32.258 *****
2026-09-08 22:46:05.328945 | instance | changed: [instance] => (item=osd0)
2026-09-08 22:46:05.329013 | instance | changed: [instance] => (item=osd1)
2026-09-08 22:46:05.329024 | instance | changed: [instance] => (item=osd2)
2026-09-08 22:46:05.329034 | instance |
2026-09-08 22:46:05.329044 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-09-08 22:46:05.329054 | instance | Tuesday 08 September 2026  22:46:05 +0000 (0:00:03.652)       0:00:35.911 *****
2026-09-08 22:46:07.252160 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-09-08 22:46:07.255527 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-09-08 22:46:07.255658 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-09-08 22:46:07.255694 | instance |
2026-09-08 22:46:07.255707 | instance | PLAY RECAP *********************************************************************
2026-09-08 22:46:07.255717 | instance | instance                   : ok=15   changed=9    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-09-08 22:46:07.255727 | instance |
2026-09-08 22:46:07.255736 | instance | Tuesday 08 September 2026  22:46:07 +0000 (0:00:01.925)       0:00:37.836 *****
2026-09-08 22:46:07.255746 | instance | ===============================================================================
2026-09-08 22:46:07.255755 | instance | Install depedencies ---------------------------------------------------- 24.27s
2026-09-08 22:46:07.255764 | instance | Create a volume group for each loop device ------------------------------ 3.65s
2026-09-08 22:46:07.255772 | instance | Create a logical volume for each loop device ---------------------------- 1.93s
2026-09-08 22:46:07.255782 | instance | Gathering Facts --------------------------------------------------------- 1.35s
2026-09-08 22:46:07.255790 | instance | Purge "snapd" package --------------------------------------------------- 0.86s
2026-09-08 22:46:07.255799 | instance | Start loop devices ------------------------------------------------------ 0.82s
2026-09-08 22:46:07.255819 | instance | Configure short hostname ------------------------------------------------ 0.76s
2026-09-08 22:46:07.255828 | instance | Gathering Facts --------------------------------------------------------- 0.73s
2026-09-08 22:46:07.256067 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.73s
2026-09-08 22:46:07.256417 | instance | Set permissions on loopback devices ------------------------------------- 0.68s
2026-09-08 22:46:07.256736 | instance | Create devices for Ceph ------------------------------------------------- 0.60s
2026-09-08 22:46:07.257030 | instance | Start up service -------------------------------------------------------- 0.56s
2026-09-08 22:46:07.257319 | instance | Generate lvm.conf ------------------------------------------------------- 0.32s
2026-09-08 22:46:07.257613 | instance | Ensure hostname inside hosts file --------------------------------------- 0.30s
2026-09-08 22:46:07.257931 | instance | Get list of all loopback devices ---------------------------------------- 0.23s
2026-09-08 22:46:07.258227 | instance | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-09-08 22:46:07.362358 | instance | INFO     [csi > prepare] Executed: Successful
2026-09-08 22:46:07.377744 | instance | INFO     [csi > converge] Executing
2026-09-08 22:46:08.808652 | instance |
2026-09-08 22:46:08.809078 | instance | PLAY [Debug CSI driver value] **************************************************
2026-09-08 22:46:08.809367 | instance |
2026-09-08 22:46:08.809665 | instance | TASK [Gathering Facts] *********************************************************
2026-09-08 22:46:08.809986 | instance | Tuesday 08 September 2026  22:46:08 +0000 (0:00:00.008)       0:00:00.008 *****
2026-09-08 22:46:09.876828 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-09-08 22:46:09.877209 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-09-08 22:46:09.877509 | instance | interpreter could change the meaning of that path. See
2026-09-08 22:46:09.877823 | instance | https://docs.ansible.com/ansible-
2026-09-08 22:46:09.878119 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-09-08 22:46:09.888617 | instance | ok: [instance]
2026-09-08 22:46:09.889041 | instance |
2026-09-08 22:46:09.889357 | instance | TASK [Display CSI driver value and environment variable] ***********************
2026-09-08 22:46:09.889651 | instance | Tuesday 08 September 2026  22:46:09 +0000 (0:00:01.080)       0:00:01.088 *****
2026-09-08 22:46:09.945096 | instance | ok: [instance] => {
2026-09-08 22:46:09.945457 | instance |     "msg": "csi_driver=rbd, MOLECULE_CSI_DRIVER="
2026-09-08 22:46:09.945770 | instance | }
2026-09-08 22:46:09.946058 | instance |
2026-09-08 22:46:09.946348 | instance | PLAY [all] *********************************************************************
2026-09-08 22:46:09.946656 | instance |
2026-09-08 22:46:09.946988 | instance | TASK [Gathering Facts] *********************************************************
2026-09-08 22:46:09.947318 | instance | Tuesday 08 September 2026  22:46:09 +0000 (0:00:00.056)       0:00:01.144 *****
2026-09-08 22:46:10.939073 | instance | ok: [instance]
2026-09-08 22:46:10.939552 | instance |
2026-09-08 22:46:10.939984 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] *****************
2026-09-08 22:46:10.940380 | instance | Tuesday 08 September 2026  22:46:10 +0000 (0:00:00.993)       0:00:02.138 *****
2026-09-08 22:46:11.148463 | instance | ok: [instance]
2026-09-08 22:46:11.148887 | instance |
2026-09-08 22:46:11.149220 | instance | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-09-08 22:46:11.149511 | instance |
2026-09-08 22:46:11.149836 | instance | TASK [Gathering Facts] *********************************************************
2026-09-08 22:46:11.150141 | instance | Tuesday 08 September 2026  22:46:11 +0000 (0:00:00.206)       0:00:02.345 *****
2026-09-08 22:46:12.119229 | instance | ok: [instance]
2026-09-08 22:46:12.119712 | instance |
2026-09-08 22:46:12.122091 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-09-08 22:46:12.122122 | instance | Tuesday 08 September 2026  22:46:12 +0000 (0:00:00.970)       0:00:03.315 *****
2026-09-08 22:46:12.450007 | instance | ok: [instance]
2026-09-08 22:46:12.450407 | instance |
2026-09-08 22:46:12.450743 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-09-08 22:46:12.451093 | instance | Tuesday 08 September 2026  22:46:12 +0000 (0:00:00.333)       0:00:03.649 *****
2026-09-08 22:46:12.489414 | instance | skipping: [instance]
2026-09-08 22:46:12.489776 | instance |
2026-09-08 22:46:12.490107 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-09-08 22:46:12.490425 | instance | Tuesday 08 September 2026  22:46:12 +0000 (0:00:00.039)       0:00:03.689 *****
2026-09-08 22:46:12.872329 | instance | changed: [instance]
2026-09-08 22:46:12.872727 | instance |
2026-09-08 22:46:12.873085 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-09-08 22:46:12.873393 | instance | Tuesday 08 September 2026  22:46:12 +0000 (0:00:00.382)       0:00:04.072 *****
2026-09-08 22:46:12.965064 | instance | ok: [instance] => {
2026-09-08 22:46:12.965443 | instance |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-09-08 22:46:12.965732 | instance | }
2026-09-08 22:46:12.966028 | instance |
2026-09-08 22:46:12.966403 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-09-08 22:46:12.966715 | instance | Tuesday 08 September 2026  22:46:12 +0000 (0:00:00.092)       0:00:04.164 *****
2026-09-08 22:46:13.752458 | instance | changed: [instance]
2026-09-08 22:46:13.752858 | instance |
2026-09-08 22:46:13.753197 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-09-08 22:46:13.753500 | instance | Tuesday 08 September 2026  22:46:13 +0000 (0:00:00.787)       0:00:04.951 *****
2026-09-08 22:46:13.816625 | instance | skipping: [instance]
2026-09-08 22:46:13.817083 | instance |
2026-09-08 22:46:13.817426 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-09-08 22:46:13.817757 | instance | Tuesday 08 September 2026  22:46:13 +0000 (0:00:00.064)       0:00:05.016 *****
2026-09-08 22:46:13.873431 | instance | skipping: [instance]
2026-09-08 22:46:13.873826 | instance |
2026-09-08 22:46:13.874147 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-09-08 22:46:13.874455 | instance | Tuesday 08 September 2026  22:46:13 +0000 (0:00:00.056)       0:00:05.073 *****
2026-09-08 22:46:14.121476 | instance | ok: [instance]
2026-09-08 22:46:14.121882 | instance |
2026-09-08 22:46:14.122205 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-09-08 22:46:14.122519 | instance | Tuesday 08 September 2026  22:46:14 +0000 (0:00:00.247)       0:00:05.320 *****
2026-09-08 22:46:15.681271 | instance | ok: [instance]
2026-09-08 22:46:15.681834 | instance |
2026-09-08 22:46:15.682156 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-09-08 22:46:15.682462 | instance | Tuesday 08 September 2026  22:46:15 +0000 (0:00:01.560)       0:00:06.880 *****
2026-09-08 22:46:15.776292 | instance | ok: [instance] => {
2026-09-08 22:46:15.776471 | instance |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-09-08 22:46:15.776741 | instance | }
2026-09-08 22:46:15.777202 | instance |
2026-09-08 22:46:15.777633 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-09-08 22:46:15.778104 | instance | Tuesday 08 September 2026  22:46:15 +0000 (0:00:00.092)       0:00:06.973 *****
2026-09-08 22:46:16.800142 | instance | changed: [instance]
2026-09-08 22:46:16.800364 | instance |
2026-09-08 22:46:16.800519 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-09-08 22:46:16.800665 | instance | Tuesday 08 September 2026  22:46:16 +0000 (0:00:01.024)       0:00:07.997 *****
2026-09-08 22:46:19.755862 | instance | changed: [instance]
2026-09-08 22:46:19.755960 | instance |
2026-09-08 22:46:19.756024 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-09-08 22:46:19.756175 | instance | Tuesday 08 September 2026  22:46:19 +0000 (0:00:02.958)       0:00:10.955 *****
2026-09-08 22:46:19.798251 | instance | skipping: [instance]
2026-09-08 22:46:19.798329 | instance |
2026-09-08 22:46:19.798729 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-09-08 22:46:19.798790 | instance | Tuesday 08 September 2026  22:46:19 +0000 (0:00:00.041)       0:00:10.997 *****
2026-09-08 22:46:19.831327 | instance | skipping: [instance]
2026-09-08 22:46:19.832131 | instance |
2026-09-08 22:46:19.832263 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-09-08 22:46:19.832275 | instance | Tuesday 08 September 2026  22:46:19 +0000 (0:00:00.033)       0:00:11.030 *****
2026-09-08 22:46:19.874213 | instance | skipping: [instance]
2026-09-08 22:46:19.875094 | instance |
2026-09-08 22:46:19.875164 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-09-08 22:46:19.875177 | instance | Tuesday 08 September 2026  22:46:19 +0000 (0:00:00.042)       0:00:11.073 *****
2026-09-08 22:46:25.434823 | instance | changed: [instance]
2026-09-08 22:46:25.435445 | instance |
2026-09-08 22:46:25.435517 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-09-08 22:46:25.435669 | instance | Tuesday 08 September 2026  22:46:25 +0000 (0:00:05.560)       0:00:16.633 *****
2026-09-08 22:46:26.133766 | instance | changed: [instance]
2026-09-08 22:46:26.134516 | instance |
2026-09-08 22:46:26.134606 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-09-08 22:46:26.134619 | instance | Tuesday 08 September 2026  22:46:26 +0000 (0:00:00.699)       0:00:17.332 *****
2026-09-08 22:46:27.160626 | instance | changed: [instance] => (item={'path': '/etc/containerd'})
2026-09-08 22:46:27.160740 | instance | changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-09-08 22:46:27.160758 | instance | changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-09-08 22:46:27.161353 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-09-08 22:46:27.161412 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-09-08 22:46:27.161418 | instance |
2026-09-08 22:46:27.161428 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-09-08 22:46:27.161434 | instance | Tuesday 08 September 2026  22:46:27 +0000 (0:00:01.027)       0:00:18.360 *****
2026-09-08 22:46:27.811788 | instance | changed: [instance]
2026-09-08 22:46:27.811909 | instance |
2026-09-08 22:46:27.812931 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-09-08 22:46:27.813005 | instance | Tuesday 08 September 2026  22:46:27 +0000 (0:00:00.621)       0:00:18.982 *****
2026-09-08 22:46:27.813015 | instance |
2026-09-08 22:46:27.813024 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-09-08 22:46:27.813032 | instance | Tuesday 08 September 2026  22:46:27 +0000 (0:00:00.028)       0:00:19.011 *****
2026-09-08 22:46:28.803551 | instance | ok: [instance]
2026-09-08 22:46:28.803668 | instance |
2026-09-08 22:46:28.804274 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-09-08 22:46:28.804342 | instance | Tuesday 08 September 2026  22:46:28 +0000 (0:00:00.991)       0:00:20.002 *****
2026-09-08 22:46:29.314382 | instance | changed: [instance]
2026-09-08 22:46:29.315256 | instance |
2026-09-08 22:46:29.315334 | instance | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-09-08 22:46:29.315381 | instance | Tuesday 08 September 2026  22:46:29 +0000 (0:00:00.510)       0:00:20.513 *****
2026-09-08 22:46:29.916057 | instance | changed: [instance]
2026-09-08 22:46:29.916720 | instance |
2026-09-08 22:46:29.916781 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-09-08 22:46:29.916791 | instance | Tuesday 08 September 2026  22:46:29 +0000 (0:00:00.601)       0:00:21.115 *****
2026-09-08 22:46:30.160407 | instance | ok: [instance]
2026-09-08 22:46:30.160506 | instance |
2026-09-08 22:46:30.160519 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-09-08 22:46:30.160530 | instance | Tuesday 08 September 2026  22:46:30 +0000 (0:00:00.243)       0:00:21.358 *****
2026-09-08 22:46:30.245358 | instance | ok: [instance] => {
2026-09-08 22:46:30.245430 | instance |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-09-08 22:46:30.245445 | instance | }
2026-09-08 22:46:30.245458 | instance |
2026-09-08 22:46:30.245492 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-09-08 22:46:30.245506 | instance | Tuesday 08 September 2026  22:46:30 +0000 (0:00:00.084)       0:00:21.442 *****
2026-09-08 22:46:31.118120 | instance | changed: [instance]
2026-09-08 22:46:31.118190 | instance |
2026-09-08 22:46:31.118202 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-09-08 22:46:31.118213 | instance | Tuesday 08 September 2026  22:46:31 +0000 (0:00:00.873)       0:00:22.316 *****
2026-09-08 22:46:35.545744 | instance | changed: [instance]
2026-09-08 22:46:35.545820 | instance |
2026-09-08 22:46:35.546138 | instance | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-09-08 22:46:35.546160 | instance | Tuesday 08 September 2026  22:46:35 +0000 (0:00:04.428)       0:00:26.745 *****
2026-09-08 22:46:36.676867 | instance | ok: [instance]
2026-09-08 22:46:36.676939 | instance |
2026-09-08 22:46:36.676952 | instance | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-09-08 22:46:36.676962 | instance | Tuesday 08 September 2026  22:46:36 +0000 (0:00:01.129)       0:00:27.875 *****
2026-09-08 22:46:37.094417 | instance | changed: [instance]
2026-09-08 22:46:37.095180 | instance |
2026-09-08 22:46:37.095251 | instance | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-09-08 22:46:37.095263 | instance | Tuesday 08 September 2026  22:46:37 +0000 (0:00:00.418)       0:00:28.293 *****
2026-09-08 22:46:37.613689 | instance | changed: [instance]
2026-09-08 22:46:37.613949 | instance |
2026-09-08 22:46:37.614219 | instance | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-09-08 22:46:37.614481 | instance | Tuesday 08 September 2026  22:46:37 +0000 (0:00:00.519)       0:00:28.813 *****
2026-09-08 22:46:38.245190 | instance | changed: [instance] => (item={'path': '/etc/docker'})
2026-09-08 22:46:38.246565 | instance | changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-09-08 22:46:38.246631 | instance | changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-09-08 22:46:38.246643 | instance |
2026-09-08 22:46:38.246654 | instance | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-09-08 22:46:38.246664 | instance | Tuesday 08 September 2026  22:46:38 +0000 (0:00:00.631)       0:00:29.444 *****
2026-09-08 22:46:38.761894 | instance | changed: [instance]
2026-09-08 22:46:38.762620 | instance |
2026-09-08 22:46:38.762684 | instance | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-09-08 22:46:38.762697 | instance | Tuesday 08 September 2026  22:46:38 +0000 (0:00:00.516)       0:00:29.961 *****
2026-09-08 22:46:39.277406 | instance | changed: [instance]
2026-09-08 22:46:39.277485 | instance |
2026-09-08 22:46:39.277547 | instance | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-09-08 22:46:39.278049 | instance | Tuesday 08 September 2026  22:46:39 +0000 (0:00:00.501)       0:00:30.463 *****
2026-09-08 22:46:39.278108 | instance |
2026-09-08 22:46:39.278114 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-09-08 22:46:39.278119 | instance | Tuesday 08 September 2026  22:46:39 +0000 (0:00:00.014)       0:00:30.477 *****
2026-09-08 22:46:40.010801 | instance | ok: [instance]
2026-09-08 22:46:40.011255 | instance |
2026-09-08 22:46:40.011307 | instance | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-09-08 22:46:40.011323 | instance | Tuesday 08 September 2026  22:46:40 +0000 (0:00:00.733)       0:00:31.210 *****
2026-09-08 22:46:41.062112 | instance | changed: [instance]
2026-09-08 22:46:41.062822 | instance |
2026-09-08 22:46:41.062888 | instance | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-09-08 22:46:41.062902 | instance | Tuesday 08 September 2026  22:46:41 +0000 (0:00:01.050)       0:00:32.261 *****
2026-09-08 22:46:41.694208 | instance | changed: [instance]
2026-09-08 22:46:41.694908 | instance |
2026-09-08 22:46:41.694952 | instance | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-09-08 22:46:41.694960 | instance | Tuesday 08 September 2026  22:46:41 +0000 (0:00:00.631)       0:00:32.893 *****
2026-09-08 22:46:41.767210 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-09-08 22:46:41.767611 | instance |
2026-09-08 22:46:41.767711 | instance | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-09-08 22:46:41.767733 | instance | Tuesday 08 September 2026  22:46:41 +0000 (0:00:00.073)       0:00:32.966 *****
2026-09-08 22:46:47.310581 | instance | changed: [instance]
2026-09-08 22:46:47.310665 | instance |
2026-09-08 22:46:47.310989 | instance | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-09-08 22:46:47.311202 | instance | Tuesday 08 September 2026  22:46:47 +0000 (0:00:05.543)       0:00:38.510 *****
2026-09-08 22:46:48.004885 | instance | ok: [instance] => (item=chronyd)
2026-09-08 22:46:48.005874 | instance | ok: [instance] => (item=sshd)
2026-09-08 22:46:48.005951 | instance |
2026-09-08 22:46:48.005962 | instance | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-09-08 22:46:48.005974 | instance | Tuesday 08 September 2026  22:46:47 +0000 (0:00:00.693)       0:00:39.204 *****
2026-09-08 22:46:59.078928 | instance | changed: [instance]
2026-09-08 22:46:59.079040 | instance |
2026-09-08 22:46:59.079597 | instance | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-09-08 22:46:59.079707 | instance | Tuesday 08 September 2026  22:46:59 +0000 (0:00:11.074)       0:00:50.278 *****
2026-09-08 22:46:59.304992 | instance | ok: [instance]
2026-09-08 22:46:59.305759 | instance |
2026-09-08 22:46:59.305819 | instance | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-09-08 22:46:59.305832 | instance | Tuesday 08 September 2026  22:46:59 +0000 (0:00:00.225)       0:00:50.504 *****
2026-09-08 22:46:59.818013 | instance | changed: [instance]
2026-09-08 22:46:59.818068 | instance |
2026-09-08 22:46:59.818080 | instance | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-09-08 22:46:59.818090 | instance | Tuesday 08 September 2026  22:46:59 +0000 (0:00:00.512)       0:00:51.016 *****
2026-09-08 22:47:00.200371 | instance | changed: [instance]
2026-09-08 22:47:00.200432 | instance |
2026-09-08 22:47:00.200444 | instance | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-09-08 22:47:00.200455 | instance | Tuesday 08 September 2026  22:47:00 +0000 (0:00:00.382)       0:00:51.398 *****
2026-09-08 22:47:00.333729 | instance | ok: [instance]
2026-09-08 22:47:00.334522 | instance |
2026-09-08 22:47:00.334577 | instance | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-09-08 22:47:00.334591 | instance | Tuesday 08 September 2026  22:47:00 +0000 (0:00:00.134)       0:00:51.532 *****
2026-09-08 22:47:00.593298 | instance | ok: [instance] => (item=instance)
2026-09-08 22:47:00.594118 | instance |
2026-09-08 22:47:00.594207 | instance | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-09-08 22:47:00.594225 | instance | Tuesday 08 September 2026  22:47:00 +0000 (0:00:00.259)       0:00:51.792 *****
2026-09-08 22:47:00.657683 | instance | ok: [instance]
2026-09-08 22:47:00.657720 | instance |
2026-09-08 22:47:00.657731 | instance | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-09-08 22:47:00.657741 | instance | Tuesday 08 September 2026  22:47:00 +0000 (0:00:00.064)       0:00:51.856 *****
2026-09-08 22:47:00.742483 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for instance
2026-09-08 22:47:00.742602 | instance |
2026-09-08 22:47:00.742618 | instance | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-09-08 22:47:00.742791 | instance | Tuesday 08 September 2026  22:47:00 +0000 (0:00:00.085)       0:00:51.942 *****
2026-09-08 22:47:01.103335 | instance | changed: [instance]
2026-09-08 22:47:01.104170 | instance |
2026-09-08 22:47:01.104245 | instance | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-09-08 22:47:01.104257 | instance | Tuesday 08 September 2026  22:47:01 +0000 (0:00:00.360)       0:00:52.302 *****
2026-09-08 22:47:01.856948 | instance | changed: [instance] => (item={'option': 'mon allow pool size one', 'section': 'global', 'value': True})
2026-09-08 22:47:01.857013 | instance | changed: [instance] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-09-08 22:47:01.857025 | instance | changed: [instance] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-09-08 22:47:01.857034 | instance |
2026-09-08 22:47:01.857044 | instance | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-09-08 22:47:01.857053 | instance | Tuesday 08 September 2026  22:47:01 +0000 (0:00:00.752)       0:00:53.054 *****
2026-09-08 22:48:34.979920 | instance | ok: [instance]
2026-09-08 22:48:34.979971 | instance |
2026-09-08 22:48:34.979979 | instance | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-09-08 22:48:34.979986 | instance | Tuesday 08 September 2026  22:48:34 +0000 (0:01:33.124)       0:02:26.179 *****
2026-09-08 22:48:35.227792 | instance | changed: [instance]
2026-09-08 22:48:35.227867 | instance |
2026-09-08 22:48:35.228212 | instance | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-09-08 22:48:35.228531 | instance | Tuesday 08 September 2026  22:48:35 +0000 (0:00:00.248)       0:02:26.427 *****
2026-09-08 22:48:35.355399 | instance | ok: [instance]
2026-09-08 22:48:35.355460 | instance |
2026-09-08 22:48:35.355734 | instance | TASK [Install Ceph host] *******************************************************
2026-09-08 22:48:35.355786 | instance | Tuesday 08 September 2026  22:48:35 +0000 (0:00:00.127)       0:02:26.555 *****
2026-09-08 22:48:35.458726 | instance | included: vexxhost.ceph.cephadm_host for instance
2026-09-08 22:48:35.458767 | instance |
2026-09-08 22:48:35.458773 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-09-08 22:48:35.458778 | instance | Tuesday 08 September 2026  22:48:35 +0000 (0:00:00.103)       0:02:26.658 *****
2026-09-08 22:48:37.139765 | instance | ok: [instance]
2026-09-08 22:48:37.139967 | instance |
2026-09-08 22:48:37.140214 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-09-08 22:48:37.140448 | instance | Tuesday 08 September 2026  22:48:37 +0000 (0:00:01.680)       0:02:28.339 *****
2026-09-08 22:48:37.217772 | instance | ok: [instance] => (item=instance)
2026-09-08 22:48:37.217988 | instance |
2026-09-08 22:48:37.218217 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-09-08 22:48:37.218445 | instance | Tuesday 08 September 2026  22:48:37 +0000 (0:00:00.077)       0:02:28.417 *****
2026-09-08 22:48:37.598447 | instance | ok: [instance]
2026-09-08 22:48:37.598719 | instance |
2026-09-08 22:48:37.598972 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-09-08 22:48:37.599220 | instance | Tuesday 08 September 2026  22:48:37 +0000 (0:00:00.380)       0:02:28.797 *****
2026-09-08 22:48:40.026911 | instance | ok: [instance]
2026-09-08 22:48:40.027087 | instance |
2026-09-08 22:48:40.027319 | instance | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-09-08 22:48:40.027603 | instance | Tuesday 08 September 2026  22:48:40 +0000 (0:00:02.428)       0:02:31.226 *****
2026-09-08 22:49:33.935120 | instance | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: [errno 5] RADOS I/O error (error connecting to the cluster)
2026-09-08 22:49:33.935216 | instance | fatal: [instance]: FAILED! => {"changed": false, "module_stderr": "Traceback (most recent call last):\n  File \"<stdin>\", line 107, in <module>\n  File \"<stdin>\", line 99, in _ansiballz_main\n  File \"<stdin>\", line 47, in invoke_module\n  File \"/usr/lib/python3.10/runpy.py\", line 224, in run_module\n    return _run_module_code(code, init_globals, run_name, mod_spec)\n  File \"/usr/lib/python3.10/runpy.py\", line 96, in _run_module_code\n    _run_code(code, mod_globals, init_globals,\n  File \"/usr/lib/python3.10/runpy.py\", line 86, in _run_code\n    exec(code, run_globals)\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_lp785bzd/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 202, in <module>\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_lp785bzd/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 198, in main\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_lp785bzd/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 177, in run_module\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_lp785bzd/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 120, in apply_spec\nRuntimeError: Inferring config /var/lib/ceph/4837cbf8-4f90-4300-b3f6-726c9b9f89b4/mon.instance/config\n2026-09-08T22:49:33.740+0000 7f00ef443640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgCakKBqQNuUIiAAlnkFxr2wJLI6SDoCtYFlFSf1mbs3MgE3TphFlgE2x9c=: Malformed input [buffer:3]\n2026-09-08T22:49:33.740+0000 7f00ef443640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-09-08T22:49:33.740+0000 7f00ef443640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgCakKBqQNuUIiAAlnkFxr2wJLI6SDoCtYFlFSf1mbs3MgE3TphFlgE2x9c=: Malformed input [buffer:3]\n2026-09-08T22:49:33.740+0000 7f00ef443640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-09-08T22:49:33.740+0000 7f00ef443640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgCakKBqQNuUIiAAlnkFxr2wJLI6SDoCtYFlFSf1mbs3MgE3TphFlgE2x9c=: Malformed input [buffer:3]\n2026-09-08T22:49:33.740+0000 7f00ef443640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-09-08T22:49:33.740+0000 7f00ef443640 -1 monclient: keyring not found\n[errno 5] RADOS I/O error (error connecting to the cluster)\n\n", "module_stdout": "", "msg": "MODULE FAILURE\nSee stdout/stderr for the exact error", "rc": 1}
2026-09-08 22:49:33.936784 | instance |
2026-09-08 22:49:33.939431 | instance | PLAY RECAP *********************************************************************
2026-09-08 22:49:33.939490 | instance | instance                   : ok=55   changed=26   unreachable=0    failed=1    skipped=6    rescued=0    ignored=0
2026-09-08 22:49:33.939502 | instance |
2026-09-08 22:49:33.939512 | instance | Tuesday 08 September 2026  22:49:33 +0000 (0:00:53.910)       0:03:25.136 *****
2026-09-08 22:49:33.939521 | instance | ===============================================================================
2026-09-08 22:49:33.939530 | instance | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 93.12s
2026-09-08 22:49:33.939539 | instance | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 53.91s
2026-09-08 22:49:33.939548 | instance | vexxhost.ceph.cephadm : Download "cephadm" ----------------------------- 11.07s
2026-09-08 22:49:33.939558 | instance | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.56s
2026-09-08 22:49:33.939567 | instance | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.54s
2026-09-08 22:49:33.939576 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 4.43s
2026-09-08 22:49:33.939590 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 2.96s
2026-09-08 22:49:33.939843 | instance | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.43s
2026-09-08 22:49:33.940166 | instance | vexxhost.containers.containerd : Reload systemd ------------------------- 1.72s
2026-09-08 22:49:33.940466 | instance | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.68s
2026-09-08 22:49:33.940781 | instance | vexxhost.containers.package : Update state for tar ---------------------- 1.56s
2026-09-08 22:49:33.941068 | instance | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.13s
2026-09-08 22:49:33.941351 | instance | Gathering Facts --------------------------------------------------------- 1.08s
2026-09-08 22:49:33.941688 | instance | vexxhost.containers.docker : Restart docker ----------------------------- 1.05s
2026-09-08 22:49:33.941979 | instance | vexxhost.containers.containerd : Create folders for configuration ------- 1.03s
2026-09-08 22:49:33.942265 | instance | vexxhost.containers.download_artifact : Download item ------------------- 1.02s
2026-09-08 22:49:33.942557 | instance | Gathering Facts --------------------------------------------------------- 0.99s
2026-09-08 22:49:33.942870 | instance | Gathering Facts --------------------------------------------------------- 0.97s
2026-09-08 22:49:33.943167 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.87s
2026-09-08 22:49:33.943488 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.79s
2026-09-08 22:49:34.077039 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-09-08 22:49:34.077334 | instance | ERROR    [csi > converge] Executed: Failed
2026-09-08 22:49:34.077518 | instance | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-09-08 22:49:34.410688 | instance | ERROR
2026-09-08 22:49:34.410996 | instance | {
2026-09-08 22:49:34.411065 | instance |   "delta": "0:04:18.715211",
2026-09-08 22:49:34.411106 | instance |   "end": "2026-09-08 22:49:34.149908",
2026-09-08 22:49:34.411142 | instance |   "msg": "non-zero return code",
2026-09-08 22:49:34.411176 | instance |   "rc": 2,
2026-09-08 22:49:34.411209 | instance |   "start": "2026-09-08 22:45:15.434697"
2026-09-08 22:49:34.411242 | instance | }
failure
2026-09-08 22:49:34.423884 | 
2026-09-08 22:49:34.423988 | PLAY RECAP
2026-09-08 22:49:34.424074 | instance | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-09-08 22:49:34.424116 | 
2026-09-08 22:49:34.587016 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-09-08 22:49:34.591156 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/post.yml@main]
2026-09-08 22:49:35.194143 | 
2026-09-08 22:49:35.194275 | PLAY [all]
2026-09-08 22:49:35.207093 | 
2026-09-08 22:49:35.207166 | TASK [gather-host-logs : creating directory for system status]
2026-09-08 22:49:35.575264 | instance | changed
2026-09-08 22:49:35.585568 | 
2026-09-08 22:49:35.585733 | TASK [gather-host-logs : Get logs for each host]
2026-09-08 22:49:35.978430 | instance | + systemd-cgls --full --all --no-pager
2026-09-08 22:49:36.001958 | instance | + ip addr
2026-09-08 22:49:36.004927 | instance | + ip route
2026-09-08 22:49:36.007308 | instance | + lsblk
2026-09-08 22:49:36.012632 | instance | + mount
2026-09-08 22:49:36.015390 | instance | + docker images
2026-09-08 22:49:36.038443 | instance | + brctl show
2026-09-08 22:49:36.038968 | instance | /bin/bash: line 8: brctl: command not found
2026-09-08 22:49:36.039323 | instance | + ps aux --sort=-%mem
2026-09-08 22:49:36.079711 | instance | + dpkg -l
2026-09-08 22:49:36.090544 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-09-08 22:49:36.091022 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-09-08 22:49:36.115890 | instance | + '[' '!' -z '' ']'
2026-09-08 22:49:36.168184 | instance | ok: Runtime: 0:00:00.141844
2026-09-08 22:49:36.179320 | 
2026-09-08 22:49:36.179455 | TASK [gather-host-logs : Downloads logs to executor]
2026-09-08 22:49:36.875931 | instance | changed:
2026-09-08 22:49:36.876213 | instance | created directory /var/lib/zuul/builds/71349fc8cd694333ada3a1c33b287b61/work/logs/instance
2026-09-08 22:49:36.876269 | instance | cd+++++++++ system/
2026-09-08 22:49:36.876314 | instance | >f+++++++++ system/brctl-show.txt
2026-09-08 22:49:36.876355 | instance | >f+++++++++ system/docker-images.txt
2026-09-08 22:49:36.876394 | instance | >f+++++++++ system/ip-addr.txt
2026-09-08 22:49:36.876437 | instance | >f+++++++++ system/ip-route.txt
2026-09-08 22:49:36.876521 | instance | >f+++++++++ system/lsblk.txt
2026-09-08 22:49:36.876569 | instance | >f+++++++++ system/mount.txt
2026-09-08 22:49:36.876607 | instance | >f+++++++++ system/packages.txt
2026-09-08 22:49:36.876644 | instance | >f+++++++++ system/ps.txt
2026-09-08 22:49:36.876685 | instance | >f+++++++++ system/systemd-cgls.txt
2026-09-08 22:49:36.894622 | 
2026-09-08 22:49:36.894761 | LOOP [helm-release-status : creating directory for helm release status]
2026-09-08 22:49:37.155172 | instance | changed: "values"
2026-09-08 22:49:37.352894 | instance | changed: "releases"
2026-09-08 22:49:37.367420 | 
2026-09-08 22:49:37.367756 | TASK [helm-release-status : Gather get release status for helm charts]
2026-09-08 22:49:37.627511 | instance | /bin/bash: line 3: kubectl: command not found
2026-09-08 22:49:37.922678 | instance | ok: Runtime: 0:00:00.007673
2026-09-08 22:49:37.934567 | 
2026-09-08 22:49:37.934751 | TASK [helm-release-status : Downloads logs to executor]
2026-09-08 22:49:38.467900 | instance | changed:
2026-09-08 22:49:38.468423 | instance | cd+++++++++ helm/
2026-09-08 22:49:38.468534 | instance | cd+++++++++ helm/releases/
2026-09-08 22:49:38.468583 | instance | cd+++++++++ helm/values/
2026-09-08 22:49:38.486509 | 
2026-09-08 22:49:38.486697 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-09-08 22:49:38.705145 | instance | changed
2026-09-08 22:49:38.716400 | 
2026-09-08 22:49:38.716580 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-09-08 22:49:39.023864 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-08 22:49:39.024049 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-08 22:49:39.030697 | instance | environment: line 1: kubectl: command not found
2026-09-08 22:49:39.031966 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-08 22:49:39.032397 | instance | environment: line 1: kubectl: command not found
2026-09-08 22:49:39.034096 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-08 22:49:39.035589 | instance | environment: line 1: kubectl: command not found
2026-09-08 22:49:39.037209 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-08 22:49:39.038602 | instance | environment: line 1: kubectl: command not found
2026-09-08 22:49:39.039979 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-08 22:49:39.040881 | instance | environment: line 1: kubectl: command not found
2026-09-08 22:49:39.042009 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-08 22:49:39.266454 | instance | ok: Runtime: 0:00:00.025791
2026-09-08 22:49:39.276818 | 
2026-09-08 22:49:39.277288 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-09-08 22:49:39.504976 | instance | changed
2026-09-08 22:49:39.515392 | 
2026-09-08 22:49:39.515588 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-09-08 22:49:39.768167 | instance | environment: line 5: kubectl: command not found
2026-09-08 22:49:39.769395 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-08 22:49:39.769498 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-08 22:49:39.770370 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-08 22:49:40.065239 | instance | ok: Runtime: 0:00:00.006108
2026-09-08 22:49:40.075290 | 
2026-09-08 22:49:40.075415 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-09-08 22:49:40.607600 | instance | changed:
2026-09-08 22:49:40.608047 | instance | cd+++++++++ objects/
2026-09-08 22:49:40.608106 | instance | cd+++++++++ objects/cluster/
2026-09-08 22:49:40.608153 | instance | cd+++++++++ objects/namespaced/
2026-09-08 22:49:40.627043 | 
2026-09-08 22:49:40.627211 | TASK [gather-pod-logs : creating directory for pod logs]
2026-09-08 22:49:40.845055 | instance | changed
2026-09-08 22:49:40.854468 | 
2026-09-08 22:49:40.854620 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-09-08 22:49:41.072683 | instance | changed
2026-09-08 22:49:41.084313 | 
2026-09-08 22:49:41.084458 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-09-08 22:49:41.352351 | instance | environment: line 3: kubectl: command not found
2026-09-08 22:49:41.634455 | instance | ok: Runtime: 0:00:00.009584
2026-09-08 22:49:41.645082 | 
2026-09-08 22:49:41.645417 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-09-08 22:49:42.203162 | instance | changed:
2026-09-08 22:49:42.203462 | instance | cd+++++++++ pod-logs/
2026-09-08 22:49:42.203573 | instance | cd+++++++++ pod-logs/failed-pods/
2026-09-08 22:49:42.230644 | 
2026-09-08 22:49:42.230863 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-09-08 22:49:42.461235 | instance | changed
2026-09-08 22:49:42.472352 | 
2026-09-08 22:49:42.473193 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-09-08 22:49:42.743938 | instance | /bin/bash: line 2: kubectl: command not found
2026-09-08 22:49:43.025771 | instance | ok: Runtime: 0:00:00.053913
2026-09-08 22:49:43.035776 | 
2026-09-08 22:49:43.035917 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-09-08 22:49:43.287962 | instance | /bin/bash: line 2: kubectl: command not found
2026-09-08 22:49:43.333178 | instance | ceph-mgr endpoints:
2026-09-08 22:49:43.586115 | instance | ok: Runtime: 0:00:00.052500
2026-09-08 22:49:43.597681 | 
2026-09-08 22:49:43.597820 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-09-08 22:49:43.865395 | instance | /bin/bash: line 4: kubectl: command not found
2026-09-08 22:49:44.148030 | instance | ok: Runtime: 0:00:00.055120
2026-09-08 22:49:44.157632 | 
2026-09-08 22:49:44.157773 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-09-08 22:49:44.709062 | instance | changed: cd+++++++++ prometheus/
2026-09-08 22:49:44.726791 | 
2026-09-08 22:49:44.726979 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-09-08 22:49:44.955757 | instance | changed
2026-09-08 22:49:44.964985 | 
2026-09-08 22:49:44.965148 | TASK [gather-selenium-data : Get selenium data]
2026-09-08 22:49:45.252809 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-09-08 22:49:45.254313 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-09-08 22:49:45.512205 | instance | ERROR
2026-09-08 22:49:45.512569 | instance | {
2026-09-08 22:49:45.512639 | instance |   "delta": "0:00:00.007450",
2026-09-08 22:49:45.512681 | instance |   "end": "2026-09-08 22:49:45.254733",
2026-09-08 22:49:45.512723 | instance |   "msg": "non-zero return code",
2026-09-08 22:49:45.512760 | instance |   "rc": 1,
2026-09-08 22:49:45.512796 | instance |   "start": "2026-09-08 22:49:45.247283"
2026-09-08 22:49:45.512831 | instance | }
2026-09-08 22:49:45.512876 | instance | ERROR: Ignoring Errors
2026-09-08 22:49:45.523107 | 
2026-09-08 22:49:45.523237 | TASK [gather-selenium-data : Downloads logs to executor]
2026-09-08 22:49:46.094331 | instance | changed: cd+++++++++ selenium/
2026-09-08 22:49:46.104805 | 
2026-09-08 22:49:46.104900 | PLAY RECAP
2026-09-08 22:49:46.104984 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-09-08 22:49:46.105028 | 
2026-09-08 22:49:46.264710 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/post.yml@main]
2026-09-08 22:49:46.268943 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-09-08 22:49:46.909125 | 
2026-09-08 22:49:46.909280 | PLAY [all]
2026-09-08 22:49:46.920579 | 
2026-09-08 22:49:46.920708 | TASK [fetch-output : Set log path for multiple nodes]
2026-09-08 22:49:46.975087 | instance | skipping: Conditional result was False
2026-09-08 22:49:46.982218 | 
2026-09-08 22:49:46.982333 | TASK [fetch-output : Set log path for single node]
2026-09-08 22:49:47.025172 | instance | ok
2026-09-08 22:49:47.033468 | 
2026-09-08 22:49:47.033583 | LOOP [fetch-output : Ensure local output dirs]
2026-09-08 22:49:47.521614 | instance -> localhost | ok: "/var/lib/zuul/builds/71349fc8cd694333ada3a1c33b287b61/work/logs"
2026-09-08 22:49:47.739678 | instance -> localhost | changed: "/var/lib/zuul/builds/71349fc8cd694333ada3a1c33b287b61/work/artifacts"
2026-09-08 22:49:47.958826 | instance -> localhost | changed: "/var/lib/zuul/builds/71349fc8cd694333ada3a1c33b287b61/work/docs"
2026-09-08 22:49:47.976036 | 
2026-09-08 22:49:47.976238 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-09-08 22:49:48.636364 | instance | changed: .d..t...... ./
2026-09-08 22:49:48.636811 | instance | changed: All items complete
2026-09-08 22:49:48.636872 | 
2026-09-08 22:49:49.141586 | instance | changed: .d..t...... ./
2026-09-08 22:49:49.653424 | instance | changed: .d..t...... ./
2026-09-08 22:49:49.685434 | 
2026-09-08 22:49:49.685773 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-09-08 22:49:50.147077 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.005940
2026-09-08 22:49:50.375607 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.007623
2026-09-08 22:49:50.392679 | 
2026-09-08 22:49:50.392856 | PLAY [all]
2026-09-08 22:49:50.406606 | 
2026-09-08 22:49:50.406832 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-09-08 22:49:50.869593 | instance | changed
2026-09-08 22:49:50.881133 | 
2026-09-08 22:49:50.881267 | PLAY RECAP
2026-09-08 22:49:50.881353 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-09-08 22:49:50.881396 | 
2026-09-08 22:49:51.115207 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-09-08 22:49:51.119391 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-09-08 22:49:51.682887 | 
2026-09-08 22:49:51.683021 | PLAY [localhost]
2026-09-08 22:49:51.692077 | 
2026-09-08 22:49:51.692145 | TASK [Generate Zuul manifest]
2026-09-08 22:49:51.709560 | localhost | ok
2026-09-08 22:49:51.725283 | 
2026-09-08 22:49:51.725365 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-09-08 22:49:52.121777 | localhost | changed
2026-09-08 22:49:52.140892 | 
2026-09-08 22:49:52.141081 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-09-08 22:49:52.170021 | localhost | ok
2026-09-08 22:49:52.176237 | 
2026-09-08 22:49:52.176304 | TASK [Upload logs]
2026-09-08 22:49:52.197760 | localhost | ok
2026-09-08 22:49:52.252344 | 
2026-09-08 22:49:52.252549 | TASK [Set zuul-log-path fact]
2026-09-08 22:49:52.271338 | localhost | ok
2026-09-08 22:49:52.281997 | 
2026-09-08 22:49:52.282065 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-09-08 22:49:52.319648 | localhost | ok
2026-09-08 22:49:52.325924 | 
2026-09-08 22:49:52.325992 | TASK [upload-logs : Create log directories]
2026-09-08 22:49:52.762219 | localhost | changed
2026-09-08 22:49:52.771797 | 
2026-09-08 22:49:52.771941 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-09-08 22:49:53.270892 | localhost -> localhost | ok: Runtime: 0:00:00.006335
2026-09-08 22:49:53.289227 | 
2026-09-08 22:49:53.289436 | TASK [upload-logs : Upload logs to log server]
2026-09-08 22:49:53.822197 | localhost | Output suppressed because no_log was given
2026-09-08 22:49:53.900791 | 
2026-09-08 22:49:53.901142 | LOOP [upload-logs : Compress console log and json output]
2026-09-08 22:49:53.961481 | localhost | skipping: Conditional result was False
2026-09-08 22:49:53.969468 | localhost | skipping: Conditional result was False
2026-09-08 22:49:53.986035 | 
2026-09-08 22:49:53.986276 | LOOP [upload-logs : Upload compressed console log and json output]
2026-09-08 22:49:54.051960 | localhost | skipping: Conditional result was False
2026-09-08 22:49:54.052353 | 
2026-09-08 22:49:54.057894 | localhost | skipping: Conditional result was False
2026-09-08 22:49:54.072069 | 
2026-09-08 22:49:54.072304 | LOOP [upload-logs : Upload console log and json output]