2026-08-28 04:00:31.921239 | Job console starting
2026-08-28 04:00:31.932328 | Updating git repos
2026-08-28 04:00:39.585949 | Cloning repos into workspace
2026-08-28 04:00:58.521026 | Restoring repo states
2026-08-28 04:01:15.166826 | Merging changes
2026-08-28 04:01:16.389385 | Checking out repos
2026-08-28 04:01:18.116112 | Preparing playbooks
2026-08-28 04:01:21.010938 | Running Ansible setup
2026-08-28 04:01:24.527904 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-28 04:01:25.122206 | 
2026-08-28 04:01:25.122341 | PLAY [localhost]
2026-08-28 04:01:25.130143 | 
2026-08-28 04:01:25.130215 | TASK [Gathering Facts]
2026-08-28 04:01:26.006714 | localhost | ok
2026-08-28 04:01:26.018055 | 
2026-08-28 04:01:26.018217 | TASK [Setup log path fact]
2026-08-28 04:01:26.037991 | localhost | ok
2026-08-28 04:01:26.050290 | 
2026-08-28 04:01:26.050393 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-28 04:01:26.082127 | localhost | ok
2026-08-28 04:01:26.094550 | 
2026-08-28 04:01:26.094667 | TASK [emit-job-header : Print job information]
2026-08-28 04:01:26.135091 | # Job Information
2026-08-28 04:01:26.135279 | Ansible Version: 2.16.18
2026-08-28 04:01:26.135325 | Job: atmosphere-molecule-csi-rbd
2026-08-28 04:01:26.135357 | Pipeline: check
2026-08-28 04:01:26.135386 | Executor: 2d72f0692154
2026-08-28 04:01:26.135414 | Triggered by: https://github.com/vexxhost/atmosphere/pull/4354
2026-08-28 04:01:26.135448 | Event ID: ad83e330-a293-11f1-839d-178f3154a439
2026-08-28 04:01:26.139677 | 
2026-08-28 04:01:26.139772 | LOOP [emit-job-header : Print node information]
2026-08-28 04:01:26.239872 | localhost | ok:
2026-08-28 04:01:26.240339 | localhost | # Node Information
2026-08-28 04:01:26.240402 | localhost | Inventory Hostname: instance
2026-08-28 04:01:26.240451 | localhost | Hostname: np0000191397
2026-08-28 04:01:26.240498 | localhost | Username: zuul
2026-08-28 04:01:26.240548 | localhost | Distro: Ubuntu 22.04
2026-08-28 04:01:26.240593 | localhost | Provider: yul1
2026-08-28 04:01:26.240787 | localhost | Region: ca-ymq-1
2026-08-28 04:01:26.240878 | localhost | Label: ubuntu-jammy
2026-08-28 04:01:26.240928 | localhost | Product Name: OpenStack Nova
2026-08-28 04:01:26.241003 | localhost | Interface IP: 162.253.55.34
2026-08-28 04:01:26.257858 | 
2026-08-28 04:01:26.258009 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-08-28 04:01:26.669856 | localhost -> localhost | changed
2026-08-28 04:01:26.675154 | 
2026-08-28 04:01:26.675229 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-08-28 04:01:27.521389 | localhost -> localhost | changed
2026-08-28 04:01:27.530347 | 
2026-08-28 04:01:27.530797 | PLAY [all]
2026-08-28 04:01:27.539378 | 
2026-08-28 04:01:27.539456 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-08-28 04:01:27.759250 | instance -> localhost | ok
2026-08-28 04:01:27.767881 | 
2026-08-28 04:01:27.767977 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-08-28 04:01:27.800384 | instance | ok
2026-08-28 04:01:27.816197 | instance | included: /var/lib/zuul/builds/4670db494a3849cdb363c1cf78b0db7b/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-28 04:01:27.822007 | 
2026-08-28 04:01:27.822091 | TASK [add-build-sshkey : Create Temp SSH key]
2026-08-28 04:01:28.904606 | instance -> localhost | Generating public/private rsa key pair.
2026-08-28 04:01:28.904849 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/4670db494a3849cdb363c1cf78b0db7b/work/4670db494a3849cdb363c1cf78b0db7b_id_rsa
2026-08-28 04:01:28.904893 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/4670db494a3849cdb363c1cf78b0db7b/work/4670db494a3849cdb363c1cf78b0db7b_id_rsa.pub
2026-08-28 04:01:28.904927 | instance -> localhost | The key fingerprint is:
2026-08-28 04:01:28.904980 | instance -> localhost | SHA256:lbxksn/K8wDiR1PnBctLgj/TgChQNbAKMjCFfrqhmNk zuul-build-sshkey
2026-08-28 04:01:28.905036 | instance -> localhost | The key's randomart image is:
2026-08-28 04:01:28.905079 | instance -> localhost | +---[RSA 3072]----+
2026-08-28 04:01:28.905127 | instance -> localhost | |ooo.ooo     .    |
2026-08-28 04:01:28.905164 | instance -> localhost | |o. . . o + o o   |
2026-08-28 04:01:28.905195 | instance -> localhost | |=   o . + X = .  |
2026-08-28 04:01:28.905226 | instance -> localhost | |.+ o .   O O o   |
2026-08-28 04:01:28.905256 | instance -> localhost | |  +   . S = +    |
2026-08-28 04:01:28.905287 | instance -> localhost | | o   . o + o     |
2026-08-28 04:01:28.905316 | instance -> localhost | |o+o   . . o .    |
2026-08-28 04:01:28.905347 | instance -> localhost | |=.E    . ..+     |
2026-08-28 04:01:28.905380 | instance -> localhost | |          oo.    |
2026-08-28 04:01:28.905411 | instance -> localhost | +----[SHA256]-----+
2026-08-28 04:01:28.905502 | instance -> localhost | ok: Runtime: 0:00:00.649597
2026-08-28 04:01:28.930243 | 
2026-08-28 04:01:28.930547 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-08-28 04:01:28.962744 | instance | ok
2026-08-28 04:01:28.971072 | instance | included: /var/lib/zuul/builds/4670db494a3849cdb363c1cf78b0db7b/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-28 04:01:28.979304 | 
2026-08-28 04:01:28.979365 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-08-28 04:01:29.002945 | instance | skipping: Conditional result was False
2026-08-28 04:01:29.010962 | 
2026-08-28 04:01:29.011057 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-08-28 04:01:29.449557 | instance | changed
2026-08-28 04:01:29.456390 | 
2026-08-28 04:01:29.456457 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-08-28 04:01:29.629992 | instance | ok
2026-08-28 04:01:29.636785 | 
2026-08-28 04:01:29.770220 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-08-28 04:01:30.272208 | instance | changed
2026-08-28 04:01:30.279371 | 
2026-08-28 04:01:30.279437 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-08-28 04:01:30.734678 | instance | changed
2026-08-28 04:01:30.743181 | 
2026-08-28 04:01:30.743292 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-08-28 04:01:30.771340 | instance | skipping: Conditional result was False
2026-08-28 04:01:30.781452 | 
2026-08-28 04:01:30.781520 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-08-28 04:01:31.133780 | instance -> localhost | changed
2026-08-28 04:01:31.150621 | 
2026-08-28 04:01:31.150692 | TASK [add-build-sshkey : Add back temp key]
2026-08-28 04:01:31.433642 | instance -> localhost | Identity added: /var/lib/zuul/builds/4670db494a3849cdb363c1cf78b0db7b/work/4670db494a3849cdb363c1cf78b0db7b_id_rsa (zuul-build-sshkey)
2026-08-28 04:01:31.433914 | instance -> localhost | ok: Runtime: 0:00:00.011659
2026-08-28 04:01:31.440772 | 
2026-08-28 04:01:31.440858 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-08-28 04:01:31.768280 | instance | ok
2026-08-28 04:01:31.772907 | 
2026-08-28 04:01:31.772990 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-08-28 04:01:31.799549 | instance | skipping: Conditional result was False
2026-08-28 04:01:31.816020 | 
2026-08-28 04:01:31.816114 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-08-28 04:01:32.176359 | instance | ok
2026-08-28 04:01:32.320177 | 
2026-08-28 04:01:32.320315 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-08-28 04:01:35.862639 | instance | Output suppressed because no_log was given
2026-08-28 04:01:35.872613 | 
2026-08-28 04:01:35.872679 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-08-28 04:01:36.083134 | instance | ok: "logs"
2026-08-28 04:01:36.083430 | instance | ok: All items complete
2026-08-28 04:01:36.083472 | 
2026-08-28 04:01:36.224492 | instance | ok: "artifacts"
2026-08-28 04:01:36.371877 | instance | ok: "docs"
2026-08-28 04:01:36.389029 | 
2026-08-28 04:01:36.389192 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-08-28 04:01:36.568386 | instance | changed: "logs"
2026-08-28 04:01:36.701145 | instance | changed: "artifacts"
2026-08-28 04:01:36.845596 | instance | changed: "docs"
2026-08-28 04:01:36.865697 | 
2026-08-28 04:01:36.865812 | PLAY RECAP
2026-08-28 04:01:36.865878 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-28 04:01:36.865918 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-28 04:01:36.865949 | 
2026-08-28 04:01:37.005848 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-28 04:01:37.010101 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-28 04:01:37.632456 | 
2026-08-28 04:01:37.632604 | PLAY [all]
2026-08-28 04:01:37.643822 | 
2026-08-28 04:01:37.643896 | TASK [setup-uv : Extract archive]
2026-08-28 04:01:39.918874 | instance | changed
2026-08-28 04:01:39.924667 | 
2026-08-28 04:01:39.924750 | TASK [setup-uv : Print version]
2026-08-28 04:01:40.243297 | instance | uv 0.8.13
2026-08-28 04:01:40.461916 | instance | ok: Runtime: 0:00:00.012343
2026-08-28 04:01:40.473753 | 
2026-08-28 04:01:40.473862 | TASK [Install Ansible collection siblings]
2026-08-28 04:01:49.375900 | instance | changed:
2026-08-28 04:01:49.449980 | instance | Sibling collection ansible.netcommon at /home/zuul/src/github.com/ansible-collections/ansible.netcommon
2026-08-28 04:01:49.461406 | instance | Sibling collection ansible.posix at /home/zuul/src/github.com/ansible-collections/ansible.posix
2026-08-28 04:01:49.461616 | instance | Sibling collection ansible.utils at /home/zuul/src/github.com/ansible-collections/ansible.utils
2026-08-28 04:01:49.461656 | instance | Sibling collection community.crypto at /home/zuul/src/github.com/ansible-collections/community.crypto
2026-08-28 04:01:49.461687 | instance | Sibling collection community.general at /home/zuul/src/github.com/ansible-collections/community.general
2026-08-28 04:01:49.461728 | instance | Sibling collection community.mysql at /home/zuul/src/github.com/ansible-collections/community.mysql
2026-08-28 04:01:49.461757 | instance | Sibling collection kubernetes.core at /home/zuul/src/github.com/ansible-collections/kubernetes.core
2026-08-28 04:01:49.461783 | instance | Sibling collection vexxhost.ceph at /home/zuul/src/github.com/vexxhost/ansible-collection-ceph
2026-08-28 04:01:49.461807 | instance | Sibling collection vexxhost.containers at /home/zuul/src/github.com/vexxhost/ansible-collection-containers
2026-08-28 04:01:49.461830 | instance | Sibling collection vexxhost.kubernetes at /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes
2026-08-28 04:01:49.461857 | instance | Sibling collection atmosphere.common at /home/zuul/src/github.com/vexxhost/atmosphere.common
2026-08-28 04:01:49.461883 | instance | Sibling collection openstack.cloud at /home/zuul/src/opendev.org/openstack/ansible-collections-openstack
2026-08-28 04:01:49.461907 | instance | Resolved ansible.netcommon to 1.2.0 for 1.2.0
2026-08-28 04:01:49.461932 | instance | Resolved ansible.posix to 1.6.0 for 1.6.0
2026-08-28 04:01:49.461955 | instance | Resolved ansible.utils to v6.1.0 for >=2.9.0
2026-08-28 04:01:49.461978 | instance | Resolved community.crypto to 2.2.3 for 2.2.3
2026-08-28 04:01:49.462001 | instance | Resolved community.general to 7.3.0 for 7.3.0
2026-08-28 04:01:49.462025 | instance | Resolved community.mysql to 3.6.0 for 3.6.0
2026-08-28 04:01:49.462049 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0
2026-08-28 04:01:49.462071 | instance | Resolved openstack.cloud to 2.6.0 for >=2.0.0
2026-08-28 04:01:49.462093 | instance | Resolved vexxhost.ceph to v4.2.0 for >=3.2.0
2026-08-28 04:01:49.462116 | instance | Resolved atmosphere.common to v0.7.0 for >=0.7.0
2026-08-28 04:01:49.462141 | instance | Resolved vexxhost.kubernetes to v3.3.0 for >=3.3.0,>=2.5.0
2026-08-28 04:01:49.462179 | instance | Resolved community.general to 7.3.0 for 7.3.0,>=4.5.0
2026-08-28 04:01:49.462204 | instance | Resolved ansible.utils to v6.1.0 for >=2.9.0,>=6.0.0
2026-08-28 04:01:49.462228 | instance | Resolved vexxhost.containers to v1.6.8 for >=1.1.1,>=1.6.0
2026-08-28 04:01:49.462252 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0,>=2.4.0,>=2.3.2
2026-08-28 04:01:49.462276 | instance | Resolved vexxhost.kubernetes to v3.3.0 for >=3.3.0,>=2.5.0
2026-08-28 04:01:49.462299 | instance | Resolved ansible.posix to 1.6.0 for 1.6.0,>=1.6.0
2026-08-28 04:01:49.462322 | instance | Resolved community.crypto to 2.2.3 for 2.2.3,>=2.2.3
2026-08-28 04:01:49.462344 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0,>=2.4.0,>=2.3.2
2026-08-28 04:01:49.462368 | instance | Resolved vexxhost.containers to v1.6.8 for >=1.1.1,>=1.6.0
2026-08-28 04:01:49.462391 | instance | Checked out ansible.netcommon to 1.2.0
2026-08-28 04:01:49.462417 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.netcommon
2026-08-28 04:01:49.462453 | instance | Starting galaxy collection install process
2026-08-28 04:01:49.462481 | instance | Process install dependency map
2026-08-28 04:01:49.462508 | instance | Starting collection install process
2026-08-28 04:01:49.462536 | instance | Installing 'ansible.netcommon:*' to '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon'
2026-08-28 04:01:49.462562 | instance | Created collection for ansible.netcommon:* at /home/zuul/.ansible/collections/ansible_collections/ansible/netcommon
2026-08-28 04:01:49.462588 | instance | ansible.netcommon:* was installed successfully
2026-08-28 04:01:49.462613 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-08-28 04:01:49.462637 | instance | Creating virtual environment at: .venv
2026-08-28 04:01:49.462662 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-08-28 04:01:49.462689 | instance | Downloading netaddr (2.2MiB)
2026-08-28 04:01:49.462717 | instance | Downloading setuptools (1.1MiB)
2026-08-28 04:01:49.462751 | instance | Downloading ansible-core (2.1MiB)
2026-08-28 04:01:49.462780 | instance | Downloading pygments (1.2MiB)
2026-08-28 04:01:49.462808 | instance | Downloading cryptography (4.2MiB)
2026-08-28 04:01:49.462836 | instance | Downloading openstacksdk (1.7MiB)
2026-08-28 04:01:49.462864 | instance | Downloading pydantic-core (2.0MiB)
2026-08-28 04:01:49.462890 | instance | Downloading kubernetes (1.9MiB)
2026-08-28 04:01:49.462917 | instance | Downloading rjsonnet (1.2MiB)
2026-08-28 04:01:49.462944 | instance |    Building pyperclip==1.9.0
2026-08-28 04:01:49.462972 | instance |  Downloading rjsonnet
2026-08-28 04:01:49.462997 | instance |  Downloading pydantic-core
2026-08-28 04:01:49.463021 | instance |  Downloading netaddr
2026-08-28 04:01:49.463049 | instance |  Downloading pygments
2026-08-28 04:01:49.463077 | instance |  Downloading cryptography
2026-08-28 04:01:49.463105 | instance |  Downloading setuptools
2026-08-28 04:01:49.463132 | instance |  Downloading kubernetes
2026-08-28 04:01:49.463158 | instance |  Downloading ansible-core
2026-08-28 04:01:49.463186 | instance |  Downloading openstacksdk
2026-08-28 04:01:49.463213 | instance |       Built pyperclip==1.9.0
2026-08-28 04:01:49.463241 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-08-28 04:01:49.463266 | instance | Installed 83 packages in 47ms
2026-08-28 04:01:49.463291 | instance | Checked out ansible.posix to 1.6.0
2026-08-28 04:01:49.463317 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.posix
2026-08-28 04:01:49.463341 | instance | Starting galaxy collection install process
2026-08-28 04:01:49.463366 | instance | Process install dependency map
2026-08-28 04:01:49.463397 | instance | Starting collection install process
2026-08-28 04:01:49.463424 | instance | Installing 'ansible.posix:1.6.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/posix'
2026-08-28 04:01:49.463450 | instance | Created collection for ansible.posix:1.6.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/posix
2026-08-28 04:01:49.463475 | instance | ansible.posix:1.6.0 was installed successfully
2026-08-28 04:01:49.463502 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 04:01:49.463529 | instance | 2.17.12
2026-08-28 04:01:49.463554 | instance | Checked out ansible.utils to v6.1.0
2026-08-28 04:01:49.463579 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.utils
2026-08-28 04:01:49.463606 | instance | Starting galaxy collection install process
2026-08-28 04:01:49.463631 | instance | Process install dependency map
2026-08-28 04:01:49.463657 | instance | Starting collection install process
2026-08-28 04:01:49.463683 | instance | Installing 'ansible.utils:6.1.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/utils'
2026-08-28 04:01:49.463710 | instance | Created collection for ansible.utils:6.1.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/utils
2026-08-28 04:01:49.463736 | instance | ansible.utils:6.1.0 was installed successfully
2026-08-28 04:01:49.463762 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 04:01:49.463787 | instance | 2.17.12
2026-08-28 04:01:49.463830 | instance | Checked out atmosphere.common to v0.7.0
2026-08-28 04:01:49.463856 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/atmosphere.common
2026-08-28 04:01:49.463882 | instance | Starting galaxy collection install process
2026-08-28 04:01:49.463908 | instance | Process install dependency map
2026-08-28 04:01:49.463934 | instance | Starting collection install process
2026-08-28 04:01:49.463959 | instance | Installing 'atmosphere.common:0.7.0' to '/home/zuul/.ansible/collections/ansible_collections/atmosphere/common'
2026-08-28 04:01:49.463982 | instance | Created collection for atmosphere.common:0.7.0 at /home/zuul/.ansible/collections/ansible_collections/atmosphere/common
2026-08-28 04:01:49.464006 | instance | atmosphere.common:0.7.0 was installed successfully
2026-08-28 04:01:49.464032 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 04:01:49.464059 | instance | 2.17.12
2026-08-28 04:01:49.464084 | instance | Checked out community.crypto to 2.2.3
2026-08-28 04:01:49.464111 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.crypto
2026-08-28 04:01:49.464138 | instance | Starting galaxy collection install process
2026-08-28 04:01:49.464166 | instance | Process install dependency map
2026-08-28 04:01:49.464192 | instance | Starting collection install process
2026-08-28 04:01:49.464218 | instance | Installing 'community.crypto:2.2.3' to '/home/zuul/.ansible/collections/ansible_collections/community/crypto'
2026-08-28 04:01:49.470179 | instance | Created collection for community.crypto:2.2.3 at /home/zuul/.ansible/collections/ansible_collections/community/crypto
2026-08-28 04:01:49.470366 | instance | community.crypto:2.2.3 was installed successfully
2026-08-28 04:01:49.470446 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 04:01:49.470515 | instance | 2.17.12
2026-08-28 04:01:49.470584 | instance | Checked out community.general to 7.3.0
2026-08-28 04:01:49.470618 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.general
2026-08-28 04:01:49.470698 | instance | Starting galaxy collection install process
2026-08-28 04:01:49.470776 | instance | Process install dependency map
2026-08-28 04:01:49.470810 | instance | Starting collection install process
2026-08-28 04:01:49.470871 | instance | Installing 'community.general:7.3.0' to '/home/zuul/.ansible/collections/ansible_collections/community/general'
2026-08-28 04:01:49.470936 | instance | Created collection for community.general:7.3.0 at /home/zuul/.ansible/collections/ansible_collections/community/general
2026-08-28 04:01:49.471005 | instance | community.general:7.3.0 was installed successfully
2026-08-28 04:01:49.471037 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 04:01:49.471103 | instance | 2.17.12
2026-08-28 04:01:49.471183 | instance | Checked out community.mysql to 3.6.0
2026-08-28 04:01:49.471228 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.mysql
2026-08-28 04:01:49.471260 | instance | Starting galaxy collection install process
2026-08-28 04:01:49.471315 | instance | Process install dependency map
2026-08-28 04:01:49.471681 | instance | Starting collection install process
2026-08-28 04:01:49.471751 | instance | Installing 'community.mysql:3.6.0' to '/home/zuul/.ansible/collections/ansible_collections/community/mysql'
2026-08-28 04:01:49.471874 | instance | Created collection for community.mysql:3.6.0 at /home/zuul/.ansible/collections/ansible_collections/community/mysql
2026-08-28 04:01:49.471948 | instance | community.mysql:3.6.0 was installed successfully
2026-08-28 04:01:49.471993 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 04:01:49.472024 | instance | 2.17.12
2026-08-28 04:01:49.472081 | instance | Checked out kubernetes.core to 2.4.0
2026-08-28 04:01:49.472169 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/kubernetes.core
2026-08-28 04:01:49.472238 | instance | Starting galaxy collection install process
2026-08-28 04:01:49.472273 | instance | Process install dependency map
2026-08-28 04:01:49.472330 | instance | Starting collection install process
2026-08-28 04:01:49.472405 | instance | Installing 'kubernetes.core:2.4.0' to '/home/zuul/.ansible/collections/ansible_collections/kubernetes/core'
2026-08-28 04:01:49.472474 | instance | Created collection for kubernetes.core:2.4.0 at /home/zuul/.ansible/collections/ansible_collections/kubernetes/core
2026-08-28 04:01:49.472560 | instance | kubernetes.core:2.4.0 was installed successfully
2026-08-28 04:01:49.472598 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 04:01:49.472628 | instance | 2.17.12
2026-08-28 04:01:49.472689 | instance | Checked out openstack.cloud to 2.6.0
2026-08-28 04:01:49.472764 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/opendev.org/openstack/ansible-collections-openstack
2026-08-28 04:01:49.472844 | instance | Starting galaxy collection install process
2026-08-28 04:01:49.472911 | instance | Process install dependency map
2026-08-28 04:01:49.472945 | instance | Starting collection install process
2026-08-28 04:01:49.473103 | instance | Installing 'openstack.cloud:2.6.0' to '/home/zuul/.ansible/collections/ansible_collections/openstack/cloud'
2026-08-28 04:01:49.473148 | instance | Created collection for openstack.cloud:2.6.0 at /home/zuul/.ansible/collections/ansible_collections/openstack/cloud
2026-08-28 04:01:49.473180 | instance | openstack.cloud:2.6.0 was installed successfully
2026-08-28 04:01:49.473249 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 04:01:49.473346 | instance | 2.17.12
2026-08-28 04:01:49.473700 | instance | Checked out vexxhost.ceph to v4.2.0
2026-08-28 04:01:49.473790 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-ceph
2026-08-28 04:01:49.473832 | instance | Starting galaxy collection install process
2026-08-28 04:01:49.474022 | instance | Process install dependency map
2026-08-28 04:01:49.474169 | instance | Starting collection install process
2026-08-28 04:01:49.474337 | instance | Installing 'vexxhost.ceph:4.2.0' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph'
2026-08-28 04:01:49.474402 | instance | Created collection for vexxhost.ceph:4.2.0 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph
2026-08-28 04:01:49.474435 | instance | vexxhost.ceph:4.2.0 was installed successfully
2026-08-28 04:01:49.474464 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 04:01:49.474824 | instance | 2.17.12
2026-08-28 04:01:49.474958 | instance | Checked out vexxhost.containers to v1.6.8
2026-08-28 04:01:49.474999 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-containers
2026-08-28 04:01:49.475031 | instance | Starting galaxy collection install process
2026-08-28 04:01:49.475258 | instance | Process install dependency map
2026-08-28 04:01:49.475300 | instance | Starting collection install process
2026-08-28 04:01:49.475326 | instance | Installing 'vexxhost.containers:1.6.8' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers'
2026-08-28 04:01:49.475548 | instance | Created collection for vexxhost.containers:1.6.8 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/containers
2026-08-28 04:01:49.475652 | instance | vexxhost.containers:1.6.8 was installed successfully
2026-08-28 04:01:49.476005 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 04:01:49.476984 | instance | 2.17.12
2026-08-28 04:01:49.477023 | instance | Checked out vexxhost.kubernetes to v3.3.0
2026-08-28 04:01:49.477096 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes
2026-08-28 04:01:49.477126 | instance | Starting galaxy collection install process
2026-08-28 04:01:49.477151 | instance | Process install dependency map
2026-08-28 04:01:49.477208 | instance | Starting collection install process
2026-08-28 04:01:49.477239 | instance | Installing 'vexxhost.kubernetes:3.3.0' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes'
2026-08-28 04:01:49.477266 | instance | Created collection for vexxhost.kubernetes:3.3.0 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes
2026-08-28 04:01:49.477292 | instance | vexxhost.kubernetes:3.3.0 was installed successfully
2026-08-28 04:01:49.477318 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 04:01:49.477409 | instance | 2.17.12
2026-08-28 04:01:49.490671 | 
2026-08-28 04:01:49.490810 | PLAY RECAP
2026-08-28 04:01:49.490909 | instance | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-28 04:01:49.490947 | 
2026-08-28 04:01:49.689569 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-28 04:01:49.694826 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/pre.yml@main]
2026-08-28 04:01:50.286823 | 
2026-08-28 04:01:50.286962 | PLAY [all]
2026-08-28 04:01:50.298622 | 
2026-08-28 04:01:50.298716 | TASK [Install "jq" for log collection]
2026-08-28 04:02:00.215722 | instance | changed
2026-08-28 04:02:00.229868 | 
2026-08-28 04:02:00.230695 | PLAY RECAP
2026-08-28 04:02:00.230920 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-28 04:02:00.231124 | 
2026-08-28 04:02:00.380934 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/pre.yml@main]
2026-08-28 04:02:00.385773 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-28 04:02:00.969899 | 
2026-08-28 04:02:00.971355 | PLAY [all]
2026-08-28 04:02:00.985098 | 
2026-08-28 04:02:00.985255 | LOOP [Check inventory directories]
2026-08-28 04:02:01.380130 | instance | ok: "src/github.com/vexxhost/atmosphere"
2026-08-28 04:02:01.542722 | instance | ok: "src/github.com/vexxhost/atmosphere/molecule/csi/inventory"
2026-08-28 04:02:01.709264 | instance | ok: "src/github.com/vexxhost/atmosphere/extensions/molecule/csi/inventory"
2026-08-28 04:02:01.728390 | 
2026-08-28 04:02:01.728641 | LOOP [Copy inventory file for Zuul]
2026-08-28 04:02:02.517529 | instance | changed:
2026-08-28 04:02:02.517813 | instance | {
2026-08-28 04:02:02.517845 | instance |   "ansible_loop_var": "item",
2026-08-28 04:02:02.517868 | instance |   "changed": false,
2026-08-28 04:02:02.517889 | instance |   "failed": false,
2026-08-28 04:02:02.517910 | instance |   "invocation": {
2026-08-28 04:02:02.517929 | instance |     "module_args": {
2026-08-28 04:02:02.517948 | instance |       "checksum_algorithm": "sha1",
2026-08-28 04:02:02.517966 | instance |       "follow": true,
2026-08-28 04:02:02.517985 | instance |       "get_attributes": true,
2026-08-28 04:02:02.518003 | instance |       "get_checksum": true,
2026-08-28 04:02:02.518022 | instance |       "get_mime": true,
2026-08-28 04:02:02.518039 | instance |       "path": "src/github.com/vexxhost/atmosphere"
2026-08-28 04:02:02.518057 | instance |     }
2026-08-28 04:02:02.518075 | instance |   },
2026-08-28 04:02:02.518093 | instance |   "item": "src/github.com/vexxhost/atmosphere",
2026-08-28 04:02:02.518111 | instance |   "stat": {
2026-08-28 04:02:02.518130 | instance |     "atime": 1787889702.2787433,
2026-08-28 04:02:02.518148 | instance |     "attr_flags": "e",
2026-08-28 04:02:02.518166 | instance |     "attributes": [
2026-08-28 04:02:02.518184 | instance |       "extents"
2026-08-28 04:02:02.518202 | instance |     ],
2026-08-28 04:02:02.518219 | instance |     "block_size": 4096,
2026-08-28 04:02:02.518236 | instance |     "blocks": 8,
2026-08-28 04:02:02.518254 | instance |     "charset": "unknown",
2026-08-28 04:02:02.518273 | instance |     "ctime": 1787889701.322742,
2026-08-28 04:02:02.518290 | instance |     "dev": 64513,
2026-08-28 04:02:02.518308 | instance |     "device_type": 0,
2026-08-28 04:02:02.518325 | instance |     "executable": true,
2026-08-28 04:02:02.518342 | instance |     "exists": true,
2026-08-28 04:02:02.518360 | instance |     "gid": 1000,
2026-08-28 04:02:02.518377 | instance |     "gr_name": "zuul",
2026-08-28 04:02:02.518395 | instance |     "inode": 1047769,
2026-08-28 04:02:02.518413 | instance |     "isblk": false,
2026-08-28 04:02:02.518431 | instance |     "ischr": false,
2026-08-28 04:02:02.518448 | instance |     "isdir": true,
2026-08-28 04:02:02.518464 | instance |     "isfifo": false,
2026-08-28 04:02:02.518482 | instance |     "isgid": false,
2026-08-28 04:02:02.518499 | instance |     "islnk": false,
2026-08-28 04:02:02.518516 | instance |     "isreg": false,
2026-08-28 04:02:02.518533 | instance |     "issock": false,
2026-08-28 04:02:02.518550 | instance |     "isuid": false,
2026-08-28 04:02:02.518568 | instance |     "mimetype": "unknown",
2026-08-28 04:02:02.518585 | instance |     "mode": "0755",
2026-08-28 04:02:02.518602 | instance |     "mtime": 1787889701.322742,
2026-08-28 04:02:02.518619 | instance |     "nlink": 22,
2026-08-28 04:02:02.518636 | instance |     "path": "src/github.com/vexxhost/atmosphere",
2026-08-28 04:02:02.518653 | instance |     "pw_name": "zuul",
2026-08-28 04:02:02.518672 | instance |     "readable": true,
2026-08-28 04:02:02.518701 | instance |     "rgrp": true,
2026-08-28 04:02:02.518720 | instance |     "roth": true,
2026-08-28 04:02:02.518755 | instance |     "rusr": true,
2026-08-28 04:02:02.518782 | instance |     "size": 4096,
2026-08-28 04:02:02.518800 | instance |     "uid": 1000,
2026-08-28 04:02:02.518818 | instance |     "version": "1530962083",
2026-08-28 04:02:02.518835 | instance |     "wgrp": false,
2026-08-28 04:02:02.518854 | instance |     "woth": false,
2026-08-28 04:02:02.518871 | instance |     "writeable": true,
2026-08-28 04:02:02.518918 | instance |     "wusr": true,
2026-08-28 04:02:02.518941 | instance |     "xgrp": true,
2026-08-28 04:02:02.519020 | instance |     "xoth": true,
2026-08-28 04:02:02.519039 | instance |     "xusr": true
2026-08-28 04:02:02.519057 | instance |   }
2026-08-28 04:02:02.519075 | instance | }
2026-08-28 04:02:02.519109 | instance | ok: All items complete
2026-08-28 04:02:02.519131 | 
2026-08-28 04:02:02.520375 | instance | skipping: Conditional result was False
2026-08-28 04:02:02.520984 | instance | skipping: Conditional result was False
2026-08-28 04:02:02.531584 | 
2026-08-28 04:02:02.531772 | LOOP [Switch "ansible_host" to private IP]
2026-08-28 04:02:02.904557 | instance | changed: 1 replacements made
2026-08-28 04:02:03.059296 | instance | skipping: Conditional result was False
2026-08-28 04:02:03.060586 | instance | skipping: Conditional result was False
2026-08-28 04:02:03.074218 | 
2026-08-28 04:02:03.074359 | TASK [Run Molecule scenario]
2026-08-28 04:02:04.074733 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-08-28 04:02:04.472733 | instance | INFO     [csi > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-08-28 04:02:04.472813 | instance | INFO     [csi > prerun] Performing prerun with role_name_check=0...
2026-08-28 04:02:14.347866 | instance | INFO     [csi > dependency] Executing
2026-08-28 04:02:14.348274 | instance | WARNING  [csi > dependency] Missing roles requirements file: requirements.yml
2026-08-28 04:02:14.348724 | instance | WARNING  [csi > dependency] Missing collections requirements file: collections.yml
2026-08-28 04:02:14.349000 | instance | WARNING  [csi > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-08-28 04:02:14.365330 | instance | INFO     [csi > cleanup] Executing
2026-08-28 04:02:14.366060 | instance | WARNING  [csi > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-28 04:02:14.378440 | instance | INFO     [csi > destroy] Executing
2026-08-28 04:02:14.378485 | instance | WARNING  [csi > destroy] Skipping, '--destroy=never' requested.
2026-08-28 04:02:14.378603 | instance | INFO     [csi > destroy] Executed: Successful
2026-08-28 04:02:14.387761 | instance | INFO     [csi > syntax] Executing
2026-08-28 04:02:15.784405 | instance |
2026-08-28 04:02:15.784634 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-08-28 04:02:15.840077 | instance | INFO     [csi > syntax] Executed: Successful
2026-08-28 04:02:15.856737 | instance | INFO     [csi > create] Executing
2026-08-28 04:02:15.860330 | instance | WARNING  [csi > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-28 04:02:15.874908 | instance | INFO     [csi > prepare] Executing
2026-08-28 04:02:16.585790 | instance |
2026-08-28 04:02:16.585908 | instance | PLAY [Prepare] *****************************************************************
2026-08-28 04:02:16.586250 | instance |
2026-08-28 04:02:16.586487 | instance | TASK [Gathering Facts] *********************************************************
2026-08-28 04:02:16.586745 | instance | Friday 28 August 2026  04:02:16 +0000 (0:00:00.022)       0:00:00.022 *********
2026-08-28 04:02:17.855916 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-08-28 04:02:17.856137 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-28 04:02:17.856376 | instance | interpreter could change the meaning of that path. See
2026-08-28 04:02:17.856602 | instance | https://docs.ansible.com/ansible-
2026-08-28 04:02:17.856870 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-08-28 04:02:17.861698 | instance | ok: [instance]
2026-08-28 04:02:17.861930 | instance |
2026-08-28 04:02:17.862186 | instance | TASK [Configure short hostname] ************************************************
2026-08-28 04:02:17.862413 | instance | Friday 28 August 2026  04:02:17 +0000 (0:00:01.277)       0:00:01.299 *********
2026-08-28 04:02:18.590744 | instance | changed: [instance]
2026-08-28 04:02:18.590926 | instance |
2026-08-28 04:02:18.591164 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-08-28 04:02:18.591428 | instance | Friday 28 August 2026  04:02:18 +0000 (0:00:00.727)       0:00:02.027 *********
2026-08-28 04:02:18.874590 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-08-28 04:02:18.874770 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-08-28 04:02:18.875048 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-08-28 04:02:18.878698 | instance | changed: [instance]
2026-08-28 04:02:18.878919 | instance |
2026-08-28 04:02:18.879150 | instance | TASK [Purge "snapd" package] ***************************************************
2026-08-28 04:02:18.879375 | instance | Friday 28 August 2026  04:02:18 +0000 (0:00:00.289)       0:00:02.317 *********
2026-08-28 04:02:19.811941 | instance | ok: [instance]
2026-08-28 04:02:19.812030 | instance |
2026-08-28 04:02:19.812188 | instance | PLAY [Create devices for Ceph] *************************************************
2026-08-28 04:02:19.812327 | instance |
2026-08-28 04:02:19.812486 | instance | TASK [Gathering Facts] *********************************************************
2026-08-28 04:02:19.812649 | instance | Friday 28 August 2026  04:02:19 +0000 (0:00:00.932)       0:00:03.249 *********
2026-08-28 04:02:20.580146 | instance | ok: [instance]
2026-08-28 04:02:20.580234 | instance |
2026-08-28 04:02:20.580427 | instance | TASK [Install depedencies] *****************************************************
2026-08-28 04:02:20.580547 | instance | Friday 28 August 2026  04:02:20 +0000 (0:00:00.768)       0:00:04.017 *********
2026-08-28 04:02:42.800255 | instance | changed: [instance]
2026-08-28 04:02:42.800534 | instance |
2026-08-28 04:02:42.800674 | instance | TASK [Start up service] ********************************************************
2026-08-28 04:02:42.800914 | instance | Friday 28 August 2026  04:02:42 +0000 (0:00:22.220)       0:00:26.238 *********
2026-08-28 04:02:43.331555 | instance | ok: [instance]
2026-08-28 04:02:43.331877 | instance |
2026-08-28 04:02:43.332124 | instance | TASK [Generate lvm.conf] *******************************************************
2026-08-28 04:02:43.332355 | instance | Friday 28 August 2026  04:02:43 +0000 (0:00:00.530)       0:00:26.769 *********
2026-08-28 04:02:43.627744 | instance | ok: [instance]
2026-08-28 04:02:43.627946 | instance |
2026-08-28 04:02:43.628183 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-08-28 04:02:43.628414 | instance | Friday 28 August 2026  04:02:43 +0000 (0:00:00.296)       0:00:27.065 *********
2026-08-28 04:02:44.332149 | instance | changed: [instance]
2026-08-28 04:02:44.332225 | instance |
2026-08-28 04:02:44.332242 | instance | TASK [Get list of all loopback devices] ****************************************
2026-08-28 04:02:44.332255 | instance | Friday 28 August 2026  04:02:44 +0000 (0:00:00.703)       0:00:27.768 *********
2026-08-28 04:02:44.532380 | instance | ok: [instance]
2026-08-28 04:02:44.533054 | instance |
2026-08-28 04:02:44.533103 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-08-28 04:02:44.533116 | instance | Friday 28 August 2026  04:02:44 +0000 (0:00:00.201)       0:00:27.970 *********
2026-08-28 04:02:44.554135 | instance | skipping: [instance]
2026-08-28 04:02:44.554642 | instance |
2026-08-28 04:02:44.554689 | instance | TASK [Create devices for Ceph] *************************************************
2026-08-28 04:02:44.554697 | instance | Friday 28 August 2026  04:02:44 +0000 (0:00:00.022)       0:00:27.992 *********
2026-08-28 04:02:45.136185 | instance | changed: [instance] => (item=osd0)
2026-08-28 04:02:45.136324 | instance | changed: [instance] => (item=osd1)
2026-08-28 04:02:45.136562 | instance | changed: [instance] => (item=osd2)
2026-08-28 04:02:45.136744 | instance |
2026-08-28 04:02:45.136932 | instance | TASK [Set permissions on loopback devices] *************************************
2026-08-28 04:02:45.137118 | instance | Friday 28 August 2026  04:02:45 +0000 (0:00:00.581)       0:00:28.574 *********
2026-08-28 04:02:45.812706 | instance | changed: [instance] => (item=osd0)
2026-08-28 04:02:45.812936 | instance | changed: [instance] => (item=osd1)
2026-08-28 04:02:45.813287 | instance | changed: [instance] => (item=osd2)
2026-08-28 04:02:45.813598 | instance |
2026-08-28 04:02:45.813903 | instance | TASK [Start loop devices] ******************************************************
2026-08-28 04:02:45.814270 | instance | Friday 28 August 2026  04:02:45 +0000 (0:00:00.675)       0:00:29.250 *********
2026-08-28 04:02:46.535409 | instance | changed: [instance] => (item=osd0)
2026-08-28 04:02:46.535652 | instance | changed: [instance] => (item=osd1)
2026-08-28 04:02:46.535990 | instance | changed: [instance] => (item=osd2)
2026-08-28 04:02:46.536267 | instance |
2026-08-28 04:02:46.536573 | instance | TASK [Create a volume group for each loop device] ******************************
2026-08-28 04:02:46.536868 | instance | Friday 28 August 2026  04:02:46 +0000 (0:00:00.722)       0:00:29.972 *********
2026-08-28 04:02:49.719225 | instance | changed: [instance] => (item=osd0)
2026-08-28 04:02:49.720364 | instance | changed: [instance] => (item=osd1)
2026-08-28 04:02:49.720433 | instance | changed: [instance] => (item=osd2)
2026-08-28 04:02:49.720445 | instance |
2026-08-28 04:02:49.720455 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-08-28 04:02:49.720465 | instance | Friday 28 August 2026  04:02:49 +0000 (0:00:03.183)       0:00:33.156 *********
2026-08-28 04:02:51.648618 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-08-28 04:02:51.648688 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-08-28 04:02:51.648713 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-08-28 04:02:51.648723 | instance |
2026-08-28 04:02:51.648733 | instance | PLAY RECAP *********************************************************************
2026-08-28 04:02:51.648742 | instance | instance                   : ok=15   changed=9    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-08-28 04:02:51.648752 | instance |
2026-08-28 04:02:51.648760 | instance | Friday 28 August 2026  04:02:51 +0000 (0:00:01.927)       0:00:35.084 *********
2026-08-28 04:02:51.648769 | instance | ===============================================================================
2026-08-28 04:02:51.648778 | instance | Install depedencies ---------------------------------------------------- 22.22s
2026-08-28 04:02:51.648787 | instance | Create a volume group for each loop device ------------------------------ 3.18s
2026-08-28 04:02:51.648795 | instance | Create a logical volume for each loop device ---------------------------- 1.93s
2026-08-28 04:02:51.648809 | instance | Gathering Facts --------------------------------------------------------- 1.28s
2026-08-28 04:02:51.650031 | instance | Purge "snapd" package --------------------------------------------------- 0.93s
2026-08-28 04:02:51.650052 | instance | Gathering Facts --------------------------------------------------------- 0.77s
2026-08-28 04:02:51.650061 | instance | Configure short hostname ------------------------------------------------ 0.73s
2026-08-28 04:02:51.650069 | instance | Start loop devices ------------------------------------------------------ 0.72s
2026-08-28 04:02:51.650078 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.70s
2026-08-28 04:02:51.650129 | instance | Set permissions on loopback devices ------------------------------------- 0.68s
2026-08-28 04:02:51.650441 | instance | Create devices for Ceph ------------------------------------------------- 0.58s
2026-08-28 04:02:51.650752 | instance | Start up service -------------------------------------------------------- 0.53s
2026-08-28 04:02:51.651037 | instance | Generate lvm.conf ------------------------------------------------------- 0.30s
2026-08-28 04:02:51.651322 | instance | Ensure hostname inside hosts file --------------------------------------- 0.29s
2026-08-28 04:02:51.651611 | instance | Get list of all loopback devices ---------------------------------------- 0.20s
2026-08-28 04:02:51.651920 | instance | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-08-28 04:02:51.733946 | instance | INFO     [csi > prepare] Executed: Successful
2026-08-28 04:02:51.748462 | instance | INFO     [csi > converge] Executing
2026-08-28 04:02:53.024296 | instance |
2026-08-28 04:02:53.024642 | instance | PLAY [Debug CSI driver value] **************************************************
2026-08-28 04:02:53.024940 | instance |
2026-08-28 04:02:53.025223 | instance | TASK [Gathering Facts] *********************************************************
2026-08-28 04:02:53.025507 | instance | Friday 28 August 2026  04:02:53 +0000 (0:00:00.006)       0:00:00.006 *********
2026-08-28 04:02:54.052795 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-08-28 04:02:54.052855 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-28 04:02:54.052867 | instance | interpreter could change the meaning of that path. See
2026-08-28 04:02:54.052877 | instance | https://docs.ansible.com/ansible-
2026-08-28 04:02:54.052887 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-08-28 04:02:54.071780 | instance | ok: [instance]
2026-08-28 04:02:54.072870 | instance |
2026-08-28 04:02:54.072939 | instance | TASK [Display CSI driver value and environment variable] ***********************
2026-08-28 04:02:54.072954 | instance | Friday 28 August 2026  04:02:54 +0000 (0:00:01.046)       0:00:01.053 *********
2026-08-28 04:02:54.133205 | instance | ok: [instance] => {
2026-08-28 04:02:54.133400 | instance |     "msg": "csi_driver=rbd, MOLECULE_CSI_DRIVER="
2026-08-28 04:02:54.133735 | instance | }
2026-08-28 04:02:54.134073 | instance |
2026-08-28 04:02:54.134405 | instance | PLAY [all] *********************************************************************
2026-08-28 04:02:54.134709 | instance |
2026-08-28 04:02:54.135007 | instance | TASK [Gathering Facts] *********************************************************
2026-08-28 04:02:54.135322 | instance | Friday 28 August 2026  04:02:54 +0000 (0:00:00.062)       0:00:01.115 *********
2026-08-28 04:02:55.051974 | instance | ok: [instance]
2026-08-28 04:02:55.052146 | instance |
2026-08-28 04:02:55.052491 | instance | TASK [Fail if atmosphere_ceph_enabled is set] **********************************
2026-08-28 04:02:55.052777 | instance | Friday 28 August 2026  04:02:55 +0000 (0:00:00.918)       0:00:02.033 *********
2026-08-28 04:02:55.101634 | instance | skipping: [instance]
2026-08-28 04:02:55.101855 | instance |
2026-08-28 04:02:55.102205 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] *****************
2026-08-28 04:02:55.102504 | instance | Friday 28 August 2026  04:02:55 +0000 (0:00:00.049)       0:00:02.083 *********
2026-08-28 04:02:55.306446 | instance | ok: [instance]
2026-08-28 04:02:55.306782 | instance |
2026-08-28 04:02:55.307082 | instance | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-08-28 04:02:55.307355 | instance |
2026-08-28 04:02:55.307643 | instance | TASK [Gathering Facts] *********************************************************
2026-08-28 04:02:55.307968 | instance | Friday 28 August 2026  04:02:55 +0000 (0:00:00.203)       0:00:02.287 *********
2026-08-28 04:02:56.285355 | instance | ok: [instance]
2026-08-28 04:02:56.285710 | instance |
2026-08-28 04:02:56.286087 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-28 04:02:56.286394 | instance | Friday 28 August 2026  04:02:56 +0000 (0:00:00.977)       0:00:03.264 *********
2026-08-28 04:02:56.630516 | instance | ok: [instance]
2026-08-28 04:02:56.630558 | instance |
2026-08-28 04:02:56.630717 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-28 04:02:56.630894 | instance | Friday 28 August 2026  04:02:56 +0000 (0:00:00.348)       0:00:03.612 *********
2026-08-28 04:02:56.685213 | instance | skipping: [instance]
2026-08-28 04:02:56.685531 | instance |
2026-08-28 04:02:56.685881 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-28 04:02:56.686215 | instance | Friday 28 August 2026  04:02:56 +0000 (0:00:00.051)       0:00:03.664 *********
2026-08-28 04:02:57.072360 | instance | changed: [instance]
2026-08-28 04:02:57.072684 | instance |
2026-08-28 04:02:57.073012 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-28 04:02:57.073301 | instance | Friday 28 August 2026  04:02:57 +0000 (0:00:00.389)       0:00:04.054 *********
2026-08-28 04:02:57.162184 | instance | ok: [instance] => {
2026-08-28 04:02:57.162526 | instance |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-28 04:02:57.162842 | instance | }
2026-08-28 04:02:57.163123 | instance |
2026-08-28 04:02:57.163418 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-28 04:02:57.163732 | instance | Friday 28 August 2026  04:02:57 +0000 (0:00:00.089)       0:00:04.144 *********
2026-08-28 04:02:57.829921 | instance | changed: [instance]
2026-08-28 04:02:57.830313 | instance |
2026-08-28 04:02:57.830639 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-28 04:02:57.830985 | instance | Friday 28 August 2026  04:02:57 +0000 (0:00:00.667)       0:00:04.811 *********
2026-08-28 04:02:57.890879 | instance | skipping: [instance]
2026-08-28 04:02:57.891186 | instance |
2026-08-28 04:02:57.891485 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-28 04:02:57.891799 | instance | Friday 28 August 2026  04:02:57 +0000 (0:00:00.061)       0:00:04.873 *********
2026-08-28 04:02:57.933141 | instance | skipping: [instance]
2026-08-28 04:02:57.933450 | instance |
2026-08-28 04:02:57.933780 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-28 04:02:57.934121 | instance | Friday 28 August 2026  04:02:57 +0000 (0:00:00.042)       0:00:04.915 *********
2026-08-28 04:02:58.159264 | instance | ok: [instance]
2026-08-28 04:02:58.159606 | instance |
2026-08-28 04:02:58.159950 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-28 04:02:58.160256 | instance | Friday 28 August 2026  04:02:58 +0000 (0:00:00.225)       0:00:05.141 *********
2026-08-28 04:02:59.277091 | instance | ok: [instance]
2026-08-28 04:02:59.277420 | instance |
2026-08-28 04:02:59.277714 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-28 04:02:59.278076 | instance | Friday 28 August 2026  04:02:59 +0000 (0:00:01.117)       0:00:06.259 *********
2026-08-28 04:02:59.362462 | instance | ok: [instance] => {
2026-08-28 04:02:59.362656 | instance |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-28 04:02:59.363163 | instance | }
2026-08-28 04:02:59.363435 | instance |
2026-08-28 04:02:59.363743 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-28 04:02:59.364034 | instance | Friday 28 August 2026  04:02:59 +0000 (0:00:00.085)       0:00:06.344 *********
2026-08-28 04:03:00.106053 | instance | changed: [instance]
2026-08-28 04:03:00.106423 | instance |
2026-08-28 04:03:00.106749 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-28 04:03:00.107049 | instance | Friday 28 August 2026  04:03:00 +0000 (0:00:00.740)       0:00:07.085 *********
2026-08-28 04:03:03.068369 | instance | changed: [instance]
2026-08-28 04:03:03.068570 | instance |
2026-08-28 04:03:03.068583 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-28 04:03:03.068593 | instance | Friday 28 August 2026  04:03:03 +0000 (0:00:02.964)       0:00:10.049 *********
2026-08-28 04:03:03.108439 | instance | skipping: [instance]
2026-08-28 04:03:03.108480 | instance |
2026-08-28 04:03:03.108487 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-28 04:03:03.108494 | instance | Friday 28 August 2026  04:03:03 +0000 (0:00:00.040)       0:00:10.090 *********
2026-08-28 04:03:03.147031 | instance | skipping: [instance]
2026-08-28 04:03:03.147052 | instance |
2026-08-28 04:03:03.147058 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-28 04:03:03.147064 | instance | Friday 28 August 2026  04:03:03 +0000 (0:00:00.038)       0:00:10.128 *********
2026-08-28 04:03:03.189498 | instance | skipping: [instance]
2026-08-28 04:03:03.189535 | instance |
2026-08-28 04:03:03.189545 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-28 04:03:03.189555 | instance | Friday 28 August 2026  04:03:03 +0000 (0:00:00.042)       0:00:10.171 *********
2026-08-28 04:03:08.706059 | instance | changed: [instance]
2026-08-28 04:03:08.706152 | instance |
2026-08-28 04:03:08.706163 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-28 04:03:08.706181 | instance | Friday 28 August 2026  04:03:08 +0000 (0:00:05.516)       0:00:15.687 *********
2026-08-28 04:03:09.321641 | instance | changed: [instance]
2026-08-28 04:03:09.321778 | instance |
2026-08-28 04:03:09.322350 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-28 04:03:09.322413 | instance | Friday 28 August 2026  04:03:09 +0000 (0:00:00.615)       0:00:16.303 *********
2026-08-28 04:03:10.347133 | instance | changed: [instance] => (item={'path': '/etc/containerd'})
2026-08-28 04:03:10.348769 | instance | changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-28 04:03:10.348827 | instance | changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-28 04:03:10.348847 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-28 04:03:10.348858 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-28 04:03:10.348868 | instance |
2026-08-28 04:03:10.348877 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-28 04:03:10.348886 | instance | Friday 28 August 2026  04:03:10 +0000 (0:00:01.025)       0:00:17.329 *********
2026-08-28 04:03:10.989728 | instance | changed: [instance]
2026-08-28 04:03:10.989816 | instance |
2026-08-28 04:03:10.990141 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-28 04:03:10.990197 | instance | Friday 28 August 2026  04:03:10 +0000 (0:00:00.618)       0:00:17.947 *********
2026-08-28 04:03:10.990600 | instance |
2026-08-28 04:03:10.990648 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-28 04:03:10.990656 | instance | Friday 28 August 2026  04:03:10 +0000 (0:00:00.024)       0:00:17.972 *********
2026-08-28 04:03:11.985526 | instance | ok: [instance]
2026-08-28 04:03:11.986056 | instance |
2026-08-28 04:03:11.986126 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-08-28 04:03:11.986320 | instance | Friday 28 August 2026  04:03:11 +0000 (0:00:00.995)       0:00:18.967 *********
2026-08-28 04:03:12.457653 | instance | changed: [instance]
2026-08-28 04:03:12.458017 | instance |
2026-08-28 04:03:12.458403 | instance | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-28 04:03:12.458454 | instance | Friday 28 August 2026  04:03:12 +0000 (0:00:00.472)       0:00:19.439 *********
2026-08-28 04:03:13.060971 | instance | changed: [instance]
2026-08-28 04:03:13.061078 | instance |
2026-08-28 04:03:13.061419 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-28 04:03:13.061467 | instance | Friday 28 August 2026  04:03:13 +0000 (0:00:00.603)       0:00:20.043 *********
2026-08-28 04:03:13.303380 | instance | ok: [instance]
2026-08-28 04:03:13.304080 | instance |
2026-08-28 04:03:13.304130 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-28 04:03:13.304141 | instance | Friday 28 August 2026  04:03:13 +0000 (0:00:00.241)       0:00:20.285 *********
2026-08-28 04:03:13.351822 | instance | ok: [instance] => {
2026-08-28 04:03:13.352973 | instance |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-28 04:03:13.353010 | instance | }
2026-08-28 04:03:13.353022 | instance |
2026-08-28 04:03:13.353031 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-28 04:03:13.353042 | instance | Friday 28 August 2026  04:03:13 +0000 (0:00:00.048)       0:00:20.333 *********
2026-08-28 04:03:14.149889 | instance | changed: [instance]
2026-08-28 04:03:14.150582 | instance |
2026-08-28 04:03:14.150615 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-28 04:03:14.150626 | instance | Friday 28 August 2026  04:03:14 +0000 (0:00:00.798)       0:00:21.132 *********
2026-08-28 04:03:18.483185 | instance | changed: [instance]
2026-08-28 04:03:18.483261 | instance |
2026-08-28 04:03:18.483470 | instance | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-28 04:03:18.483503 | instance | Friday 28 August 2026  04:03:18 +0000 (0:00:04.333)       0:00:25.465 *********
2026-08-28 04:03:19.507057 | instance | ok: [instance]
2026-08-28 04:03:19.507768 | instance |
2026-08-28 04:03:19.507823 | instance | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-28 04:03:19.507835 | instance | Friday 28 August 2026  04:03:19 +0000 (0:00:01.023)       0:00:26.488 *********
2026-08-28 04:03:19.858125 | instance | changed: [instance]
2026-08-28 04:03:19.858204 | instance |
2026-08-28 04:03:19.858577 | instance | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-28 04:03:19.858625 | instance | Friday 28 August 2026  04:03:19 +0000 (0:00:00.350)       0:00:26.839 *********
2026-08-28 04:03:20.348030 | instance | changed: [instance]
2026-08-28 04:03:20.348757 | instance |
2026-08-28 04:03:20.348814 | instance | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-28 04:03:20.348826 | instance | Friday 28 August 2026  04:03:20 +0000 (0:00:00.489)       0:00:27.329 *********
2026-08-28 04:03:20.962733 | instance | changed: [instance] => (item={'path': '/etc/docker'})
2026-08-28 04:03:20.963889 | instance | changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-28 04:03:20.963941 | instance | changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-28 04:03:20.963952 | instance |
2026-08-28 04:03:20.963962 | instance | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-28 04:03:20.963971 | instance | Friday 28 August 2026  04:03:20 +0000 (0:00:00.615)       0:00:27.944 *********
2026-08-28 04:03:21.427419 | instance | changed: [instance]
2026-08-28 04:03:21.428087 | instance |
2026-08-28 04:03:21.428138 | instance | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-28 04:03:21.428150 | instance | Friday 28 August 2026  04:03:21 +0000 (0:00:00.464)       0:00:28.409 *********
2026-08-28 04:03:21.913803 | instance | changed: [instance]
2026-08-28 04:03:21.913871 | instance |
2026-08-28 04:03:21.914075 | instance | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-28 04:03:21.914158 | instance | Friday 28 August 2026  04:03:21 +0000 (0:00:00.469)       0:00:28.878 *********
2026-08-28 04:03:21.914422 | instance |
2026-08-28 04:03:21.914455 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-28 04:03:21.914465 | instance | Friday 28 August 2026  04:03:21 +0000 (0:00:00.017)       0:00:28.896 *********
2026-08-28 04:03:22.677053 | instance | ok: [instance]
2026-08-28 04:03:22.677102 | instance |
2026-08-28 04:03:22.677114 | instance | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-08-28 04:03:22.677124 | instance | Friday 28 August 2026  04:03:22 +0000 (0:00:00.761)       0:00:29.658 *********
2026-08-28 04:03:23.671022 | instance | changed: [instance]
2026-08-28 04:03:23.671731 | instance |
2026-08-28 04:03:23.671763 | instance | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-28 04:03:23.671775 | instance | Friday 28 August 2026  04:03:23 +0000 (0:00:00.994)       0:00:30.652 *********
2026-08-28 04:03:24.301580 | instance | changed: [instance]
2026-08-28 04:03:24.301618 | instance |
2026-08-28 04:03:24.301627 | instance | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-28 04:03:24.301633 | instance | Friday 28 August 2026  04:03:24 +0000 (0:00:00.630)       0:00:31.283 *********
2026-08-28 04:03:24.369018 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-28 04:03:24.369080 | instance |
2026-08-28 04:03:24.369407 | instance | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-28 04:03:24.369445 | instance | Friday 28 August 2026  04:03:24 +0000 (0:00:00.067)       0:00:31.351 *********
2026-08-28 04:03:29.961038 | instance | changed: [instance]
2026-08-28 04:03:29.961092 | instance |
2026-08-28 04:03:29.961103 | instance | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-28 04:03:29.961114 | instance | Friday 28 August 2026  04:03:29 +0000 (0:00:05.590)       0:00:36.942 *********
2026-08-28 04:03:30.649880 | instance | ok: [instance] => (item=chronyd)
2026-08-28 04:03:30.650835 | instance | ok: [instance] => (item=sshd)
2026-08-28 04:03:30.651054 | instance |
2026-08-28 04:03:30.651067 | instance | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-28 04:03:30.651077 | instance | Friday 28 August 2026  04:03:30 +0000 (0:00:00.689)       0:00:37.631 *********
2026-08-28 04:03:32.019123 | instance | changed: [instance]
2026-08-28 04:03:32.019180 | instance |
2026-08-28 04:03:32.019192 | instance | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-28 04:03:32.019202 | instance | Friday 28 August 2026  04:03:32 +0000 (0:00:01.368)       0:00:39.000 *********
2026-08-28 04:03:32.242078 | instance | ok: [instance]
2026-08-28 04:03:32.242826 | instance |
2026-08-28 04:03:32.243133 | instance | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-28 04:03:32.243147 | instance | Friday 28 August 2026  04:03:32 +0000 (0:00:00.223)       0:00:39.223 *********
2026-08-28 04:03:32.729181 | instance | changed: [instance]
2026-08-28 04:03:32.729261 | instance |
2026-08-28 04:03:32.729617 | instance | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-28 04:03:32.729675 | instance | Friday 28 August 2026  04:03:32 +0000 (0:00:00.487)       0:00:39.711 *********
2026-08-28 04:03:33.085002 | instance | changed: [instance]
2026-08-28 04:03:33.085071 | instance |
2026-08-28 04:03:33.085139 | instance | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-08-28 04:03:33.085294 | instance | Friday 28 August 2026  04:03:33 +0000 (0:00:00.355)       0:00:40.067 *********
2026-08-28 04:03:33.315992 | instance | ok: [instance]
2026-08-28 04:03:33.316115 | instance |
2026-08-28 04:03:33.316196 | instance | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-08-28 04:03:33.316378 | instance | Friday 28 August 2026  04:03:33 +0000 (0:00:00.230)       0:00:40.298 *********
2026-08-28 04:03:33.575303 | instance | ok: [instance] => (item=instance)
2026-08-28 04:03:33.576087 | instance |
2026-08-28 04:03:33.576170 | instance | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-08-28 04:03:33.576183 | instance | Friday 28 August 2026  04:03:33 +0000 (0:00:00.258)       0:00:40.556 *********
2026-08-28 04:03:33.650686 | instance | ok: [instance]
2026-08-28 04:03:33.650842 | instance |
2026-08-28 04:03:33.651070 | instance | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-08-28 04:03:33.651291 | instance | Friday 28 August 2026  04:03:33 +0000 (0:00:00.075)       0:00:40.632 *********
2026-08-28 04:03:33.769950 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for instance
2026-08-28 04:03:33.770078 | instance |
2026-08-28 04:03:33.770281 | instance | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-08-28 04:03:33.770469 | instance | Friday 28 August 2026  04:03:33 +0000 (0:00:00.119)       0:00:40.752 *********
2026-08-28 04:03:34.036990 | instance | changed: [instance]
2026-08-28 04:03:34.037186 | instance |
2026-08-28 04:03:34.037413 | instance | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-08-28 04:03:34.037653 | instance | Friday 28 August 2026  04:03:34 +0000 (0:00:00.266)       0:00:41.018 *********
2026-08-28 04:03:34.756171 | instance | changed: [instance] => (item={'option': 'mon allow pool size one', 'section': 'global', 'value': True})
2026-08-28 04:03:34.756397 | instance | changed: [instance] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-08-28 04:03:34.756652 | instance | changed: [instance] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-08-28 04:03:34.756857 | instance |
2026-08-28 04:03:34.757079 | instance | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-08-28 04:03:34.757307 | instance | Friday 28 August 2026  04:03:34 +0000 (0:00:00.719)       0:00:41.738 *********
2026-08-28 04:04:58.940348 | instance | ok: [instance]
2026-08-28 04:04:58.940406 | instance |
2026-08-28 04:04:58.940414 | instance | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-08-28 04:04:58.940421 | instance | Friday 28 August 2026  04:04:58 +0000 (0:01:24.183)       0:02:05.921 *********
2026-08-28 04:04:59.139188 | instance | changed: [instance]
2026-08-28 04:04:59.139237 | instance |
2026-08-28 04:04:59.139245 | instance | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-08-28 04:04:59.139252 | instance | Friday 28 August 2026  04:04:59 +0000 (0:00:00.199)       0:02:06.120 *********
2026-08-28 04:04:59.176649 | instance | ok: [instance]
2026-08-28 04:04:59.176690 | instance |
2026-08-28 04:04:59.176698 | instance | TASK [Install Ceph host] *******************************************************
2026-08-28 04:04:59.176705 | instance | Friday 28 August 2026  04:04:59 +0000 (0:00:00.037)       0:02:06.158 *********
2026-08-28 04:04:59.253949 | instance | included: vexxhost.ceph.cephadm_host for instance
2026-08-28 04:04:59.254003 | instance |
2026-08-28 04:04:59.254008 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-28 04:04:59.254013 | instance | Friday 28 August 2026  04:04:59 +0000 (0:00:00.078)       0:02:06.236 *********
2026-08-28 04:05:00.787028 | instance | ok: [instance]
2026-08-28 04:05:00.787125 | instance |
2026-08-28 04:05:00.787292 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-28 04:05:00.787431 | instance | Friday 28 August 2026  04:05:00 +0000 (0:00:01.533)       0:02:07.769 *********
2026-08-28 04:05:00.829053 | instance | ok: [instance] => (item=instance)
2026-08-28 04:05:00.829133 | instance |
2026-08-28 04:05:00.829175 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-28 04:05:00.829283 | instance | Friday 28 August 2026  04:05:00 +0000 (0:00:00.042)       0:02:07.811 *********
2026-08-28 04:05:01.193503 | instance | ok: [instance]
2026-08-28 04:05:01.193669 | instance |
2026-08-28 04:05:01.193864 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-28 04:05:01.194124 | instance | Friday 28 August 2026  04:05:01 +0000 (0:00:00.363)       0:02:08.175 *********
2026-08-28 04:05:03.395226 | instance | ok: [instance]
2026-08-28 04:05:03.395312 | instance |
2026-08-28 04:05:03.395663 | instance | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-08-28 04:05:03.395707 | instance | Friday 28 August 2026  04:05:03 +0000 (0:00:02.201)       0:02:10.377 *********
2026-08-28 04:05:50.792593 | instance | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: [errno 5] RADOS I/O error (error connecting to the cluster)
2026-08-28 04:05:50.793496 | instance | fatal: [instance]: FAILED! => {"changed": false, "module_stderr": "Traceback (most recent call last):\n  File \"<stdin>\", line 107, in <module>\n  File \"<stdin>\", line 99, in _ansiballz_main\n  File \"<stdin>\", line 47, in invoke_module\n  File \"/usr/lib/python3.10/runpy.py\", line 224, in run_module\n    return _run_module_code(code, init_globals, run_name, mod_spec)\n  File \"/usr/lib/python3.10/runpy.py\", line 96, in _run_module_code\n    _run_code(code, mod_globals, init_globals,\n  File \"/usr/lib/python3.10/runpy.py\", line 86, in _run_code\n    exec(code, run_globals)\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_28oeq9_l/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 202, in <module>\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_28oeq9_l/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 198, in main\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_28oeq9_l/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 177, in run_module\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_28oeq9_l/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 120, in apply_spec\nRuntimeError: Inferring config /var/lib/ceph/4837cbf8-4f90-4300-b3f6-726c9b9f89b4/mon.instance/config\n2026-08-28T04:05:50.633+0000 7f8a3309a640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgDGCJFqHZGdASAAWixyCZxasRE5GxFFJhcJ8hlpf/VLIbK1GcTgkzpIhaY=: Malformed input [buffer:3]\n2026-08-28T04:05:50.633+0000 7f8a3309a640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-08-28T04:05:50.637+0000 7f8a3309a640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgDGCJFqHZGdASAAWixyCZxasRE5GxFFJhcJ8hlpf/VLIbK1GcTgkzpIhaY=: Malformed input [buffer:3]\n2026-08-28T04:05:50.637+0000 7f8a3309a640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-08-28T04:05:50.637+0000 7f8a3309a640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgDGCJFqHZGdASAAWixyCZxasRE5GxFFJhcJ8hlpf/VLIbK1GcTgkzpIhaY=: Malformed input [buffer:3]\n2026-08-28T04:05:50.637+0000 7f8a3309a640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-08-28T04:05:50.637+0000 7f8a3309a640 -1 monclient: keyring not found\n[errno 5] RADOS I/O error (error connecting to the cluster)\n\n", "module_stdout": "", "msg": "MODULE FAILURE\nSee stdout/stderr for the exact error", "rc": 1}
2026-08-28 04:05:50.799728 | instance |
2026-08-28 04:05:50.799778 | instance | PLAY RECAP *********************************************************************
2026-08-28 04:05:50.799787 | instance | instance                   : ok=55   changed=26   unreachable=0    failed=1    skipped=7    rescued=0    ignored=0
2026-08-28 04:05:50.799794 | instance |
2026-08-28 04:05:50.799800 | instance | Friday 28 August 2026  04:05:50 +0000 (0:00:47.401)       0:02:57.779 *********
2026-08-28 04:05:50.799806 | instance | ===============================================================================
2026-08-28 04:05:50.799812 | instance | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 84.18s
2026-08-28 04:05:50.799817 | instance | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 47.40s
2026-08-28 04:05:50.799823 | instance | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.59s
2026-08-28 04:05:50.799828 | instance | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.52s
2026-08-28 04:05:50.799834 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 4.33s
2026-08-28 04:05:50.799840 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 2.96s
2026-08-28 04:05:50.799858 | instance | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.20s
2026-08-28 04:05:50.799864 | instance | vexxhost.containers.containerd : Reload systemd ------------------------- 1.76s
2026-08-28 04:05:50.799870 | instance | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.53s
2026-08-28 04:05:50.799876 | instance | vexxhost.ceph.cephadm : Download "cephadm" ------------------------------ 1.37s
2026-08-28 04:05:50.799881 | instance | vexxhost.containers.package : Update state for tar ---------------------- 1.12s
2026-08-28 04:05:50.799890 | instance | Gathering Facts --------------------------------------------------------- 1.05s
2026-08-28 04:05:50.800101 | instance | vexxhost.containers.containerd : Create folders for configuration ------- 1.03s
2026-08-28 04:05:50.800392 | instance | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.02s
2026-08-28 04:05:50.800669 | instance | vexxhost.containers.docker : Restart docker ----------------------------- 0.99s
2026-08-28 04:05:50.800969 | instance | Gathering Facts --------------------------------------------------------- 0.98s
2026-08-28 04:05:50.801254 | instance | Gathering Facts --------------------------------------------------------- 0.92s
2026-08-28 04:05:50.801533 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.80s
2026-08-28 04:05:50.801829 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.74s
2026-08-28 04:05:50.802136 | instance | vexxhost.ceph.mon : Include extra configuration values ------------------ 0.72s
2026-08-28 04:05:50.896738 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-08-28 04:05:50.897017 | instance | ERROR    [csi > converge] Executed: Failed
2026-08-28 04:05:50.897188 | instance | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-08-28 04:05:51.450986 | instance | ERROR
2026-08-28 04:05:51.451238 | instance | {
2026-08-28 04:05:51.451278 | instance |   "delta": "0:03:47.518102",
2026-08-28 04:05:51.451306 | instance |   "end": "2026-08-28 04:05:50.961446",
2026-08-28 04:05:51.451333 | instance |   "msg": "non-zero return code",
2026-08-28 04:05:51.451358 | instance |   "rc": 2,
2026-08-28 04:05:51.451383 | instance |   "start": "2026-08-28 04:02:03.443344"
2026-08-28 04:05:51.451407 | instance | }
failure
2026-08-28 04:05:51.459499 | 
2026-08-28 04:05:51.459548 | PLAY RECAP
2026-08-28 04:05:51.459596 | instance | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-08-28 04:05:51.459740 | 
2026-08-28 04:05:51.662633 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-28 04:05:51.665369 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/post.yml@main]
2026-08-28 04:05:52.310262 | 
2026-08-28 04:05:52.310396 | PLAY [all]
2026-08-28 04:05:52.324216 | 
2026-08-28 04:05:52.324291 | TASK [gather-host-logs : creating directory for system status]
2026-08-28 04:05:52.682242 | instance | changed
2026-08-28 04:05:52.688586 | 
2026-08-28 04:05:52.688667 | TASK [gather-host-logs : Get logs for each host]
2026-08-28 04:05:53.048038 | instance | + systemd-cgls --full --all --no-pager
2026-08-28 04:05:53.067966 | instance | + ip addr
2026-08-28 04:05:53.070321 | instance | + ip route
2026-08-28 04:05:53.072452 | instance | + lsblk
2026-08-28 04:05:53.075048 | instance | + mount
2026-08-28 04:05:53.077763 | instance | + docker images
2026-08-28 04:05:53.098680 | instance | + brctl show
2026-08-28 04:05:53.099157 | instance | /bin/bash: line 8: brctl: command not found
2026-08-28 04:05:53.099453 | instance | + ps aux --sort=-%mem
2026-08-28 04:05:53.134679 | instance | + dpkg -l
2026-08-28 04:05:53.145554 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-08-28 04:05:53.146033 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-08-28 04:05:53.157666 | instance | + '[' '!' -z '' ']'
2026-08-28 04:05:53.228653 | instance | ok: Runtime: 0:00:00.114054
2026-08-28 04:05:53.236535 | 
2026-08-28 04:05:53.236625 | TASK [gather-host-logs : Downloads logs to executor]
2026-08-28 04:05:53.890271 | instance | changed:
2026-08-28 04:05:53.890481 | instance | created directory /var/lib/zuul/builds/4670db494a3849cdb363c1cf78b0db7b/work/logs/instance
2026-08-28 04:05:53.890521 | instance | cd+++++++++ system/
2026-08-28 04:05:53.890552 | instance | >f+++++++++ system/brctl-show.txt
2026-08-28 04:05:53.890581 | instance | >f+++++++++ system/docker-images.txt
2026-08-28 04:05:53.890609 | instance | >f+++++++++ system/ip-addr.txt
2026-08-28 04:05:53.890640 | instance | >f+++++++++ system/ip-route.txt
2026-08-28 04:05:53.890669 | instance | >f+++++++++ system/lsblk.txt
2026-08-28 04:05:53.890696 | instance | >f+++++++++ system/mount.txt
2026-08-28 04:05:53.890723 | instance | >f+++++++++ system/packages.txt
2026-08-28 04:05:53.890749 | instance | >f+++++++++ system/ps.txt
2026-08-28 04:05:53.890778 | instance | >f+++++++++ system/systemd-cgls.txt
2026-08-28 04:05:53.902610 | 
2026-08-28 04:05:53.902682 | LOOP [helm-release-status : creating directory for helm release status]
2026-08-28 04:05:54.114980 | instance | changed: "values"
2026-08-28 04:05:54.255878 | instance | changed: "releases"
2026-08-28 04:05:54.268227 | 
2026-08-28 04:05:54.268380 | TASK [helm-release-status : Gather get release status for helm charts]
2026-08-28 04:05:54.496971 | instance | /bin/bash: line 3: kubectl: command not found
2026-08-28 04:05:54.811675 | instance | ok: Runtime: 0:00:00.004948
2026-08-28 04:05:54.817702 | 
2026-08-28 04:05:54.817774 | TASK [helm-release-status : Downloads logs to executor]
2026-08-28 04:05:55.327032 | instance | changed:
2026-08-28 04:05:55.327209 | instance | cd+++++++++ helm/
2026-08-28 04:05:55.327249 | instance | cd+++++++++ helm/releases/
2026-08-28 04:05:55.327281 | instance | cd+++++++++ helm/values/
2026-08-28 04:05:55.338155 | 
2026-08-28 04:05:55.338223 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-08-28 04:05:55.554082 | instance | changed
2026-08-28 04:05:55.562009 | 
2026-08-28 04:05:55.562085 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-08-28 04:05:55.827302 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-08-28 04:05:55.827426 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-08-28 04:05:55.832939 | instance | environment: line 1: kubectl: command not found
2026-08-28 04:05:55.834193 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-08-28 04:05:55.835619 | instance | environment: line 1: kubectl: command not found
2026-08-28 04:05:55.837596 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-08-28 04:05:55.838046 | instance | environment: line 1: kubectl: command not found
2026-08-28 04:05:55.839345 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-08-28 04:05:55.841159 | instance | environment: line 1: kubectl: command not found
2026-08-28 04:05:55.842375 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-08-28 04:05:55.842699 | instance | environment: line 1: kubectl: command not found
2026-08-28 04:05:55.843943 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-08-28 04:05:56.099709 | instance | ok: Runtime: 0:00:00.024217
2026-08-28 04:05:56.106727 | 
2026-08-28 04:05:56.106811 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-08-28 04:05:56.520811 | instance | changed
2026-08-28 04:05:56.526209 | 
2026-08-28 04:05:56.526292 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-08-28 04:05:56.751670 | instance | environment: line 5: kubectl: command not found
2026-08-28 04:05:56.752182 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-08-28 04:05:56.752387 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-08-28 04:05:56.752814 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-08-28 04:05:57.066414 | instance | ok: Runtime: 0:00:00.006126
2026-08-28 04:05:57.073474 | 
2026-08-28 04:05:57.073543 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-08-28 04:05:57.582336 | instance | changed:
2026-08-28 04:05:57.582511 | instance | cd+++++++++ objects/
2026-08-28 04:05:57.582549 | instance | cd+++++++++ objects/cluster/
2026-08-28 04:05:57.582581 | instance | cd+++++++++ objects/namespaced/
2026-08-28 04:05:57.594060 | 
2026-08-28 04:05:57.594126 | TASK [gather-pod-logs : creating directory for pod logs]
2026-08-28 04:05:57.809793 | instance | changed
2026-08-28 04:05:57.816476 | 
2026-08-28 04:05:57.816567 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-08-28 04:05:58.032849 | instance | changed
2026-08-28 04:05:58.057760 | 
2026-08-28 04:05:58.057855 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-08-28 04:05:58.287203 | instance | environment: line 3: kubectl: command not found
2026-08-28 04:05:58.594917 | instance | ok: Runtime: 0:00:00.007192
2026-08-28 04:05:58.600595 | 
2026-08-28 04:05:58.600669 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-08-28 04:05:59.127383 | instance | changed:
2026-08-28 04:05:59.127564 | instance | cd+++++++++ pod-logs/
2026-08-28 04:05:59.127593 | instance | cd+++++++++ pod-logs/failed-pods/
2026-08-28 04:05:59.137434 | 
2026-08-28 04:05:59.137502 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-08-28 04:05:59.355564 | instance | changed
2026-08-28 04:05:59.361296 | 
2026-08-28 04:05:59.361368 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-08-28 04:05:59.591554 | instance | /bin/bash: line 2: kubectl: command not found
2026-08-28 04:05:59.899493 | instance | ok: Runtime: 0:00:00.052518
2026-08-28 04:05:59.907511 | 
2026-08-28 04:05:59.907693 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-08-28 04:06:00.139333 | instance | /bin/bash: line 2: kubectl: command not found
2026-08-28 04:06:00.183501 | instance | ceph-mgr endpoints:
2026-08-28 04:06:00.453400 | instance | ok: Runtime: 0:00:00.049401
2026-08-28 04:06:00.461311 | 
2026-08-28 04:06:00.461383 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-08-28 04:06:00.682848 | instance | /bin/bash: line 4: kubectl: command not found
2026-08-28 04:06:01.000119 | instance | ok: Runtime: 0:00:00.049551
2026-08-28 04:06:01.007874 | 
2026-08-28 04:06:01.007961 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-08-28 04:06:01.507229 | instance | changed: cd+++++++++ prometheus/
2026-08-28 04:06:01.518961 | 
2026-08-28 04:06:01.519031 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-08-28 04:06:01.735443 | instance | changed
2026-08-28 04:06:01.742082 | 
2026-08-28 04:06:01.742154 | TASK [gather-selenium-data : Get selenium data]
2026-08-28 04:06:02.003445 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-08-28 04:06:02.004863 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-08-28 04:06:02.280379 | instance | ERROR
2026-08-28 04:06:02.280786 | instance | {
2026-08-28 04:06:02.280854 | instance |   "delta": "0:00:00.005660",
2026-08-28 04:06:02.280890 | instance |   "end": "2026-08-28 04:06:02.005169",
2026-08-28 04:06:02.280918 | instance |   "msg": "non-zero return code",
2026-08-28 04:06:02.280945 | instance |   "rc": 1,
2026-08-28 04:06:02.280996 | instance |   "start": "2026-08-28 04:06:01.999509"
2026-08-28 04:06:02.281023 | instance | }
2026-08-28 04:06:02.281055 | instance | ERROR: Ignoring Errors
2026-08-28 04:06:02.287978 | 
2026-08-28 04:06:02.288065 | TASK [gather-selenium-data : Downloads logs to executor]
2026-08-28 04:06:02.809267 | instance | changed: cd+++++++++ selenium/
2026-08-28 04:06:02.817433 | 
2026-08-28 04:06:02.817494 | PLAY RECAP
2026-08-28 04:06:02.817545 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-08-28 04:06:02.817567 | 
2026-08-28 04:06:02.958306 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/post.yml@main]
2026-08-28 04:06:02.962122 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-28 04:06:03.576391 | 
2026-08-28 04:06:03.576562 | PLAY [all]
2026-08-28 04:06:03.588507 | 
2026-08-28 04:06:03.588586 | TASK [fetch-output : Set log path for multiple nodes]
2026-08-28 04:06:03.634455 | instance | skipping: Conditional result was False
2026-08-28 04:06:03.642389 | 
2026-08-28 04:06:03.642497 | TASK [fetch-output : Set log path for single node]
2026-08-28 04:06:03.688183 | instance | ok
2026-08-28 04:06:03.693148 | 
2026-08-28 04:06:03.693224 | LOOP [fetch-output : Ensure local output dirs]
2026-08-28 04:06:04.078507 | instance -> localhost | ok: "/var/lib/zuul/builds/4670db494a3849cdb363c1cf78b0db7b/work/logs"
2026-08-28 04:06:04.300020 | instance -> localhost | changed: "/var/lib/zuul/builds/4670db494a3849cdb363c1cf78b0db7b/work/artifacts"
2026-08-28 04:06:04.520462 | instance -> localhost | changed: "/var/lib/zuul/builds/4670db494a3849cdb363c1cf78b0db7b/work/docs"
2026-08-28 04:06:04.542961 | 
2026-08-28 04:06:04.543128 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-08-28 04:06:05.219274 | instance | changed: .d..t...... ./
2026-08-28 04:06:05.219522 | instance | changed: All items complete
2026-08-28 04:06:05.219560 | 
2026-08-28 04:06:05.698742 | instance | changed: .d..t...... ./
2026-08-28 04:06:06.143075 | instance | changed: .d..t...... ./
2026-08-28 04:06:06.159547 | 
2026-08-28 04:06:06.159678 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-08-28 04:06:06.578206 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.007094
2026-08-28 04:06:06.807031 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.008672
2026-08-28 04:06:06.823738 | 
2026-08-28 04:06:06.823861 | PLAY [all]
2026-08-28 04:06:06.829919 | 
2026-08-28 04:06:06.829989 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-08-28 04:06:07.298118 | instance | changed
2026-08-28 04:06:07.305541 | 
2026-08-28 04:06:07.305591 | PLAY RECAP
2026-08-28 04:06:07.305635 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-28 04:06:07.305658 | 
2026-08-28 04:06:07.423939 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-28 04:06:07.427325 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-08-28 04:06:08.019304 | 
2026-08-28 04:06:08.019445 | PLAY [localhost]
2026-08-28 04:06:08.029553 | 
2026-08-28 04:06:08.029626 | TASK [Generate Zuul manifest]
2026-08-28 04:06:08.049323 | localhost | ok
2026-08-28 04:06:08.067220 | 
2026-08-28 04:06:08.067301 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-08-28 04:06:08.574303 | localhost | changed
2026-08-28 04:06:08.586308 | 
2026-08-28 04:06:08.586386 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-08-28 04:06:08.638580 | localhost | ok
2026-08-28 04:06:08.648495 | 
2026-08-28 04:06:08.648556 | TASK [Upload logs]
2026-08-28 04:06:08.669381 | localhost | ok
2026-08-28 04:06:08.787569 | 
2026-08-28 04:06:08.787739 | TASK [Set zuul-log-path fact]
2026-08-28 04:06:08.808670 | localhost | ok
2026-08-28 04:06:08.822256 | 
2026-08-28 04:06:08.822330 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-28 04:06:08.854349 | localhost | ok
2026-08-28 04:06:08.863712 | 
2026-08-28 04:06:08.863813 | TASK [upload-logs : Create log directories]
2026-08-28 04:06:09.294895 | localhost | changed
2026-08-28 04:06:09.301629 | 
2026-08-28 04:06:09.301734 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-08-28 04:06:09.709308 | localhost -> localhost | ok: Runtime: 0:00:00.005823
2026-08-28 04:06:09.716424 | 
2026-08-28 04:06:09.716549 | TASK [upload-logs : Upload logs to log server]
2026-08-28 04:06:10.206853 | localhost | Output suppressed because no_log was given
2026-08-28 04:06:10.247357 | 
2026-08-28 04:06:10.247504 | LOOP [upload-logs : Compress console log and json output]
2026-08-28 04:06:10.293121 | localhost | skipping: Conditional result was False
2026-08-28 04:06:10.302134 | localhost | skipping: Conditional result was False
2026-08-28 04:06:10.313718 | 
2026-08-28 04:06:10.314075 | LOOP [upload-logs : Upload compressed console log and json output]
2026-08-28 04:06:10.358654 | localhost | skipping: Conditional result was False
2026-08-28 04:06:10.359037 | 
2026-08-28 04:06:10.362686 | localhost | skipping: Conditional result was False
2026-08-28 04:06:10.377270 | 
2026-08-28 04:06:10.377424 | LOOP [upload-logs : Upload console log and json output]