2026-03-31 18:17:13.362957 | Job console starting 2026-03-31 18:17:13.860163 | Updating git repos 2026-03-31 18:17:14.071664 | Cloning repos into workspace 2026-03-31 18:17:15.472564 | Restoring repo states 2026-03-31 18:17:15.550954 | Merging changes 2026-03-31 18:17:16.466698 | Checking out repos 2026-03-31 18:17:16.814097 | Preparing playbooks 2026-03-31 18:17:27.153067 | Running Ansible setup 2026-03-31 18:17:32.991003 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-31 18:17:33.685410 | 2026-03-31 18:17:33.685854 | PLAY [localhost] 2026-03-31 18:17:33.695683 | 2026-03-31 18:17:33.695839 | TASK [Gathering Facts] 2026-03-31 18:17:34.761296 | localhost | ok 2026-03-31 18:17:34.788923 | 2026-03-31 18:17:34.789094 | TASK [Setup log path fact] 2026-03-31 18:17:34.807372 | localhost | ok 2026-03-31 18:17:34.821982 | 2026-03-31 18:17:34.822130 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-31 18:17:34.853460 | localhost | ok 2026-03-31 18:17:34.862470 | 2026-03-31 18:17:34.862680 | TASK [emit-job-header : Print job information] 2026-03-31 18:17:34.902883 | # Job Information 2026-03-31 18:17:34.903031 | Ansible Version: 2.16.16 2026-03-31 18:17:34.903065 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy 2026-03-31 18:17:34.903089 | Pipeline: check 2026-03-31 18:17:34.903110 | Executor: 0a8996d2b663 2026-03-31 18:17:34.903130 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/96 2026-03-31 18:17:34.903153 | Event ID: 55a9a070-2d11-11f1-9233-a3bfad3c5a11 2026-03-31 18:17:34.905954 | 2026-03-31 18:17:34.906031 | LOOP [emit-job-header : Print node information] 2026-03-31 18:17:35.009836 | localhost | ok: 2026-03-31 18:17:35.010049 | localhost | # Node Information 2026-03-31 18:17:35.010079 | localhost | Inventory Hostname: mon1 2026-03-31 18:17:35.010103 | localhost | Hostname: np0000161922 2026-03-31 18:17:35.010123 | localhost | Username: zuul 2026-03-31 18:17:35.010242 | localhost | Distro: Ubuntu 22.04 2026-03-31 18:17:35.010288 | localhost | Provider: yul1 2026-03-31 18:17:35.010315 | localhost | Region: ca-ymq-1 2026-03-31 18:17:35.010337 | localhost | Label: ubuntu-jammy 2026-03-31 18:17:35.010356 | localhost | Product Name: OpenStack Nova 2026-03-31 18:17:35.010375 | localhost | Interface IP: 199.19.213.145 2026-03-31 18:17:35.067448 | localhost | ok: 2026-03-31 18:17:35.067577 | localhost | # Node Information 2026-03-31 18:17:35.067616 | localhost | Inventory Hostname: osd1 2026-03-31 18:17:35.067645 | localhost | Hostname: np0000161923 2026-03-31 18:17:35.067673 | localhost | Username: zuul 2026-03-31 18:17:35.067700 | localhost | Distro: Ubuntu 22.04 2026-03-31 18:17:35.067726 | localhost | Provider: yul1 2026-03-31 18:17:35.067752 | localhost | Region: ca-ymq-1 2026-03-31 18:17:35.067778 | localhost | Label: ubuntu-jammy 2026-03-31 18:17:35.067803 | localhost | Product Name: OpenStack Nova 2026-03-31 18:17:35.067831 | localhost | Interface IP: 199.19.213.159 2026-03-31 18:17:35.082354 | 2026-03-31 18:17:35.082496 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-31 18:17:35.621580 | localhost -> localhost | changed 2026-03-31 18:17:35.626201 | 2026-03-31 18:17:35.626271 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-31 18:17:36.665216 | localhost -> localhost | changed 2026-03-31 18:17:36.675371 | 2026-03-31 18:17:36.675453 | PLAY [all] 2026-03-31 18:17:36.689558 | 2026-03-31 18:17:36.689775 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-31 18:17:37.065816 | mon1 -> localhost | ok 2026-03-31 18:17:37.082350 | 2026-03-31 18:17:37.082502 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-31 18:17:37.126408 | mon1 | ok 2026-03-31 18:17:37.158880 | osd1 | ok 2026-03-31 18:17:37.182120 | mon1 | included: /var/lib/zuul/builds/a118900b07804a978846eb908927944a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-31 18:17:37.182227 | osd1 | included: /var/lib/zuul/builds/a118900b07804a978846eb908927944a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-31 18:17:37.188678 | 2026-03-31 18:17:37.188777 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-31 18:17:38.921781 | mon1 -> localhost | Generating public/private rsa key pair. 2026-03-31 18:17:38.926420 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/a118900b07804a978846eb908927944a/work/a118900b07804a978846eb908927944a_id_rsa 2026-03-31 18:17:38.926545 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/a118900b07804a978846eb908927944a/work/a118900b07804a978846eb908927944a_id_rsa.pub 2026-03-31 18:17:38.926596 | mon1 -> localhost | The key fingerprint is: 2026-03-31 18:17:38.926644 | mon1 -> localhost | SHA256:IiMg/uJMm+jyid6pupHNMDvYb5LXVkkFK9l6MITBSwg zuul-build-sshkey 2026-03-31 18:17:38.926684 | mon1 -> localhost | The key's randomart image is: 2026-03-31 18:17:38.926718 | mon1 -> localhost | +---[RSA 3072]----+ 2026-03-31 18:17:38.926756 | mon1 -> localhost | |E. o.o. .. | 2026-03-31 18:17:38.926794 | mon1 -> localhost | | . +. o .. | 2026-03-31 18:17:38.926837 | mon1 -> localhost | |o . .= o. | 2026-03-31 18:17:38.926869 | mon1 -> localhost | |o. . =. | 2026-03-31 18:17:38.926906 | mon1 -> localhost | |o.. o o.S. | 2026-03-31 18:17:38.926943 | mon1 -> localhost | |.O.. o oo | 2026-03-31 18:17:38.926981 | mon1 -> localhost | |*o+o . . | 2026-03-31 18:17:38.927018 | mon1 -> localhost | |*+Bo+ o | 2026-03-31 18:17:38.927055 | mon1 -> localhost | |X@+*.. | 2026-03-31 18:17:38.927096 | mon1 -> localhost | +----[SHA256]-----+ 2026-03-31 18:17:38.927192 | mon1 -> localhost | ok: Runtime: 0:00:01.128196 2026-03-31 18:17:38.934382 | 2026-03-31 18:17:38.934514 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-31 18:17:38.972215 | mon1 | ok 2026-03-31 18:17:38.989491 | osd1 | ok 2026-03-31 18:17:39.010739 | mon1 | included: /var/lib/zuul/builds/a118900b07804a978846eb908927944a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-31 18:17:39.011024 | osd1 | included: /var/lib/zuul/builds/a118900b07804a978846eb908927944a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-31 18:17:39.024042 | 2026-03-31 18:17:39.024216 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-31 18:17:39.050933 | mon1 | skipping: Conditional result was False 2026-03-31 18:17:39.062073 | osd1 | skipping: Conditional result was False 2026-03-31 18:17:39.214111 | 2026-03-31 18:17:39.214281 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-31 18:17:39.680011 | osd1 | changed 2026-03-31 18:17:39.759227 | mon1 | changed 2026-03-31 18:17:39.766169 | 2026-03-31 18:17:39.766308 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-31 18:17:39.960730 | mon1 | ok 2026-03-31 18:17:39.977615 | osd1 | ok 2026-03-31 18:17:39.982990 | 2026-03-31 18:17:39.983059 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-31 18:17:40.496011 | osd1 | changed 2026-03-31 18:17:40.815671 | mon1 | changed 2026-03-31 18:17:40.929112 | 2026-03-31 18:17:40.929223 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-31 18:17:41.411084 | mon1 | changed 2026-03-31 18:17:41.441998 | osd1 | changed 2026-03-31 18:17:41.447519 | 2026-03-31 18:17:41.447588 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-31 18:17:41.471843 | mon1 | skipping: Conditional result was False 2026-03-31 18:17:41.483475 | osd1 | skipping: Conditional result was False 2026-03-31 18:17:41.583561 | 2026-03-31 18:17:41.583703 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-31 18:17:42.002161 | mon1 -> localhost | changed 2026-03-31 18:17:42.016973 | 2026-03-31 18:17:42.017088 | TASK [add-build-sshkey : Add back temp key] 2026-03-31 18:17:42.467544 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/a118900b07804a978846eb908927944a/work/a118900b07804a978846eb908927944a_id_rsa (zuul-build-sshkey) 2026-03-31 18:17:42.468059 | mon1 -> localhost | ok: Runtime: 0:00:00.012719 2026-03-31 18:17:42.483068 | 2026-03-31 18:17:42.483175 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-31 18:17:42.776940 | osd1 | ok 2026-03-31 18:17:42.782403 | mon1 | ok 2026-03-31 18:17:42.790180 | 2026-03-31 18:17:42.790249 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-31 18:17:42.816864 | mon1 | skipping: Conditional result was False 2026-03-31 18:17:42.829089 | osd1 | skipping: Conditional result was False 2026-03-31 18:17:42.849585 | 2026-03-31 18:17:42.849662 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-31 18:17:43.156776 | osd1 | ok 2026-03-31 18:17:43.244739 | mon1 | ok 2026-03-31 18:17:43.250447 | 2026-03-31 18:17:43.250525 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-31 18:17:44.045079 | osd1 | Output suppressed because no_log was given 2026-03-31 18:17:44.077660 | mon1 | Output suppressed because no_log was given 2026-03-31 18:17:44.092220 | 2026-03-31 18:17:44.092362 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-31 18:17:44.277624 | mon1 | ok: "logs" 2026-03-31 18:17:44.304004 | mon1 | ok: All items complete 2026-03-31 18:17:44.304142 | 2026-03-31 18:17:44.311674 | osd1 | ok: "logs" 2026-03-31 18:17:44.427029 | mon1 | ok: "artifacts" 2026-03-31 18:17:44.437924 | osd1 | ok: "artifacts" 2026-03-31 18:17:44.593634 | mon1 | ok: "docs" 2026-03-31 18:17:44.600797 | osd1 | ok: "docs" 2026-03-31 18:17:44.615475 | 2026-03-31 18:17:44.665974 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-31 18:17:44.849233 | mon1 | changed: "logs" 2026-03-31 18:17:44.929635 | mon1 | ok: All items complete 2026-03-31 18:17:44.929754 | 2026-03-31 18:17:44.935467 | osd1 | changed: "logs" 2026-03-31 18:17:45.014260 | mon1 | changed: "artifacts" 2026-03-31 18:17:45.026720 | osd1 | changed: "artifacts" 2026-03-31 18:17:45.177856 | mon1 | changed: "docs" 2026-03-31 18:17:45.184341 | osd1 | changed: "docs" 2026-03-31 18:17:45.210653 | 2026-03-31 18:17:45.210778 | PLAY RECAP 2026-03-31 18:17:45.210834 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-31 18:17:45.210866 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-31 18:17:45.210892 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-31 18:17:45.210910 | 2026-03-31 18:17:45.363719 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-31 18:17:45.471751 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-31 18:17:46.133212 | 2026-03-31 18:17:46.133393 | PLAY [all] 2026-03-31 18:17:46.147052 | 2026-03-31 18:17:46.147247 | TASK [setup-uv : Extract archive] 2026-03-31 18:17:48.336454 | mon1 | changed 2026-03-31 18:17:49.388849 | osd1 | changed 2026-03-31 18:17:49.469809 | 2026-03-31 18:17:49.469968 | TASK [setup-uv : Print version] 2026-03-31 18:17:49.892033 | osd1 | uv 0.8.13 2026-03-31 18:17:49.894423 | mon1 | uv 0.8.13 2026-03-31 18:17:50.074999 | osd1 | ok: Runtime: 0:00:00.013810 2026-03-31 18:17:50.086288 | mon1 | ok: Runtime: 0:00:00.012258 2026-03-31 18:17:50.114393 | 2026-03-31 18:17:50.114528 | PLAY RECAP 2026-03-31 18:17:50.114607 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-31 18:17:50.114660 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-31 18:17:50.114694 | 2026-03-31 18:17:50.265753 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-31 18:17:50.365618 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-31 18:17:51.055942 | 2026-03-31 18:17:51.056167 | PLAY [all] 2026-03-31 18:17:51.076316 | 2026-03-31 18:17:51.076660 | TASK [Copy inventory file for Zuul] 2026-03-31 18:17:52.037839 | mon1 | changed 2026-03-31 18:17:52.043195 | 2026-03-31 18:17:52.043321 | TASK [Switch "ansible_host" to private IP] 2026-03-31 18:17:52.336778 | mon1 | changed: 2 replacements made 2026-03-31 18:17:52.344208 | 2026-03-31 18:17:52.344316 | TASK [Run Molecule scenario] 2026-03-31 18:17:52.950716 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-03-31 18:17:53.723072 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-03-31 18:17:53.894479 | mon1 | Using CPython 3.13.7 2026-03-31 18:17:53.895353 | mon1 | Creating virtual environment at: .venv 2026-03-31 18:17:54.183546 | mon1 | Downloading pygments (1.2MiB) 2026-03-31 18:17:54.189165 | mon1 | Downloading cryptography (4.3MiB) 2026-03-31 18:17:54.189636 | mon1 | Downloading ansible-core (2.1MiB) 2026-03-31 18:17:54.189885 | mon1 | Downloading netaddr (2.2MiB) 2026-03-31 18:17:54.375383 | mon1 | Downloading netaddr 2026-03-31 18:17:54.385112 | mon1 | Downloading cryptography 2026-03-31 18:17:54.431516 | mon1 | Downloading pygments 2026-03-31 18:17:54.559598 | mon1 | Downloading ansible-core 2026-03-31 18:17:54.588678 | mon1 | Installed 36 packages in 28ms 2026-03-31 18:17:55.712358 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-03-31 18:17:55.712521 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-03-31 18:17:56.331483 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-31 18:17:56.331576 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-31 18:18:10.715320 | mon1 | INFO [default > dependency] Executing 2026-03-31 18:18:10.716106 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-31 18:18:10.716120 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-31 18:18:10.716159 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-31 18:18:10.723223 | mon1 | INFO [default > cleanup] Executing 2026-03-31 18:18:10.723584 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-31 18:18:10.729245 | mon1 | INFO [default > destroy] Executing 2026-03-31 18:18:10.729273 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-31 18:18:10.729354 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-31 18:18:10.734317 | mon1 | INFO [default > syntax] Executing 2026-03-31 18:18:11.724802 | mon1 | 2026-03-31 18:18:11.725008 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-31 18:18:11.807044 | mon1 | INFO [default > syntax] Executed: Successful 2026-03-31 18:18:11.818221 | mon1 | INFO [default > create] Executing 2026-03-31 18:18:11.819519 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-31 18:18:11.824435 | mon1 | INFO [default > prepare] Executing 2026-03-31 18:18:12.516910 | mon1 | 2026-03-31 18:18:12.517154 | mon1 | PLAY [Prepare] ***************************************************************** 2026-03-31 18:18:12.517355 | mon1 | 2026-03-31 18:18:12.517567 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:18:12.517739 | mon1 | Tuesday 31 March 2026 18:18:12 +0000 (0:00:00.034) 0:00:00.034 ********* 2026-03-31 18:18:13.712492 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-31 18:18:13.712837 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-31 18:18:13.712901 | mon1 | interpreter could change the meaning of that path. See 2026-03-31 18:18:13.713137 | mon1 | https://docs.ansible.com/ansible- 2026-03-31 18:18:13.713382 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-31 18:18:13.713672 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-31 18:18:13.713875 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-31 18:18:13.714073 | mon1 | interpreter could change the meaning of that path. See 2026-03-31 18:18:13.714269 | mon1 | https://docs.ansible.com/ansible- 2026-03-31 18:18:13.714468 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-31 18:18:13.718302 | mon1 | ok: [osd1] 2026-03-31 18:18:13.718523 | mon1 | ok: [mon1] 2026-03-31 18:18:13.718721 | mon1 | 2026-03-31 18:18:13.718938 | mon1 | TASK [Configure short hostname] ************************************************ 2026-03-31 18:18:13.719155 | mon1 | Tuesday 31 March 2026 18:18:13 +0000 (0:00:01.202) 0:00:01.236 ********* 2026-03-31 18:18:14.440436 | mon1 | changed: [osd1] 2026-03-31 18:18:14.440507 | mon1 | changed: [mon1] 2026-03-31 18:18:14.440633 | mon1 | 2026-03-31 18:18:14.440760 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-31 18:18:14.440903 | mon1 | Tuesday 31 March 2026 18:18:14 +0000 (0:00:00.715) 0:00:01.951 ********* 2026-03-31 18:18:14.711911 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-31 18:18:14.712104 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-03-31 18:18:14.712314 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-31 18:18:14.734322 | mon1 | changed: [mon1] 2026-03-31 18:18:14.734534 | mon1 | changed: [osd1] 2026-03-31 18:18:14.734726 | mon1 | 2026-03-31 18:18:14.734936 | mon1 | TASK [Update apt cache] ******************************************************** 2026-03-31 18:18:14.735153 | mon1 | Tuesday 31 March 2026 18:18:14 +0000 (0:00:00.300) 0:00:02.252 ********* 2026-03-31 18:18:52.929046 | mon1 | changed: [mon1] 2026-03-31 18:18:52.929426 | mon1 | changed: [osd1] 2026-03-31 18:18:52.929444 | mon1 | 2026-03-31 18:18:52.929575 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-03-31 18:18:52.929756 | mon1 | 2026-03-31 18:18:52.929966 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:18:52.930169 | mon1 | Tuesday 31 March 2026 18:18:52 +0000 (0:00:38.194) 0:00:40.446 ********* 2026-03-31 18:18:53.618612 | mon1 | ok: [osd1] 2026-03-31 18:18:53.618709 | mon1 | 2026-03-31 18:18:53.618796 | mon1 | TASK [Install depedencies] ***************************************************** 2026-03-31 18:18:53.618943 | mon1 | Tuesday 31 March 2026 18:18:53 +0000 (0:00:00.689) 0:00:41.136 ********* 2026-03-31 18:19:17.803006 | mon1 | changed: [osd1] 2026-03-31 18:19:17.803110 | mon1 | 2026-03-31 18:19:17.803125 | mon1 | TASK [Start up service] ******************************************************** 2026-03-31 18:19:17.803233 | mon1 | Tuesday 31 March 2026 18:19:17 +0000 (0:00:24.184) 0:01:05.321 ********* 2026-03-31 18:19:18.374850 | mon1 | ok: [osd1] 2026-03-31 18:19:18.375672 | mon1 | 2026-03-31 18:19:18.375691 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-03-31 18:19:18.375701 | mon1 | Tuesday 31 March 2026 18:19:18 +0000 (0:00:00.571) 0:01:05.892 ********* 2026-03-31 18:19:18.693480 | mon1 | ok: [osd1] 2026-03-31 18:19:18.693612 | mon1 | 2026-03-31 18:19:18.693922 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-31 18:19:18.694232 | mon1 | Tuesday 31 March 2026 18:19:18 +0000 (0:00:00.318) 0:01:06.210 ********* 2026-03-31 18:19:19.383129 | mon1 | changed: [osd1] 2026-03-31 18:19:19.383271 | mon1 | 2026-03-31 18:19:19.383569 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-03-31 18:19:19.383803 | mon1 | Tuesday 31 March 2026 18:19:19 +0000 (0:00:00.690) 0:01:06.900 ********* 2026-03-31 18:19:19.586345 | mon1 | ok: [osd1] 2026-03-31 18:19:19.586495 | mon1 | 2026-03-31 18:19:19.586707 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-31 18:19:19.586915 | mon1 | Tuesday 31 March 2026 18:19:19 +0000 (0:00:00.203) 0:01:07.103 ********* 2026-03-31 18:19:19.609986 | mon1 | skipping: [osd1] 2026-03-31 18:19:19.610176 | mon1 | 2026-03-31 18:19:19.610411 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-03-31 18:19:19.610592 | mon1 | Tuesday 31 March 2026 18:19:19 +0000 (0:00:00.024) 0:01:07.128 ********* 2026-03-31 18:19:20.165177 | mon1 | changed: [osd1] => (item=osd0) 2026-03-31 18:19:20.165338 | mon1 | changed: [osd1] => (item=osd1) 2026-03-31 18:19:20.165550 | mon1 | changed: [osd1] => (item=osd2) 2026-03-31 18:19:20.165851 | mon1 | 2026-03-31 18:19:20.166004 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-03-31 18:19:20.166262 | mon1 | Tuesday 31 March 2026 18:19:20 +0000 (0:00:00.554) 0:01:07.682 ********* 2026-03-31 18:19:20.818507 | mon1 | changed: [osd1] => (item=osd0) 2026-03-31 18:19:20.818669 | mon1 | changed: [osd1] => (item=osd1) 2026-03-31 18:19:20.818895 | mon1 | changed: [osd1] => (item=osd2) 2026-03-31 18:19:20.819103 | mon1 | 2026-03-31 18:19:20.819328 | mon1 | TASK [Start loop devices] ****************************************************** 2026-03-31 18:19:20.819546 | mon1 | Tuesday 31 March 2026 18:19:20 +0000 (0:00:00.653) 0:01:08.335 ********* 2026-03-31 18:19:21.541143 | mon1 | changed: [osd1] => (item=osd0) 2026-03-31 18:19:21.541306 | mon1 | changed: [osd1] => (item=osd1) 2026-03-31 18:19:21.541518 | mon1 | changed: [osd1] => (item=osd2) 2026-03-31 18:19:21.541707 | mon1 | 2026-03-31 18:19:21.541926 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-03-31 18:19:21.542126 | mon1 | Tuesday 31 March 2026 18:19:21 +0000 (0:00:00.722) 0:01:09.058 ********* 2026-03-31 18:19:24.450486 | mon1 | changed: [osd1] => (item=osd0) 2026-03-31 18:19:24.450658 | mon1 | changed: [osd1] => (item=osd1) 2026-03-31 18:19:24.450849 | mon1 | changed: [osd1] => (item=osd2) 2026-03-31 18:19:24.451021 | mon1 | 2026-03-31 18:19:24.451230 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-03-31 18:19:24.451424 | mon1 | Tuesday 31 March 2026 18:19:24 +0000 (0:00:02.909) 0:01:11.967 ********* 2026-03-31 18:19:26.246894 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-03-31 18:19:26.246977 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-03-31 18:19:26.247195 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-03-31 18:19:26.247301 | mon1 | 2026-03-31 18:19:26.247464 | mon1 | PLAY RECAP ********************************************************************* 2026-03-31 18:19:26.247685 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-31 18:19:26.247872 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-31 18:19:26.248003 | mon1 | 2026-03-31 18:19:26.248136 | mon1 | 2026-03-31 18:19:26.248289 | mon1 | TASKS RECAP ******************************************************************** 2026-03-31 18:19:26.248520 | mon1 | Tuesday 31 March 2026 18:19:26 +0000 (0:00:01.796) 0:01:13.764 ********* 2026-03-31 18:19:26.248676 | mon1 | =============================================================================== 2026-03-31 18:19:26.248840 | mon1 | Update apt cache ------------------------------------------------------- 38.19s 2026-03-31 18:19:26.249000 | mon1 | Install depedencies ---------------------------------------------------- 24.18s 2026-03-31 18:19:26.249162 | mon1 | Create a volume group for each loop device ------------------------------ 2.91s 2026-03-31 18:19:26.249298 | mon1 | Create a logical volume for each loop device ---------------------------- 1.80s 2026-03-31 18:19:26.249436 | mon1 | Gathering Facts --------------------------------------------------------- 1.20s 2026-03-31 18:19:26.249561 | mon1 | Start loop devices ------------------------------------------------------ 0.72s 2026-03-31 18:19:26.249688 | mon1 | Configure short hostname ------------------------------------------------ 0.72s 2026-03-31 18:19:26.249812 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.69s 2026-03-31 18:19:26.249939 | mon1 | Gathering Facts --------------------------------------------------------- 0.69s 2026-03-31 18:19:26.250077 | mon1 | Set permissions on loopback devices ------------------------------------- 0.65s 2026-03-31 18:19:26.250200 | mon1 | Start up service -------------------------------------------------------- 0.57s 2026-03-31 18:19:26.250323 | mon1 | Create devices for Ceph ------------------------------------------------- 0.55s 2026-03-31 18:19:26.250446 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.32s 2026-03-31 18:19:26.250575 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.30s 2026-03-31 18:19:26.250705 | mon1 | Get list of all loopback devices ---------------------------------------- 0.20s 2026-03-31 18:19:26.250841 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-03-31 18:19:26.327218 | mon1 | INFO [default > prepare] Executed: Successful 2026-03-31 18:19:26.337237 | mon1 | INFO [default > converge] Executing 2026-03-31 18:19:27.176855 | mon1 | 2026-03-31 18:19:27.177056 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-31 18:19:27.177270 | mon1 | 2026-03-31 18:19:27.177512 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:19:27.177725 | mon1 | Tuesday 31 March 2026 18:19:27 +0000 (0:00:00.049) 0:00:00.049 ********* 2026-03-31 18:19:28.308182 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-31 18:19:28.308353 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-31 18:19:28.308606 | mon1 | interpreter could change the meaning of that path. See 2026-03-31 18:19:28.308806 | mon1 | https://docs.ansible.com/ansible- 2026-03-31 18:19:28.309011 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-31 18:19:28.321559 | mon1 | ok: [mon1] 2026-03-31 18:19:28.321737 | mon1 | 2026-03-31 18:19:28.321949 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:19:28.322146 | mon1 | Tuesday 31 March 2026 18:19:28 +0000 (0:00:01.144) 0:00:01.194 ********* 2026-03-31 18:19:28.607074 | mon1 | ok: [mon1] 2026-03-31 18:19:28.607235 | mon1 | 2026-03-31 18:19:28.607467 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:19:28.607678 | mon1 | Tuesday 31 March 2026 18:19:28 +0000 (0:00:00.285) 0:00:01.479 ********* 2026-03-31 18:19:28.641996 | mon1 | skipping: [mon1] 2026-03-31 18:19:28.642143 | mon1 | 2026-03-31 18:19:28.642344 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-31 18:19:28.642541 | mon1 | Tuesday 31 March 2026 18:19:28 +0000 (0:00:00.035) 0:00:01.515 ********* 2026-03-31 18:19:28.946332 | mon1 | changed: [mon1] 2026-03-31 18:19:28.946530 | mon1 | 2026-03-31 18:19:28.946776 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:19:28.947048 | mon1 | Tuesday 31 March 2026 18:19:28 +0000 (0:00:00.303) 0:00:01.819 ********* 2026-03-31 18:19:29.040969 | mon1 | ok: [mon1] => { 2026-03-31 18:19:29.041163 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-31 18:19:29.041364 | mon1 | } 2026-03-31 18:19:29.041564 | mon1 | 2026-03-31 18:19:29.041765 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:19:29.041972 | mon1 | Tuesday 31 March 2026 18:19:29 +0000 (0:00:00.094) 0:00:01.913 ********* 2026-03-31 18:19:29.640428 | mon1 | changed: [mon1] 2026-03-31 18:19:29.640529 | mon1 | 2026-03-31 18:19:29.640542 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:19:29.640553 | mon1 | Tuesday 31 March 2026 18:19:29 +0000 (0:00:00.595) 0:00:02.509 ********* 2026-03-31 18:19:29.680430 | mon1 | skipping: [mon1] 2026-03-31 18:19:29.680644 | mon1 | 2026-03-31 18:19:29.680855 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:19:29.681063 | mon1 | Tuesday 31 March 2026 18:19:29 +0000 (0:00:00.044) 0:00:02.553 ********* 2026-03-31 18:19:29.721576 | mon1 | skipping: [mon1] 2026-03-31 18:19:29.721681 | mon1 | 2026-03-31 18:19:29.721901 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:19:29.722107 | mon1 | Tuesday 31 March 2026 18:19:29 +0000 (0:00:00.041) 0:00:02.594 ********* 2026-03-31 18:19:29.918731 | mon1 | ok: [mon1] 2026-03-31 18:19:29.918879 | mon1 | 2026-03-31 18:19:29.919089 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:19:29.919292 | mon1 | Tuesday 31 March 2026 18:19:29 +0000 (0:00:00.196) 0:00:02.791 ********* 2026-03-31 18:19:31.040188 | mon1 | ok: [mon1] 2026-03-31 18:19:31.040603 | mon1 | 2026-03-31 18:19:31.040919 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:19:31.041198 | mon1 | Tuesday 31 March 2026 18:19:31 +0000 (0:00:01.115) 0:00:03.907 ********* 2026-03-31 18:19:31.113152 | mon1 | ok: [mon1] => { 2026-03-31 18:19:31.113322 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-31 18:19:31.113517 | mon1 | } 2026-03-31 18:19:31.113634 | mon1 | 2026-03-31 18:19:31.113760 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:19:31.113885 | mon1 | Tuesday 31 March 2026 18:19:31 +0000 (0:00:00.078) 0:00:03.985 ********* 2026-03-31 18:19:31.729146 | mon1 | changed: [mon1] 2026-03-31 18:19:31.729414 | mon1 | 2026-03-31 18:19:31.729604 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:19:31.729783 | mon1 | Tuesday 31 March 2026 18:19:31 +0000 (0:00:00.616) 0:00:04.601 ********* 2026-03-31 18:19:34.648253 | mon1 | changed: [mon1] 2026-03-31 18:19:34.648365 | mon1 | 2026-03-31 18:19:34.648380 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-31 18:19:34.648552 | mon1 | Tuesday 31 March 2026 18:19:34 +0000 (0:00:02.919) 0:00:07.521 ********* 2026-03-31 18:19:34.681676 | mon1 | skipping: [mon1] 2026-03-31 18:19:34.681766 | mon1 | 2026-03-31 18:19:34.681822 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-31 18:19:34.681925 | mon1 | Tuesday 31 March 2026 18:19:34 +0000 (0:00:00.033) 0:00:07.554 ********* 2026-03-31 18:19:34.712228 | mon1 | skipping: [mon1] 2026-03-31 18:19:34.712409 | mon1 | 2026-03-31 18:19:34.712638 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-31 18:19:34.712781 | mon1 | Tuesday 31 March 2026 18:19:34 +0000 (0:00:00.030) 0:00:07.584 ********* 2026-03-31 18:19:34.737173 | mon1 | skipping: [mon1] 2026-03-31 18:19:34.737263 | mon1 | 2026-03-31 18:19:34.737278 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-31 18:19:34.737407 | mon1 | Tuesday 31 March 2026 18:19:34 +0000 (0:00:00.025) 0:00:07.609 ********* 2026-03-31 18:19:57.362432 | mon1 | changed: [mon1] 2026-03-31 18:19:57.362503 | mon1 | 2026-03-31 18:19:57.362682 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-31 18:19:57.362697 | mon1 | Tuesday 31 March 2026 18:19:57 +0000 (0:00:22.625) 0:00:30.235 ********* 2026-03-31 18:19:57.908888 | mon1 | changed: [mon1] 2026-03-31 18:19:57.908959 | mon1 | 2026-03-31 18:19:57.909239 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-31 18:19:57.909260 | mon1 | Tuesday 31 March 2026 18:19:57 +0000 (0:00:00.546) 0:00:30.781 ********* 2026-03-31 18:19:58.799910 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-31 18:19:58.799973 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-31 18:19:58.800089 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-31 18:19:58.800502 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-31 18:19:58.800701 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-31 18:19:58.800716 | mon1 | 2026-03-31 18:19:58.800733 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-31 18:19:58.800744 | mon1 | Tuesday 31 March 2026 18:19:58 +0000 (0:00:00.891) 0:00:31.673 ********* 2026-03-31 18:19:59.336519 | mon1 | changed: [mon1] 2026-03-31 18:19:59.336592 | mon1 | 2026-03-31 18:19:59.337061 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-31 18:19:59.337101 | mon1 | Tuesday 31 March 2026 18:19:59 +0000 (0:00:00.528) 0:00:32.201 ********* 2026-03-31 18:19:59.337107 | mon1 | 2026-03-31 18:19:59.337112 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-31 18:19:59.337116 | mon1 | Tuesday 31 March 2026 18:19:59 +0000 (0:00:00.007) 0:00:32.209 ********* 2026-03-31 18:20:00.242934 | mon1 | ok: [mon1] 2026-03-31 18:20:00.243356 | mon1 | 2026-03-31 18:20:00.243405 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-31 18:20:00.243413 | mon1 | Tuesday 31 March 2026 18:20:00 +0000 (0:00:00.906) 0:00:33.115 ********* 2026-03-31 18:20:00.677900 | mon1 | changed: [mon1] 2026-03-31 18:20:00.677989 | mon1 | 2026-03-31 18:20:00.678281 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-31 18:20:00.678342 | mon1 | Tuesday 31 March 2026 18:20:00 +0000 (0:00:00.435) 0:00:33.550 ********* 2026-03-31 18:20:01.200016 | mon1 | changed: [mon1] 2026-03-31 18:20:01.200091 | mon1 | 2026-03-31 18:20:01.200303 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:20:01.200347 | mon1 | Tuesday 31 March 2026 18:20:01 +0000 (0:00:00.522) 0:00:34.073 ********* 2026-03-31 18:20:01.397901 | mon1 | ok: [mon1] 2026-03-31 18:20:01.397969 | mon1 | 2026-03-31 18:20:01.398063 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:20:01.398190 | mon1 | Tuesday 31 March 2026 18:20:01 +0000 (0:00:00.197) 0:00:34.271 ********* 2026-03-31 18:20:01.463829 | mon1 | ok: [mon1] => { 2026-03-31 18:20:01.463913 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-31 18:20:01.464305 | mon1 | } 2026-03-31 18:20:01.464352 | mon1 | 2026-03-31 18:20:01.464357 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:20:01.464362 | mon1 | Tuesday 31 March 2026 18:20:01 +0000 (0:00:00.065) 0:00:34.336 ********* 2026-03-31 18:20:02.842165 | mon1 | changed: [mon1] 2026-03-31 18:20:02.842238 | mon1 | 2026-03-31 18:20:02.842576 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:20:02.842625 | mon1 | Tuesday 31 March 2026 18:20:02 +0000 (0:00:01.378) 0:00:35.715 ********* 2026-03-31 18:20:07.216454 | mon1 | changed: [mon1] 2026-03-31 18:20:07.216526 | mon1 | 2026-03-31 18:20:07.216611 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-31 18:20:07.216715 | mon1 | Tuesday 31 March 2026 18:20:07 +0000 (0:00:04.374) 0:00:40.089 ********* 2026-03-31 18:20:08.170085 | mon1 | ok: [mon1] 2026-03-31 18:20:08.170163 | mon1 | 2026-03-31 18:20:08.170275 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-31 18:20:08.170398 | mon1 | Tuesday 31 March 2026 18:20:08 +0000 (0:00:00.953) 0:00:41.043 ********* 2026-03-31 18:20:08.693669 | mon1 | changed: [mon1] 2026-03-31 18:20:08.693863 | mon1 | 2026-03-31 18:20:08.694093 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-31 18:20:08.694317 | mon1 | Tuesday 31 March 2026 18:20:08 +0000 (0:00:00.523) 0:00:41.566 ********* 2026-03-31 18:20:09.141532 | mon1 | changed: [mon1] 2026-03-31 18:20:09.141734 | mon1 | 2026-03-31 18:20:09.141981 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-31 18:20:09.142212 | mon1 | Tuesday 31 March 2026 18:20:09 +0000 (0:00:00.447) 0:00:42.014 ********* 2026-03-31 18:20:09.678574 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-03-31 18:20:09.678690 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-31 18:20:09.678846 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-31 18:20:09.679005 | mon1 | 2026-03-31 18:20:09.679194 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-31 18:20:09.679380 | mon1 | Tuesday 31 March 2026 18:20:09 +0000 (0:00:00.537) 0:00:42.551 ********* 2026-03-31 18:20:10.100484 | mon1 | changed: [mon1] 2026-03-31 18:20:10.100546 | mon1 | 2026-03-31 18:20:10.101070 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-31 18:20:10.101107 | mon1 | Tuesday 31 March 2026 18:20:10 +0000 (0:00:00.421) 0:00:42.973 ********* 2026-03-31 18:20:10.538401 | mon1 | changed: [mon1] 2026-03-31 18:20:10.538488 | mon1 | 2026-03-31 18:20:10.539070 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-31 18:20:10.539087 | mon1 | Tuesday 31 March 2026 18:20:10 +0000 (0:00:00.428) 0:00:43.401 ********* 2026-03-31 18:20:10.539093 | mon1 | 2026-03-31 18:20:10.539099 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-31 18:20:10.539116 | mon1 | Tuesday 31 March 2026 18:20:10 +0000 (0:00:00.009) 0:00:43.411 ********* 2026-03-31 18:20:11.171574 | mon1 | ok: [mon1] 2026-03-31 18:20:11.171621 | mon1 | 2026-03-31 18:20:11.171629 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-31 18:20:11.171636 | mon1 | Tuesday 31 March 2026 18:20:11 +0000 (0:00:00.632) 0:00:44.044 ********* 2026-03-31 18:20:11.935426 | mon1 | changed: [mon1] 2026-03-31 18:20:11.935507 | mon1 | 2026-03-31 18:20:11.935799 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-31 18:20:11.935844 | mon1 | Tuesday 31 March 2026 18:20:11 +0000 (0:00:00.764) 0:00:44.808 ********* 2026-03-31 18:20:12.443132 | mon1 | changed: [mon1] 2026-03-31 18:20:12.443203 | mon1 | 2026-03-31 18:20:12.443284 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-31 18:20:12.443416 | mon1 | Tuesday 31 March 2026 18:20:12 +0000 (0:00:00.507) 0:00:45.316 ********* 2026-03-31 18:20:12.488511 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-31 18:20:12.488947 | mon1 | 2026-03-31 18:20:12.488982 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-31 18:20:12.488990 | mon1 | Tuesday 31 March 2026 18:20:12 +0000 (0:00:00.045) 0:00:45.361 ********* 2026-03-31 18:20:37.097953 | mon1 | changed: [mon1] 2026-03-31 18:20:37.098211 | mon1 | 2026-03-31 18:20:37.098227 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-31 18:20:37.098340 | mon1 | Tuesday 31 March 2026 18:20:37 +0000 (0:00:24.609) 0:01:09.970 ********* 2026-03-31 18:20:37.728449 | mon1 | ok: [mon1] => (item=chronyd) 2026-03-31 18:20:37.728519 | mon1 | ok: [mon1] => (item=sshd) 2026-03-31 18:20:37.728944 | mon1 | 2026-03-31 18:20:37.728994 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-31 18:20:37.729002 | mon1 | Tuesday 31 March 2026 18:20:37 +0000 (0:00:00.630) 0:01:10.601 ********* 2026-03-31 18:20:38.028931 | mon1 | changed: [mon1] 2026-03-31 18:20:38.029004 | mon1 | 2026-03-31 18:20:38.029090 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-31 18:20:38.029218 | mon1 | Tuesday 31 March 2026 18:20:38 +0000 (0:00:00.300) 0:01:10.902 ********* 2026-03-31 18:20:38.217163 | mon1 | ok: [mon1] 2026-03-31 18:20:38.217236 | mon1 | 2026-03-31 18:20:38.217254 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-31 18:20:38.217386 | mon1 | Tuesday 31 March 2026 18:20:38 +0000 (0:00:00.188) 0:01:11.090 ********* 2026-03-31 18:20:38.686094 | mon1 | changed: [mon1] 2026-03-31 18:20:38.686163 | mon1 | 2026-03-31 18:20:38.686247 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-31 18:20:38.686377 | mon1 | Tuesday 31 March 2026 18:20:38 +0000 (0:00:00.468) 0:01:11.559 ********* 2026-03-31 18:20:39.006634 | mon1 | changed: [mon1] 2026-03-31 18:20:39.006692 | mon1 | 2026-03-31 18:20:39.006969 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-31 18:20:39.007011 | mon1 | Tuesday 31 March 2026 18:20:39 +0000 (0:00:00.320) 0:01:11.879 ********* 2026-03-31 18:20:39.120350 | mon1 | ok: [mon1] 2026-03-31 18:20:39.120410 | mon1 | 2026-03-31 18:20:39.120624 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-31 18:20:39.120649 | mon1 | Tuesday 31 March 2026 18:20:39 +0000 (0:00:00.113) 0:01:11.993 ********* 2026-03-31 18:20:39.328682 | mon1 | ok: [mon1] => (item=mon1) 2026-03-31 18:20:39.328764 | mon1 | 2026-03-31 18:20:39.328995 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-31 18:20:39.329040 | mon1 | Tuesday 31 March 2026 18:20:39 +0000 (0:00:00.208) 0:01:12.201 ********* 2026-03-31 18:20:39.377464 | mon1 | ok: [mon1] 2026-03-31 18:20:39.377877 | mon1 | 2026-03-31 18:20:39.377917 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-31 18:20:39.377924 | mon1 | Tuesday 31 March 2026 18:20:39 +0000 (0:00:00.048) 0:01:12.250 ********* 2026-03-31 18:20:39.465680 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-03-31 18:20:39.465729 | mon1 | 2026-03-31 18:20:39.465945 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-31 18:20:39.465997 | mon1 | Tuesday 31 March 2026 18:20:39 +0000 (0:00:00.088) 0:01:12.338 ********* 2026-03-31 18:20:39.726196 | mon1 | changed: [mon1] 2026-03-31 18:20:39.726270 | mon1 | 2026-03-31 18:20:39.726509 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-31 18:20:39.726555 | mon1 | Tuesday 31 March 2026 18:20:39 +0000 (0:00:00.260) 0:01:12.599 ********* 2026-03-31 18:20:40.367120 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-31 18:20:40.367759 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-31 18:20:40.367870 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-31 18:20:40.367878 | mon1 | 2026-03-31 18:20:40.367885 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-31 18:20:40.367891 | mon1 | Tuesday 31 March 2026 18:20:40 +0000 (0:00:00.640) 0:01:13.240 ********* 2026-03-31 18:22:05.004723 | mon1 | ok: [mon1] 2026-03-31 18:22:05.004795 | mon1 | 2026-03-31 18:22:05.004883 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-31 18:22:05.004978 | mon1 | Tuesday 31 March 2026 18:22:04 +0000 (0:01:24.637) 0:02:37.877 ********* 2026-03-31 18:22:05.231727 | mon1 | changed: [mon1] 2026-03-31 18:22:05.231833 | mon1 | 2026-03-31 18:22:05.232094 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-31 18:22:05.232144 | mon1 | Tuesday 31 March 2026 18:22:05 +0000 (0:00:00.226) 0:02:38.104 ********* 2026-03-31 18:22:05.266982 | mon1 | ok: [mon1] 2026-03-31 18:22:05.267088 | mon1 | 2026-03-31 18:22:05.267263 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-31 18:22:05.267412 | mon1 | Tuesday 31 March 2026 18:22:05 +0000 (0:00:00.035) 0:02:38.139 ********* 2026-03-31 18:22:05.345671 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-31 18:22:05.345748 | mon1 | 2026-03-31 18:22:05.345763 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-31 18:22:05.345888 | mon1 | Tuesday 31 March 2026 18:22:05 +0000 (0:00:00.079) 0:02:38.218 ********* 2026-03-31 18:22:10.957040 | mon1 | ok: [mon1] 2026-03-31 18:22:10.957083 | mon1 | 2026-03-31 18:22:10.957089 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-31 18:22:10.957094 | mon1 | Tuesday 31 March 2026 18:22:10 +0000 (0:00:05.611) 0:02:43.829 ********* 2026-03-31 18:22:10.997276 | mon1 | ok: [mon1] => (item=mon1) 2026-03-31 18:22:10.997322 | mon1 | 2026-03-31 18:22:10.997329 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-31 18:22:10.997336 | mon1 | Tuesday 31 March 2026 18:22:10 +0000 (0:00:00.039) 0:02:43.869 ********* 2026-03-31 18:22:11.368255 | mon1 | ok: [mon1] 2026-03-31 18:22:11.368354 | mon1 | 2026-03-31 18:22:11.368744 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-31 18:22:11.368798 | mon1 | Tuesday 31 March 2026 18:22:11 +0000 (0:00:00.371) 0:02:44.241 ********* 2026-03-31 18:22:18.661663 | mon1 | ok: [mon1] 2026-03-31 18:22:18.661751 | mon1 | 2026-03-31 18:22:18.661766 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-31 18:22:18.661914 | mon1 | Tuesday 31 March 2026 18:22:18 +0000 (0:00:07.293) 0:02:51.534 ********* 2026-03-31 18:23:03.467342 | mon1 | changed: [mon1] 2026-03-31 18:23:03.467421 | mon1 | 2026-03-31 18:23:03.467765 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-31 18:23:03.467854 | mon1 | Tuesday 31 March 2026 18:23:03 +0000 (0:00:44.805) 0:03:36.340 ********* 2026-03-31 18:23:17.481487 | mon1 | ok: [mon1] 2026-03-31 18:23:17.481547 | mon1 | 2026-03-31 18:23:17.481785 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-31 18:23:17.481823 | mon1 | Tuesday 31 March 2026 18:23:17 +0000 (0:00:14.014) 0:03:50.354 ********* 2026-03-31 18:23:17.537181 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-31 18:23:17.537250 | mon1 | 2026-03-31 18:23:17.537304 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-31 18:23:17.537437 | mon1 | Tuesday 31 March 2026 18:23:17 +0000 (0:00:00.055) 0:03:50.410 ********* 2026-03-31 18:23:17.587771 | mon1 | skipping: [mon1] 2026-03-31 18:23:17.587826 | mon1 | 2026-03-31 18:23:17.588043 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-31 18:23:17.588089 | mon1 | Tuesday 31 March 2026 18:23:17 +0000 (0:00:00.050) 0:03:50.460 ********* 2026-03-31 18:23:17.632980 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-31 18:23:17.633060 | mon1 | skipping: [mon1] 2026-03-31 18:23:17.633329 | mon1 | 2026-03-31 18:23:17.633356 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-31 18:23:17.633362 | mon1 | Tuesday 31 March 2026 18:23:17 +0000 (0:00:00.045) 0:03:50.505 ********* 2026-03-31 18:23:17.887120 | mon1 | ok: [mon1] 2026-03-31 18:23:17.887184 | mon1 | 2026-03-31 18:23:17.887512 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-31 18:23:17.887580 | mon1 | Tuesday 31 March 2026 18:23:17 +0000 (0:00:00.254) 0:03:50.760 ********* 2026-03-31 18:23:24.200294 | mon1 | ok: [mon1] 2026-03-31 18:23:24.200380 | mon1 | 2026-03-31 18:23:24.200456 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-31 18:23:24.200566 | mon1 | Tuesday 31 March 2026 18:23:24 +0000 (0:00:06.313) 0:03:57.073 ********* 2026-03-31 18:23:36.201040 | mon1 | changed: [mon1] 2026-03-31 18:23:36.201119 | mon1 | 2026-03-31 18:23:36.201345 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-31 18:23:36.201388 | mon1 | Tuesday 31 March 2026 18:23:36 +0000 (0:00:12.000) 0:04:09.074 ********* 2026-03-31 18:23:42.127528 | mon1 | ok: [mon1] 2026-03-31 18:23:42.127609 | mon1 | 2026-03-31 18:23:42.127679 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-31 18:23:42.127801 | mon1 | Tuesday 31 March 2026 18:23:42 +0000 (0:00:05.926) 0:04:15.000 ********* 2026-03-31 18:23:49.193311 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-31 18:23:49.193428 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-31 18:23:49.193557 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-03-31 18:23:49.193699 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-31 18:23:49.193793 | mon1 | 2026-03-31 18:23:49.193900 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-31 18:23:49.193986 | mon1 | 2026-03-31 18:23:49.194105 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:23:49.194199 | mon1 | Tuesday 31 March 2026 18:23:49 +0000 (0:00:07.066) 0:04:22.066 ********* 2026-03-31 18:23:50.311045 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-31 18:23:50.311181 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-31 18:23:50.311332 | mon1 | interpreter could change the meaning of that path. See 2026-03-31 18:23:50.311475 | mon1 | https://docs.ansible.com/ansible- 2026-03-31 18:23:50.311617 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-31 18:23:50.321754 | mon1 | ok: [osd1] 2026-03-31 18:23:50.321821 | mon1 | 2026-03-31 18:23:50.321935 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:23:50.322069 | mon1 | Tuesday 31 March 2026 18:23:50 +0000 (0:00:01.128) 0:04:23.194 ********* 2026-03-31 18:23:50.527913 | mon1 | ok: [osd1] 2026-03-31 18:23:50.527989 | mon1 | 2026-03-31 18:23:50.528036 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:23:50.528145 | mon1 | Tuesday 31 March 2026 18:23:50 +0000 (0:00:00.206) 0:04:23.401 ********* 2026-03-31 18:23:50.557574 | mon1 | skipping: [osd1] 2026-03-31 18:23:50.557640 | mon1 | 2026-03-31 18:23:50.557674 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-31 18:23:50.557790 | mon1 | Tuesday 31 March 2026 18:23:50 +0000 (0:00:00.029) 0:04:23.430 ********* 2026-03-31 18:23:50.766711 | mon1 | changed: [osd1] 2026-03-31 18:23:50.766786 | mon1 | 2026-03-31 18:23:50.766832 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:23:50.766946 | mon1 | Tuesday 31 March 2026 18:23:50 +0000 (0:00:00.208) 0:04:23.639 ********* 2026-03-31 18:23:50.815817 | mon1 | ok: [osd1] => { 2026-03-31 18:23:50.815950 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-31 18:23:50.816081 | mon1 | } 2026-03-31 18:23:50.816204 | mon1 | 2026-03-31 18:23:50.816342 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:23:50.816504 | mon1 | Tuesday 31 March 2026 18:23:50 +0000 (0:00:00.049) 0:04:23.688 ********* 2026-03-31 18:23:51.370201 | mon1 | changed: [osd1] 2026-03-31 18:23:51.370285 | mon1 | 2026-03-31 18:23:51.370427 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:23:51.370566 | mon1 | Tuesday 31 March 2026 18:23:51 +0000 (0:00:00.554) 0:04:24.243 ********* 2026-03-31 18:23:51.407314 | mon1 | skipping: [osd1] 2026-03-31 18:23:51.407385 | mon1 | 2026-03-31 18:23:51.407450 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:23:51.407569 | mon1 | Tuesday 31 March 2026 18:23:51 +0000 (0:00:00.037) 0:04:24.280 ********* 2026-03-31 18:23:51.442015 | mon1 | skipping: [osd1] 2026-03-31 18:23:51.442062 | mon1 | 2026-03-31 18:23:51.442178 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:23:51.442278 | mon1 | Tuesday 31 March 2026 18:23:51 +0000 (0:00:00.034) 0:04:24.315 ********* 2026-03-31 18:23:51.637493 | mon1 | ok: [osd1] 2026-03-31 18:23:51.637574 | mon1 | 2026-03-31 18:23:51.637651 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:23:51.637761 | mon1 | Tuesday 31 March 2026 18:23:51 +0000 (0:00:00.195) 0:04:24.510 ********* 2026-03-31 18:23:52.683733 | mon1 | ok: [osd1] 2026-03-31 18:23:52.683819 | mon1 | 2026-03-31 18:23:52.683838 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:23:52.683951 | mon1 | Tuesday 31 March 2026 18:23:52 +0000 (0:00:01.046) 0:04:25.556 ********* 2026-03-31 18:23:52.746116 | mon1 | ok: [osd1] => { 2026-03-31 18:23:52.746188 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-31 18:23:52.746315 | mon1 | } 2026-03-31 18:23:52.746428 | mon1 | 2026-03-31 18:23:52.746560 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:23:52.746697 | mon1 | Tuesday 31 March 2026 18:23:52 +0000 (0:00:00.062) 0:04:25.619 ********* 2026-03-31 18:23:53.420912 | mon1 | changed: [osd1] 2026-03-31 18:23:53.420976 | mon1 | 2026-03-31 18:23:53.421111 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:23:53.421154 | mon1 | Tuesday 31 March 2026 18:23:53 +0000 (0:00:00.674) 0:04:26.294 ********* 2026-03-31 18:23:56.098651 | mon1 | changed: [osd1] 2026-03-31 18:23:56.098731 | mon1 | 2026-03-31 18:23:56.098743 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-31 18:23:56.098850 | mon1 | Tuesday 31 March 2026 18:23:56 +0000 (0:00:02.677) 0:04:28.971 ********* 2026-03-31 18:23:56.123896 | mon1 | skipping: [osd1] 2026-03-31 18:23:56.123947 | mon1 | 2026-03-31 18:23:56.124096 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-31 18:23:56.124199 | mon1 | Tuesday 31 March 2026 18:23:56 +0000 (0:00:00.025) 0:04:28.996 ********* 2026-03-31 18:23:56.150491 | mon1 | skipping: [osd1] 2026-03-31 18:23:56.150538 | mon1 | 2026-03-31 18:23:56.150624 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-31 18:23:56.150721 | mon1 | Tuesday 31 March 2026 18:23:56 +0000 (0:00:00.026) 0:04:29.023 ********* 2026-03-31 18:23:56.175732 | mon1 | skipping: [osd1] 2026-03-31 18:23:56.175801 | mon1 | 2026-03-31 18:23:56.175868 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-31 18:23:56.175988 | mon1 | Tuesday 31 March 2026 18:23:56 +0000 (0:00:00.025) 0:04:29.048 ********* 2026-03-31 18:24:01.566671 | mon1 | changed: [osd1] 2026-03-31 18:24:01.567570 | mon1 | 2026-03-31 18:24:01.567632 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-31 18:24:01.567645 | mon1 | Tuesday 31 March 2026 18:24:01 +0000 (0:00:05.389) 0:04:34.438 ********* 2026-03-31 18:24:02.044074 | mon1 | changed: [osd1] 2026-03-31 18:24:02.044140 | mon1 | 2026-03-31 18:24:02.044239 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-31 18:24:02.044372 | mon1 | Tuesday 31 March 2026 18:24:02 +0000 (0:00:00.478) 0:04:34.917 ********* 2026-03-31 18:24:02.969096 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-31 18:24:02.969166 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-31 18:24:02.969953 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-31 18:24:02.969974 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-31 18:24:02.969981 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-31 18:24:02.969987 | mon1 | 2026-03-31 18:24:02.969994 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-31 18:24:02.969999 | mon1 | Tuesday 31 March 2026 18:24:02 +0000 (0:00:00.924) 0:04:35.841 ********* 2026-03-31 18:24:03.478537 | mon1 | changed: [osd1] 2026-03-31 18:24:03.478600 | mon1 | 2026-03-31 18:24:03.478648 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-31 18:24:03.479037 | mon1 | Tuesday 31 March 2026 18:24:03 +0000 (0:00:00.504) 0:04:36.346 ********* 2026-03-31 18:24:03.479080 | mon1 | 2026-03-31 18:24:03.479086 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-31 18:24:03.479091 | mon1 | Tuesday 31 March 2026 18:24:03 +0000 (0:00:00.005) 0:04:36.351 ********* 2026-03-31 18:24:04.174368 | mon1 | ok: [osd1] 2026-03-31 18:24:04.174452 | mon1 | 2026-03-31 18:24:04.174661 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-31 18:24:04.174711 | mon1 | Tuesday 31 March 2026 18:24:04 +0000 (0:00:00.695) 0:04:37.047 ********* 2026-03-31 18:24:04.597715 | mon1 | changed: [osd1] 2026-03-31 18:24:04.597804 | mon1 | 2026-03-31 18:24:04.597881 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-31 18:24:04.597985 | mon1 | Tuesday 31 March 2026 18:24:04 +0000 (0:00:00.423) 0:04:37.470 ********* 2026-03-31 18:24:05.148345 | mon1 | changed: [osd1] 2026-03-31 18:24:05.148445 | mon1 | 2026-03-31 18:24:05.148583 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:24:05.148688 | mon1 | Tuesday 31 March 2026 18:24:05 +0000 (0:00:00.550) 0:04:38.021 ********* 2026-03-31 18:24:05.348686 | mon1 | ok: [osd1] 2026-03-31 18:24:05.348759 | mon1 | 2026-03-31 18:24:05.348934 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:24:05.348978 | mon1 | Tuesday 31 March 2026 18:24:05 +0000 (0:00:00.200) 0:04:38.221 ********* 2026-03-31 18:24:05.393086 | mon1 | ok: [osd1] => { 2026-03-31 18:24:05.393704 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-31 18:24:05.393757 | mon1 | } 2026-03-31 18:24:05.393766 | mon1 | 2026-03-31 18:24:05.393772 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:24:05.393779 | mon1 | Tuesday 31 March 2026 18:24:05 +0000 (0:00:00.044) 0:04:38.266 ********* 2026-03-31 18:24:06.616660 | mon1 | changed: [osd1] 2026-03-31 18:24:06.616737 | mon1 | 2026-03-31 18:24:06.616808 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:24:06.616903 | mon1 | Tuesday 31 March 2026 18:24:06 +0000 (0:00:01.223) 0:04:39.489 ********* 2026-03-31 18:24:11.043748 | mon1 | changed: [osd1] 2026-03-31 18:24:11.043827 | mon1 | 2026-03-31 18:24:11.043893 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-31 18:24:11.043967 | mon1 | Tuesday 31 March 2026 18:24:11 +0000 (0:00:04.427) 0:04:43.916 ********* 2026-03-31 18:24:12.264534 | mon1 | ok: [osd1] 2026-03-31 18:24:12.264602 | mon1 | 2026-03-31 18:24:12.265050 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-31 18:24:12.265079 | mon1 | Tuesday 31 March 2026 18:24:12 +0000 (0:00:01.220) 0:04:45.137 ********* 2026-03-31 18:24:12.492550 | mon1 | changed: [osd1] 2026-03-31 18:24:12.493104 | mon1 | 2026-03-31 18:24:12.493132 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-31 18:24:12.493143 | mon1 | Tuesday 31 March 2026 18:24:12 +0000 (0:00:00.228) 0:04:45.365 ********* 2026-03-31 18:24:12.940903 | mon1 | changed: [osd1] 2026-03-31 18:24:12.941424 | mon1 | 2026-03-31 18:24:12.941473 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-31 18:24:12.941481 | mon1 | Tuesday 31 March 2026 18:24:12 +0000 (0:00:00.448) 0:04:45.813 ********* 2026-03-31 18:24:13.481628 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-03-31 18:24:13.481762 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-31 18:24:13.482481 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-31 18:24:13.482531 | mon1 | 2026-03-31 18:24:13.482541 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-31 18:24:13.482549 | mon1 | Tuesday 31 March 2026 18:24:13 +0000 (0:00:00.540) 0:04:46.354 ********* 2026-03-31 18:24:13.925153 | mon1 | changed: [osd1] 2026-03-31 18:24:13.925224 | mon1 | 2026-03-31 18:24:13.925279 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-31 18:24:13.925398 | mon1 | Tuesday 31 March 2026 18:24:13 +0000 (0:00:00.443) 0:04:46.798 ********* 2026-03-31 18:24:14.379098 | mon1 | changed: [osd1] 2026-03-31 18:24:14.379177 | mon1 | 2026-03-31 18:24:14.379847 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-31 18:24:14.379896 | mon1 | Tuesday 31 March 2026 18:24:14 +0000 (0:00:00.446) 0:04:47.244 ********* 2026-03-31 18:24:14.379902 | mon1 | 2026-03-31 18:24:14.379907 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-31 18:24:14.379911 | mon1 | Tuesday 31 March 2026 18:24:14 +0000 (0:00:00.007) 0:04:47.252 ********* 2026-03-31 18:24:15.103362 | mon1 | ok: [osd1] 2026-03-31 18:24:15.103440 | mon1 | 2026-03-31 18:24:15.103690 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-31 18:24:15.103740 | mon1 | Tuesday 31 March 2026 18:24:15 +0000 (0:00:00.724) 0:04:47.976 ********* 2026-03-31 18:24:16.043062 | mon1 | changed: [osd1] 2026-03-31 18:24:16.043140 | mon1 | 2026-03-31 18:24:16.043445 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-31 18:24:16.043498 | mon1 | Tuesday 31 March 2026 18:24:16 +0000 (0:00:00.939) 0:04:48.915 ********* 2026-03-31 18:24:16.575456 | mon1 | changed: [osd1] 2026-03-31 18:24:16.575530 | mon1 | 2026-03-31 18:24:16.575611 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-31 18:24:16.575748 | mon1 | Tuesday 31 March 2026 18:24:16 +0000 (0:00:00.532) 0:04:49.448 ********* 2026-03-31 18:24:16.621667 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-31 18:24:16.621732 | mon1 | 2026-03-31 18:24:16.621943 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-31 18:24:16.621999 | mon1 | Tuesday 31 March 2026 18:24:16 +0000 (0:00:00.045) 0:04:49.494 ********* 2026-03-31 18:24:21.869309 | mon1 | changed: [osd1] 2026-03-31 18:24:21.869430 | mon1 | 2026-03-31 18:24:21.869816 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-31 18:24:21.869878 | mon1 | Tuesday 31 March 2026 18:24:21 +0000 (0:00:05.247) 0:04:54.742 ********* 2026-03-31 18:24:22.506640 | mon1 | ok: [osd1] => (item=chronyd) 2026-03-31 18:24:22.506723 | mon1 | ok: [osd1] => (item=sshd) 2026-03-31 18:24:22.506787 | mon1 | 2026-03-31 18:24:22.507230 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-31 18:24:22.507281 | mon1 | Tuesday 31 March 2026 18:24:22 +0000 (0:00:00.637) 0:04:55.379 ********* 2026-03-31 18:24:22.791865 | mon1 | changed: [osd1] 2026-03-31 18:24:22.791994 | mon1 | 2026-03-31 18:24:22.792005 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-31 18:24:22.792140 | mon1 | Tuesday 31 March 2026 18:24:22 +0000 (0:00:00.285) 0:04:55.664 ********* 2026-03-31 18:24:22.983532 | mon1 | ok: [osd1] 2026-03-31 18:24:22.983612 | mon1 | 2026-03-31 18:24:22.984321 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-31 18:24:22.984373 | mon1 | Tuesday 31 March 2026 18:24:22 +0000 (0:00:00.191) 0:04:55.856 ********* 2026-03-31 18:24:23.281478 | mon1 | changed: [osd1] 2026-03-31 18:24:23.281549 | mon1 | 2026-03-31 18:24:23.281900 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-31 18:24:23.281949 | mon1 | Tuesday 31 March 2026 18:24:23 +0000 (0:00:00.297) 0:04:56.154 ********* 2026-03-31 18:24:23.483414 | mon1 | changed: [osd1] 2026-03-31 18:24:23.483490 | mon1 | 2026-03-31 18:24:23.483499 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-31 18:24:23.483641 | mon1 | Tuesday 31 March 2026 18:24:23 +0000 (0:00:00.201) 0:04:56.356 ********* 2026-03-31 18:24:23.698748 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-31 18:24:23.698801 | mon1 | 2026-03-31 18:24:23.698809 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-31 18:24:23.698815 | mon1 | Tuesday 31 March 2026 18:24:23 +0000 (0:00:00.214) 0:04:56.571 ********* 2026-03-31 18:24:23.741950 | mon1 | ok: [osd1] 2026-03-31 18:24:23.742002 | mon1 | 2026-03-31 18:24:23.742009 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-31 18:24:23.742016 | mon1 | Tuesday 31 March 2026 18:24:23 +0000 (0:00:00.043) 0:04:56.614 ********* 2026-03-31 18:24:23.789024 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-31 18:24:23.789105 | mon1 | 2026-03-31 18:24:23.789111 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-31 18:24:23.789116 | mon1 | Tuesday 31 March 2026 18:24:23 +0000 (0:00:00.047) 0:04:56.661 ********* 2026-03-31 18:24:29.723340 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:24:29.723409 | mon1 | 2026-03-31 18:24:29.723644 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-31 18:24:29.723662 | mon1 | Tuesday 31 March 2026 18:24:29 +0000 (0:00:05.934) 0:05:02.596 ********* 2026-03-31 18:24:29.770522 | mon1 | ok: [osd1] => (item=osd1) 2026-03-31 18:24:29.770580 | mon1 | 2026-03-31 18:24:29.770828 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-31 18:24:29.770868 | mon1 | Tuesday 31 March 2026 18:24:29 +0000 (0:00:00.047) 0:05:02.643 ********* 2026-03-31 18:24:30.019529 | mon1 | changed: [osd1] 2026-03-31 18:24:30.019614 | mon1 | 2026-03-31 18:24:30.019941 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-31 18:24:30.019992 | mon1 | Tuesday 31 March 2026 18:24:30 +0000 (0:00:00.248) 0:05:02.892 ********* 2026-03-31 18:24:38.564096 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:24:38.564162 | mon1 | 2026-03-31 18:24:38.564430 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-31 18:24:38.564487 | mon1 | Tuesday 31 March 2026 18:24:38 +0000 (0:00:08.544) 0:05:11.437 ********* 2026-03-31 18:24:40.106555 | mon1 | ok: [osd1] 2026-03-31 18:24:40.106654 | mon1 | 2026-03-31 18:24:40.106732 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-31 18:24:40.106852 | mon1 | Tuesday 31 March 2026 18:24:40 +0000 (0:00:01.542) 0:05:12.979 ********* 2026-03-31 18:25:23.013566 | mon1 | ok: [osd1] 2026-03-31 18:25:23.013717 | mon1 | 2026-03-31 18:25:23.013731 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-31 18:25:23.013741 | mon1 | Tuesday 31 March 2026 18:25:23 +0000 (0:00:42.906) 0:05:55.886 ********* 2026-03-31 18:26:54.468511 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-03-31 18:26:54.468602 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-03-31 18:26:54.468989 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-03-31 18:26:54.469037 | mon1 | 2026-03-31 18:26:54.469042 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-31 18:26:54.469047 | mon1 | Tuesday 31 March 2026 18:26:54 +0000 (0:01:31.455) 0:07:27.341 ********* 2026-03-31 18:27:00.481851 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:27:00.481961 | mon1 | 2026-03-31 18:27:00.482239 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-31 18:27:00.482293 | mon1 | Tuesday 31 March 2026 18:27:00 +0000 (0:00:06.013) 0:07:33.354 ********* 2026-03-31 18:27:06.427233 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:27:06.427357 | mon1 | 2026-03-31 18:27:06.427665 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-31 18:27:06.427737 | mon1 | Tuesday 31 March 2026 18:27:06 +0000 (0:00:05.945) 0:07:39.300 ********* 2026-03-31 18:27:06.487111 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-31 18:27:06.487177 | mon1 | 2026-03-31 18:27:06.487430 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-31 18:27:06.487522 | mon1 | Tuesday 31 March 2026 18:27:06 +0000 (0:00:00.059) 0:07:39.359 ********* 2026-03-31 18:27:06.524941 | mon1 | ok: [osd1] 2026-03-31 18:27:06.525012 | mon1 | 2026-03-31 18:27:06.525249 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-31 18:27:06.525305 | mon1 | Tuesday 31 March 2026 18:27:06 +0000 (0:00:00.038) 0:07:39.397 ********* 2026-03-31 18:27:12.531674 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:27:12.531749 | mon1 | 2026-03-31 18:27:12.531974 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-31 18:27:12.532016 | mon1 | Tuesday 31 March 2026 18:27:12 +0000 (0:00:06.006) 0:07:45.404 ********* 2026-03-31 18:27:12.572637 | mon1 | ok: [osd1] 2026-03-31 18:27:12.573089 | mon1 | 2026-03-31 18:27:12.573119 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-31 18:27:12.573127 | mon1 | Tuesday 31 March 2026 18:27:12 +0000 (0:00:00.040) 0:07:45.445 ********* 2026-03-31 18:27:12.615848 | mon1 | skipping: [osd1] => (item=1) 2026-03-31 18:27:12.615941 | mon1 | skipping: [osd1] => (item=1) 2026-03-31 18:27:12.616452 | mon1 | skipping: [osd1] => (item=1) 2026-03-31 18:27:12.616501 | mon1 | skipping: [osd1] 2026-03-31 18:27:12.616508 | mon1 | 2026-03-31 18:27:12.616513 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-31 18:27:12.616518 | mon1 | Tuesday 31 March 2026 18:27:12 +0000 (0:00:00.043) 0:07:45.488 ********* 2026-03-31 18:27:12.652170 | mon1 | skipping: [osd1] 2026-03-31 18:27:12.652244 | mon1 | 2026-03-31 18:27:12.652343 | mon1 | PLAY RECAP ********************************************************************* 2026-03-31 18:27:12.652593 | mon1 | mon1 : ok=59 changed=29 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-31 18:27:12.652675 | mon1 | osd1 : ok=53 changed=24 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-31 18:27:12.652691 | mon1 | 2026-03-31 18:27:12.654879 | mon1 | 2026-03-31 18:27:12.654898 | mon1 | TASKS RECAP ******************************************************************** 2026-03-31 18:27:12.654903 | mon1 | Tuesday 31 March 2026 18:27:12 +0000 (0:00:00.036) 0:07:45.525 ********* 2026-03-31 18:27:12.654908 | mon1 | =============================================================================== 2026-03-31 18:27:12.654921 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 91.46s 2026-03-31 18:27:12.654926 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 84.64s 2026-03-31 18:27:12.654929 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 44.81s 2026-03-31 18:27:12.654933 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 42.91s 2026-03-31 18:27:12.654937 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 24.61s 2026-03-31 18:27:12.654941 | mon1 | vexxhost.containers.containerd : Install AppArmor packages ------------- 22.63s 2026-03-31 18:27:12.654945 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.01s 2026-03-31 18:27:12.654949 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.00s 2026-03-31 18:27:12.654953 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 8.54s 2026-03-31 18:27:12.654957 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.29s 2026-03-31 18:27:12.654961 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.07s 2026-03-31 18:27:12.654965 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.31s 2026-03-31 18:27:12.654968 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.01s 2026-03-31 18:27:12.654972 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.01s 2026-03-31 18:27:12.654976 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 5.95s 2026-03-31 18:27:12.654980 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.93s 2026-03-31 18:27:12.654984 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 5.93s 2026-03-31 18:27:12.654988 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.61s 2026-03-31 18:27:12.654992 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.39s 2026-03-31 18:27:12.654996 | mon1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.25s 2026-03-31 18:27:12.763403 | mon1 | INFO [default > converge] Executed: Successful 2026-03-31 18:27:12.772782 | mon1 | INFO [default > idempotence] Executing 2026-03-31 18:27:13.591129 | mon1 | 2026-03-31 18:27:13.591538 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-31 18:27:13.591828 | mon1 | 2026-03-31 18:27:13.592126 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:27:13.592571 | mon1 | Tuesday 31 March 2026 18:27:13 +0000 (0:00:00.045) 0:00:00.045 ********* 2026-03-31 18:27:14.738609 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-31 18:27:14.738682 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-31 18:27:14.738695 | mon1 | interpreter could change the meaning of that path. See 2026-03-31 18:27:14.738706 | mon1 | https://docs.ansible.com/ansible- 2026-03-31 18:27:14.738716 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-31 18:27:14.749702 | mon1 | ok: [mon1] 2026-03-31 18:27:14.749737 | mon1 | 2026-03-31 18:27:14.749750 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:27:14.749761 | mon1 | Tuesday 31 March 2026 18:27:14 +0000 (0:00:01.157) 0:00:01.203 ********* 2026-03-31 18:27:15.060444 | mon1 | ok: [mon1] 2026-03-31 18:27:15.060499 | mon1 | 2026-03-31 18:27:15.060517 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:27:15.060790 | mon1 | Tuesday 31 March 2026 18:27:15 +0000 (0:00:00.311) 0:00:01.514 ********* 2026-03-31 18:27:15.089054 | mon1 | skipping: [mon1] 2026-03-31 18:27:15.089153 | mon1 | 2026-03-31 18:27:15.089299 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-31 18:27:15.089438 | mon1 | Tuesday 31 March 2026 18:27:15 +0000 (0:00:00.029) 0:00:01.543 ********* 2026-03-31 18:27:15.398339 | mon1 | ok: [mon1] 2026-03-31 18:27:15.398542 | mon1 | 2026-03-31 18:27:15.398893 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:27:15.399163 | mon1 | Tuesday 31 March 2026 18:27:15 +0000 (0:00:00.309) 0:00:01.852 ********* 2026-03-31 18:27:15.470445 | mon1 | ok: [mon1] => { 2026-03-31 18:27:15.470740 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-31 18:27:15.471042 | mon1 | } 2026-03-31 18:27:15.471230 | mon1 | 2026-03-31 18:27:15.471463 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:27:15.471691 | mon1 | Tuesday 31 March 2026 18:27:15 +0000 (0:00:00.071) 0:00:01.924 ********* 2026-03-31 18:27:15.871681 | mon1 | ok: [mon1] 2026-03-31 18:27:15.871760 | mon1 | 2026-03-31 18:27:15.871778 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:27:15.871791 | mon1 | Tuesday 31 March 2026 18:27:15 +0000 (0:00:00.400) 0:00:02.325 ********* 2026-03-31 18:27:15.916847 | mon1 | skipping: [mon1] 2026-03-31 18:27:15.916919 | mon1 | 2026-03-31 18:27:15.917195 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:27:15.917247 | mon1 | Tuesday 31 March 2026 18:27:15 +0000 (0:00:00.046) 0:00:02.371 ********* 2026-03-31 18:27:15.956749 | mon1 | skipping: [mon1] 2026-03-31 18:27:15.956814 | mon1 | 2026-03-31 18:27:15.957036 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:27:15.957082 | mon1 | Tuesday 31 March 2026 18:27:15 +0000 (0:00:00.039) 0:00:02.411 ********* 2026-03-31 18:27:16.169423 | mon1 | ok: [mon1] 2026-03-31 18:27:16.169548 | mon1 | 2026-03-31 18:27:16.169676 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:27:16.169797 | mon1 | Tuesday 31 March 2026 18:27:16 +0000 (0:00:00.212) 0:00:02.623 ********* 2026-03-31 18:27:17.301521 | mon1 | ok: [mon1] 2026-03-31 18:27:17.301779 | mon1 | 2026-03-31 18:27:17.301968 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:27:17.302336 | mon1 | Tuesday 31 March 2026 18:27:17 +0000 (0:00:01.131) 0:00:03.755 ********* 2026-03-31 18:27:17.377078 | mon1 | ok: [mon1] => { 2026-03-31 18:27:17.377299 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-31 18:27:17.377516 | mon1 | } 2026-03-31 18:27:17.377718 | mon1 | 2026-03-31 18:27:17.377951 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:27:17.378252 | mon1 | Tuesday 31 March 2026 18:27:17 +0000 (0:00:00.075) 0:00:03.831 ********* 2026-03-31 18:27:17.710803 | mon1 | ok: [mon1] 2026-03-31 18:27:17.710896 | mon1 | 2026-03-31 18:27:17.711053 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:27:17.711201 | mon1 | Tuesday 31 March 2026 18:27:17 +0000 (0:00:00.333) 0:00:04.165 ********* 2026-03-31 18:27:19.872496 | mon1 | ok: [mon1] 2026-03-31 18:27:19.872574 | mon1 | 2026-03-31 18:27:19.872615 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-31 18:27:19.872814 | mon1 | Tuesday 31 March 2026 18:27:19 +0000 (0:00:02.161) 0:00:06.326 ********* 2026-03-31 18:27:19.895876 | mon1 | skipping: [mon1] 2026-03-31 18:27:19.896298 | mon1 | 2026-03-31 18:27:19.896350 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-31 18:27:19.896358 | mon1 | Tuesday 31 March 2026 18:27:19 +0000 (0:00:00.024) 0:00:06.350 ********* 2026-03-31 18:27:19.921531 | mon1 | skipping: [mon1] 2026-03-31 18:27:19.921610 | mon1 | 2026-03-31 18:27:19.921862 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-31 18:27:19.921916 | mon1 | Tuesday 31 March 2026 18:27:19 +0000 (0:00:00.025) 0:00:06.376 ********* 2026-03-31 18:27:19.946664 | mon1 | skipping: [mon1] 2026-03-31 18:27:19.947148 | mon1 | 2026-03-31 18:27:19.947206 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-31 18:27:19.947214 | mon1 | Tuesday 31 March 2026 18:27:19 +0000 (0:00:00.024) 0:00:06.400 ********* 2026-03-31 18:27:20.977164 | mon1 | ok: [mon1] 2026-03-31 18:27:20.977212 | mon1 | 2026-03-31 18:27:20.977221 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-31 18:27:20.977229 | mon1 | Tuesday 31 March 2026 18:27:20 +0000 (0:00:01.029) 0:00:07.430 ********* 2026-03-31 18:27:21.415431 | mon1 | ok: [mon1] 2026-03-31 18:27:21.415470 | mon1 | 2026-03-31 18:27:21.415476 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-31 18:27:21.415480 | mon1 | Tuesday 31 March 2026 18:27:21 +0000 (0:00:00.438) 0:00:07.869 ********* 2026-03-31 18:27:22.312026 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-31 18:27:22.312104 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-31 18:27:22.312518 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-31 18:27:22.312839 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-31 18:27:22.312855 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-31 18:27:22.312872 | mon1 | 2026-03-31 18:27:22.312882 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-31 18:27:22.312891 | mon1 | Tuesday 31 March 2026 18:27:22 +0000 (0:00:00.896) 0:00:08.766 ********* 2026-03-31 18:27:22.788961 | mon1 | ok: [mon1] 2026-03-31 18:27:22.789019 | mon1 | 2026-03-31 18:27:22.789121 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-31 18:27:22.789513 | mon1 | Tuesday 31 March 2026 18:27:22 +0000 (0:00:00.470) 0:00:09.236 ********* 2026-03-31 18:27:22.789558 | mon1 | 2026-03-31 18:27:22.789564 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-31 18:27:22.789569 | mon1 | Tuesday 31 March 2026 18:27:22 +0000 (0:00:00.007) 0:00:09.243 ********* 2026-03-31 18:27:23.374464 | mon1 | ok: [mon1] 2026-03-31 18:27:23.374540 | mon1 | 2026-03-31 18:27:23.374646 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:27:23.374780 | mon1 | Tuesday 31 March 2026 18:27:23 +0000 (0:00:00.585) 0:00:09.829 ********* 2026-03-31 18:27:23.577814 | mon1 | ok: [mon1] 2026-03-31 18:27:23.577879 | mon1 | 2026-03-31 18:27:23.577971 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:27:23.578095 | mon1 | Tuesday 31 March 2026 18:27:23 +0000 (0:00:00.203) 0:00:10.032 ********* 2026-03-31 18:27:23.647287 | mon1 | ok: [mon1] => { 2026-03-31 18:27:23.648009 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-31 18:27:23.648042 | mon1 | } 2026-03-31 18:27:23.648049 | mon1 | 2026-03-31 18:27:23.648055 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:27:23.648062 | mon1 | Tuesday 31 March 2026 18:27:23 +0000 (0:00:00.069) 0:00:10.101 ********* 2026-03-31 18:27:24.006389 | mon1 | ok: [mon1] 2026-03-31 18:27:24.006455 | mon1 | 2026-03-31 18:27:24.006540 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:27:24.006668 | mon1 | Tuesday 31 March 2026 18:27:24 +0000 (0:00:00.359) 0:00:10.460 ********* 2026-03-31 18:27:27.056604 | mon1 | ok: [mon1] 2026-03-31 18:27:27.056694 | mon1 | 2026-03-31 18:27:27.056931 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-31 18:27:27.056978 | mon1 | Tuesday 31 March 2026 18:27:27 +0000 (0:00:03.049) 0:00:13.510 ********* 2026-03-31 18:27:28.018943 | mon1 | ok: [mon1] 2026-03-31 18:27:28.019047 | mon1 | 2026-03-31 18:27:28.019358 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-31 18:27:28.019409 | mon1 | Tuesday 31 March 2026 18:27:28 +0000 (0:00:00.962) 0:00:14.473 ********* 2026-03-31 18:27:28.285899 | mon1 | ok: [mon1] 2026-03-31 18:27:28.285959 | mon1 | 2026-03-31 18:27:28.286063 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-31 18:27:28.286167 | mon1 | Tuesday 31 March 2026 18:27:28 +0000 (0:00:00.267) 0:00:14.740 ********* 2026-03-31 18:27:28.700775 | mon1 | ok: [mon1] 2026-03-31 18:27:28.700828 | mon1 | 2026-03-31 18:27:28.700953 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-31 18:27:28.701082 | mon1 | Tuesday 31 March 2026 18:27:28 +0000 (0:00:00.414) 0:00:15.155 ********* 2026-03-31 18:27:29.249358 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-03-31 18:27:29.249479 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-31 18:27:29.250070 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-31 18:27:29.250119 | mon1 | 2026-03-31 18:27:29.250127 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-31 18:27:29.250134 | mon1 | Tuesday 31 March 2026 18:27:29 +0000 (0:00:00.548) 0:00:15.703 ********* 2026-03-31 18:27:29.663814 | mon1 | ok: [mon1] 2026-03-31 18:27:29.663888 | mon1 | 2026-03-31 18:27:29.664082 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-31 18:27:29.664125 | mon1 | Tuesday 31 March 2026 18:27:29 +0000 (0:00:00.414) 0:00:16.118 ********* 2026-03-31 18:27:30.072224 | mon1 | ok: [mon1] 2026-03-31 18:27:30.072303 | mon1 | 2026-03-31 18:27:30.072523 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-31 18:27:30.072588 | mon1 | Tuesday 31 March 2026 18:27:30 +0000 (0:00:00.400) 0:00:16.519 ********* 2026-03-31 18:27:30.072606 | mon1 | 2026-03-31 18:27:30.072824 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-31 18:27:30.072865 | mon1 | Tuesday 31 March 2026 18:27:30 +0000 (0:00:00.007) 0:00:16.526 ********* 2026-03-31 18:27:30.427405 | mon1 | ok: [mon1] 2026-03-31 18:27:30.427467 | mon1 | 2026-03-31 18:27:30.427655 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-31 18:27:30.427696 | mon1 | Tuesday 31 March 2026 18:27:30 +0000 (0:00:00.355) 0:00:16.881 ********* 2026-03-31 18:27:30.472964 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-31 18:27:30.473595 | mon1 | 2026-03-31 18:27:30.473650 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-31 18:27:30.473660 | mon1 | Tuesday 31 March 2026 18:27:30 +0000 (0:00:00.045) 0:00:16.927 ********* 2026-03-31 18:27:31.456218 | mon1 | ok: [mon1] 2026-03-31 18:27:31.456335 | mon1 | 2026-03-31 18:27:31.456675 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-31 18:27:31.456730 | mon1 | Tuesday 31 March 2026 18:27:31 +0000 (0:00:00.983) 0:00:17.910 ********* 2026-03-31 18:27:32.123495 | mon1 | ok: [mon1] => (item=chronyd) 2026-03-31 18:27:32.124055 | mon1 | ok: [mon1] => (item=sshd) 2026-03-31 18:27:32.124107 | mon1 | 2026-03-31 18:27:32.124115 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-31 18:27:32.124122 | mon1 | Tuesday 31 March 2026 18:27:32 +0000 (0:00:00.667) 0:00:18.577 ********* 2026-03-31 18:27:32.399125 | mon1 | ok: [mon1] 2026-03-31 18:27:32.399227 | mon1 | 2026-03-31 18:27:32.399370 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-31 18:27:32.399547 | mon1 | Tuesday 31 March 2026 18:27:32 +0000 (0:00:00.276) 0:00:18.853 ********* 2026-03-31 18:27:32.592614 | mon1 | ok: [mon1] 2026-03-31 18:27:32.592685 | mon1 | 2026-03-31 18:27:32.592907 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-31 18:27:32.592954 | mon1 | Tuesday 31 March 2026 18:27:32 +0000 (0:00:00.193) 0:00:19.047 ********* 2026-03-31 18:27:33.006358 | mon1 | ok: [mon1] 2026-03-31 18:27:33.006436 | mon1 | 2026-03-31 18:27:33.006758 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-31 18:27:33.006807 | mon1 | Tuesday 31 March 2026 18:27:33 +0000 (0:00:00.413) 0:00:19.460 ********* 2026-03-31 18:27:33.332098 | mon1 | ok: [mon1] 2026-03-31 18:27:33.332164 | mon1 | 2026-03-31 18:27:33.332464 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-31 18:27:33.332538 | mon1 | Tuesday 31 March 2026 18:27:33 +0000 (0:00:00.325) 0:00:19.786 ********* 2026-03-31 18:27:33.396910 | mon1 | ok: [mon1] 2026-03-31 18:27:33.397028 | mon1 | 2026-03-31 18:27:33.397041 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-31 18:27:33.397105 | mon1 | Tuesday 31 March 2026 18:27:33 +0000 (0:00:00.065) 0:00:19.851 ********* 2026-03-31 18:27:33.618200 | mon1 | ok: [mon1] => (item=mon1) 2026-03-31 18:27:33.618282 | mon1 | 2026-03-31 18:27:33.618288 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-31 18:27:33.618294 | mon1 | Tuesday 31 March 2026 18:27:33 +0000 (0:00:00.220) 0:00:20.072 ********* 2026-03-31 18:27:33.666591 | mon1 | ok: [mon1] 2026-03-31 18:27:33.666640 | mon1 | 2026-03-31 18:27:33.666646 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-31 18:27:33.666651 | mon1 | Tuesday 31 March 2026 18:27:33 +0000 (0:00:00.048) 0:00:20.120 ********* 2026-03-31 18:27:33.701180 | mon1 | skipping: [mon1] 2026-03-31 18:27:33.701511 | mon1 | 2026-03-31 18:27:33.701569 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-31 18:27:33.701593 | mon1 | Tuesday 31 March 2026 18:27:33 +0000 (0:00:00.034) 0:00:20.155 ********* 2026-03-31 18:27:33.763581 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-31 18:27:33.763627 | mon1 | 2026-03-31 18:27:33.763886 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-31 18:27:33.763933 | mon1 | Tuesday 31 March 2026 18:27:33 +0000 (0:00:00.062) 0:00:20.217 ********* 2026-03-31 18:27:40.167760 | mon1 | ok: [mon1] 2026-03-31 18:27:40.167830 | mon1 | 2026-03-31 18:27:40.168172 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-31 18:27:40.168224 | mon1 | Tuesday 31 March 2026 18:27:40 +0000 (0:00:06.404) 0:00:26.622 ********* 2026-03-31 18:27:40.209311 | mon1 | ok: [mon1] => (item=mon1) 2026-03-31 18:27:40.209388 | mon1 | 2026-03-31 18:27:40.209568 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-31 18:27:40.209612 | mon1 | Tuesday 31 March 2026 18:27:40 +0000 (0:00:00.041) 0:00:26.663 ********* 2026-03-31 18:27:40.586834 | mon1 | ok: [mon1] 2026-03-31 18:27:40.586913 | mon1 | 2026-03-31 18:27:40.586979 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-31 18:27:40.587106 | mon1 | Tuesday 31 March 2026 18:27:40 +0000 (0:00:00.377) 0:00:27.041 ********* 2026-03-31 18:27:47.145640 | mon1 | ok: [mon1] 2026-03-31 18:27:47.145752 | mon1 | 2026-03-31 18:27:47.146101 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-31 18:27:47.146160 | mon1 | Tuesday 31 March 2026 18:27:47 +0000 (0:00:06.558) 0:00:33.599 ********* 2026-03-31 18:27:53.452646 | mon1 | ok: [mon1] 2026-03-31 18:27:53.452777 | mon1 | 2026-03-31 18:27:53.452876 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-31 18:27:53.453046 | mon1 | Tuesday 31 March 2026 18:27:53 +0000 (0:00:06.306) 0:00:39.906 ********* 2026-03-31 18:28:07.462509 | mon1 | ok: [mon1] 2026-03-31 18:28:07.462597 | mon1 | 2026-03-31 18:28:07.462658 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-31 18:28:07.462772 | mon1 | Tuesday 31 March 2026 18:28:07 +0000 (0:00:14.010) 0:00:53.916 ********* 2026-03-31 18:28:07.549788 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-31 18:28:07.549840 | mon1 | 2026-03-31 18:28:07.550084 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-31 18:28:07.550133 | mon1 | Tuesday 31 March 2026 18:28:07 +0000 (0:00:00.087) 0:00:54.004 ********* 2026-03-31 18:28:07.593396 | mon1 | skipping: [mon1] 2026-03-31 18:28:07.593439 | mon1 | 2026-03-31 18:28:07.593560 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-31 18:28:07.593678 | mon1 | Tuesday 31 March 2026 18:28:07 +0000 (0:00:00.043) 0:00:54.047 ********* 2026-03-31 18:28:07.636549 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-31 18:28:07.636599 | mon1 | skipping: [mon1] 2026-03-31 18:28:07.636974 | mon1 | 2026-03-31 18:28:07.637022 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-31 18:28:07.637028 | mon1 | Tuesday 31 March 2026 18:28:07 +0000 (0:00:00.043) 0:00:54.091 ********* 2026-03-31 18:28:07.891794 | mon1 | ok: [mon1] 2026-03-31 18:28:07.891867 | mon1 | 2026-03-31 18:28:07.891955 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-31 18:28:07.892088 | mon1 | Tuesday 31 March 2026 18:28:07 +0000 (0:00:00.255) 0:00:54.346 ********* 2026-03-31 18:28:14.254895 | mon1 | ok: [mon1] 2026-03-31 18:28:14.254951 | mon1 | 2026-03-31 18:28:14.254957 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-31 18:28:14.254962 | mon1 | Tuesday 31 March 2026 18:28:14 +0000 (0:00:06.362) 0:01:00.708 ********* 2026-03-31 18:28:20.397083 | mon1 | ok: [mon1] 2026-03-31 18:28:20.397176 | mon1 | 2026-03-31 18:28:20.397438 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-31 18:28:20.397466 | mon1 | Tuesday 31 March 2026 18:28:20 +0000 (0:00:06.142) 0:01:06.851 ********* 2026-03-31 18:28:26.350977 | mon1 | ok: [mon1] 2026-03-31 18:28:26.351310 | mon1 | 2026-03-31 18:28:26.351387 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-31 18:28:26.351568 | mon1 | Tuesday 31 March 2026 18:28:26 +0000 (0:00:05.953) 0:01:12.805 ********* 2026-03-31 18:28:34.520224 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-31 18:28:34.520501 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-31 18:28:34.520517 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-03-31 18:28:34.520527 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-31 18:28:34.520540 | mon1 | 2026-03-31 18:28:34.521067 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-31 18:28:34.521113 | mon1 | 2026-03-31 18:28:34.521119 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:28:34.521123 | mon1 | Tuesday 31 March 2026 18:28:34 +0000 (0:00:08.169) 0:01:20.974 ********* 2026-03-31 18:28:35.898717 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-31 18:28:35.898788 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-31 18:28:35.898815 | mon1 | interpreter could change the meaning of that path. See 2026-03-31 18:28:35.898826 | mon1 | https://docs.ansible.com/ansible- 2026-03-31 18:28:35.898839 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-31 18:28:35.910232 | mon1 | ok: [osd1] 2026-03-31 18:28:35.910257 | mon1 | 2026-03-31 18:28:35.910262 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:28:35.910267 | mon1 | Tuesday 31 March 2026 18:28:35 +0000 (0:00:01.389) 0:01:22.364 ********* 2026-03-31 18:28:36.150233 | mon1 | ok: [osd1] 2026-03-31 18:28:36.150276 | mon1 | 2026-03-31 18:28:36.150282 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:28:36.150286 | mon1 | Tuesday 31 March 2026 18:28:36 +0000 (0:00:00.239) 0:01:22.604 ********* 2026-03-31 18:28:36.185443 | mon1 | skipping: [osd1] 2026-03-31 18:28:36.185464 | mon1 | 2026-03-31 18:28:36.185469 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-31 18:28:36.185473 | mon1 | Tuesday 31 March 2026 18:28:36 +0000 (0:00:00.035) 0:01:22.640 ********* 2026-03-31 18:28:36.394304 | mon1 | ok: [osd1] 2026-03-31 18:28:36.394343 | mon1 | 2026-03-31 18:28:36.394349 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:28:36.394354 | mon1 | Tuesday 31 March 2026 18:28:36 +0000 (0:00:00.208) 0:01:22.848 ********* 2026-03-31 18:28:36.466236 | mon1 | ok: [osd1] => { 2026-03-31 18:28:36.466262 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-31 18:28:36.466269 | mon1 | } 2026-03-31 18:28:36.466275 | mon1 | 2026-03-31 18:28:36.466281 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:28:36.466286 | mon1 | Tuesday 31 March 2026 18:28:36 +0000 (0:00:00.071) 0:01:22.920 ********* 2026-03-31 18:28:36.807791 | mon1 | ok: [osd1] 2026-03-31 18:28:36.807840 | mon1 | 2026-03-31 18:28:36.807847 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:28:36.807854 | mon1 | Tuesday 31 March 2026 18:28:36 +0000 (0:00:00.341) 0:01:23.261 ********* 2026-03-31 18:28:36.841976 | mon1 | skipping: [osd1] 2026-03-31 18:28:36.842001 | mon1 | 2026-03-31 18:28:36.842007 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:28:36.842011 | mon1 | Tuesday 31 March 2026 18:28:36 +0000 (0:00:00.034) 0:01:23.296 ********* 2026-03-31 18:28:36.880381 | mon1 | skipping: [osd1] 2026-03-31 18:28:36.880420 | mon1 | 2026-03-31 18:28:36.880426 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:28:36.880430 | mon1 | Tuesday 31 March 2026 18:28:36 +0000 (0:00:00.038) 0:01:23.334 ********* 2026-03-31 18:28:37.074914 | mon1 | ok: [osd1] 2026-03-31 18:28:37.074954 | mon1 | 2026-03-31 18:28:37.075196 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:28:37.075245 | mon1 | Tuesday 31 March 2026 18:28:37 +0000 (0:00:00.194) 0:01:23.529 ********* 2026-03-31 18:28:38.268443 | mon1 | ok: [osd1] 2026-03-31 18:28:38.268525 | mon1 | 2026-03-31 18:28:38.268582 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:28:38.268708 | mon1 | Tuesday 31 March 2026 18:28:38 +0000 (0:00:01.193) 0:01:24.722 ********* 2026-03-31 18:28:38.353787 | mon1 | ok: [osd1] => { 2026-03-31 18:28:38.354316 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-31 18:28:38.354361 | mon1 | } 2026-03-31 18:28:38.354367 | mon1 | 2026-03-31 18:28:38.354371 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:28:38.354377 | mon1 | Tuesday 31 March 2026 18:28:38 +0000 (0:00:00.085) 0:01:24.808 ********* 2026-03-31 18:28:38.716248 | mon1 | ok: [osd1] 2026-03-31 18:28:38.716316 | mon1 | 2026-03-31 18:28:38.716369 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:28:38.716489 | mon1 | Tuesday 31 March 2026 18:28:38 +0000 (0:00:00.362) 0:01:25.170 ********* 2026-03-31 18:28:40.765153 | mon1 | ok: [osd1] 2026-03-31 18:28:40.765206 | mon1 | 2026-03-31 18:28:40.765212 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-31 18:28:40.765217 | mon1 | Tuesday 31 March 2026 18:28:40 +0000 (0:00:02.048) 0:01:27.219 ********* 2026-03-31 18:28:40.793273 | mon1 | skipping: [osd1] 2026-03-31 18:28:40.793297 | mon1 | 2026-03-31 18:28:40.793303 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-31 18:28:40.793309 | mon1 | Tuesday 31 March 2026 18:28:40 +0000 (0:00:00.028) 0:01:27.247 ********* 2026-03-31 18:28:40.823781 | mon1 | skipping: [osd1] 2026-03-31 18:28:40.823826 | mon1 | 2026-03-31 18:28:40.823834 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-31 18:28:40.823840 | mon1 | Tuesday 31 March 2026 18:28:40 +0000 (0:00:00.030) 0:01:27.277 ********* 2026-03-31 18:28:40.848923 | mon1 | skipping: [osd1] 2026-03-31 18:28:40.848967 | mon1 | 2026-03-31 18:28:40.849052 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-31 18:28:40.849199 | mon1 | Tuesday 31 March 2026 18:28:40 +0000 (0:00:00.025) 0:01:27.303 ********* 2026-03-31 18:28:42.074251 | mon1 | ok: [osd1] 2026-03-31 18:28:42.074380 | mon1 | 2026-03-31 18:28:42.074738 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-31 18:28:42.074799 | mon1 | Tuesday 31 March 2026 18:28:42 +0000 (0:00:01.225) 0:01:28.528 ********* 2026-03-31 18:28:42.531933 | mon1 | ok: [osd1] 2026-03-31 18:28:42.532022 | mon1 | 2026-03-31 18:28:42.532361 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-31 18:28:42.532441 | mon1 | Tuesday 31 March 2026 18:28:42 +0000 (0:00:00.457) 0:01:28.986 ********* 2026-03-31 18:28:43.436186 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-31 18:28:43.436325 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-31 18:28:43.437154 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-31 18:28:43.437175 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-31 18:28:43.437183 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-31 18:28:43.437190 | mon1 | 2026-03-31 18:28:43.437196 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-31 18:28:43.437202 | mon1 | Tuesday 31 March 2026 18:28:43 +0000 (0:00:00.904) 0:01:29.890 ********* 2026-03-31 18:28:43.930648 | mon1 | ok: [osd1] 2026-03-31 18:28:43.930749 | mon1 | 2026-03-31 18:28:43.931429 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-31 18:28:43.931450 | mon1 | Tuesday 31 March 2026 18:28:43 +0000 (0:00:00.487) 0:01:30.378 ********* 2026-03-31 18:28:43.931457 | mon1 | 2026-03-31 18:28:43.931463 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-31 18:28:43.931468 | mon1 | Tuesday 31 March 2026 18:28:43 +0000 (0:00:00.007) 0:01:30.385 ********* 2026-03-31 18:28:44.281002 | mon1 | ok: [osd1] 2026-03-31 18:28:44.281058 | mon1 | 2026-03-31 18:28:44.281149 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:28:44.281280 | mon1 | Tuesday 31 March 2026 18:28:44 +0000 (0:00:00.350) 0:01:30.735 ********* 2026-03-31 18:28:44.511416 | mon1 | ok: [osd1] 2026-03-31 18:28:44.511482 | mon1 | 2026-03-31 18:28:44.511634 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:28:44.511651 | mon1 | Tuesday 31 March 2026 18:28:44 +0000 (0:00:00.230) 0:01:30.965 ********* 2026-03-31 18:28:44.579079 | mon1 | ok: [osd1] => { 2026-03-31 18:28:44.579143 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-31 18:28:44.579219 | mon1 | } 2026-03-31 18:28:44.579491 | mon1 | 2026-03-31 18:28:44.579505 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:28:44.579511 | mon1 | Tuesday 31 March 2026 18:28:44 +0000 (0:00:00.067) 0:01:31.033 ********* 2026-03-31 18:28:44.932005 | mon1 | ok: [osd1] 2026-03-31 18:28:44.932072 | mon1 | 2026-03-31 18:28:44.932085 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:28:44.932189 | mon1 | Tuesday 31 March 2026 18:28:44 +0000 (0:00:00.352) 0:01:31.386 ********* 2026-03-31 18:28:48.016631 | mon1 | ok: [osd1] 2026-03-31 18:28:48.016699 | mon1 | 2026-03-31 18:28:48.016887 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-31 18:28:48.016904 | mon1 | Tuesday 31 March 2026 18:28:48 +0000 (0:00:03.084) 0:01:34.471 ********* 2026-03-31 18:28:49.260104 | mon1 | ok: [osd1] 2026-03-31 18:28:49.260199 | mon1 | 2026-03-31 18:28:49.260512 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-31 18:28:49.260578 | mon1 | Tuesday 31 March 2026 18:28:49 +0000 (0:00:01.243) 0:01:35.714 ********* 2026-03-31 18:28:49.458780 | mon1 | ok: [osd1] 2026-03-31 18:28:49.458845 | mon1 | 2026-03-31 18:28:49.458930 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-31 18:28:49.459059 | mon1 | Tuesday 31 March 2026 18:28:49 +0000 (0:00:00.198) 0:01:35.913 ********* 2026-03-31 18:28:49.890197 | mon1 | ok: [osd1] 2026-03-31 18:28:49.890746 | mon1 | 2026-03-31 18:28:49.890772 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-31 18:28:49.890782 | mon1 | Tuesday 31 March 2026 18:28:49 +0000 (0:00:00.431) 0:01:36.344 ********* 2026-03-31 18:28:50.455369 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-03-31 18:28:50.455437 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-31 18:28:50.455994 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-31 18:28:50.456043 | mon1 | 2026-03-31 18:28:50.456051 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-31 18:28:50.456068 | mon1 | Tuesday 31 March 2026 18:28:50 +0000 (0:00:00.565) 0:01:36.909 ********* 2026-03-31 18:28:50.875788 | mon1 | ok: [osd1] 2026-03-31 18:28:50.875858 | mon1 | 2026-03-31 18:28:50.875930 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-31 18:28:50.876042 | mon1 | Tuesday 31 March 2026 18:28:50 +0000 (0:00:00.420) 0:01:37.330 ********* 2026-03-31 18:28:51.307061 | mon1 | ok: [osd1] 2026-03-31 18:28:51.307138 | mon1 | 2026-03-31 18:28:51.307200 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-31 18:28:51.307312 | mon1 | Tuesday 31 March 2026 18:28:51 +0000 (0:00:00.423) 0:01:37.753 ********* 2026-03-31 18:28:51.307471 | mon1 | 2026-03-31 18:28:51.307615 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-31 18:28:51.307864 | mon1 | Tuesday 31 March 2026 18:28:51 +0000 (0:00:00.007) 0:01:37.761 ********* 2026-03-31 18:28:51.680043 | mon1 | ok: [osd1] 2026-03-31 18:28:51.680112 | mon1 | 2026-03-31 18:28:51.680166 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-31 18:28:51.680268 | mon1 | Tuesday 31 March 2026 18:28:51 +0000 (0:00:00.372) 0:01:38.134 ********* 2026-03-31 18:28:51.719272 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-31 18:28:51.719360 | mon1 | 2026-03-31 18:28:51.719464 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-31 18:28:51.719633 | mon1 | Tuesday 31 March 2026 18:28:51 +0000 (0:00:00.039) 0:01:38.173 ********* 2026-03-31 18:28:52.912815 | mon1 | ok: [osd1] 2026-03-31 18:28:52.912941 | mon1 | 2026-03-31 18:28:52.913079 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-31 18:28:52.913347 | mon1 | Tuesday 31 March 2026 18:28:52 +0000 (0:00:01.193) 0:01:39.367 ********* 2026-03-31 18:28:53.575360 | mon1 | ok: [osd1] => (item=chronyd) 2026-03-31 18:28:53.575403 | mon1 | ok: [osd1] => (item=sshd) 2026-03-31 18:28:53.575409 | mon1 | 2026-03-31 18:28:53.575413 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-31 18:28:53.575418 | mon1 | Tuesday 31 March 2026 18:28:53 +0000 (0:00:00.662) 0:01:40.029 ********* 2026-03-31 18:28:53.850934 | mon1 | ok: [osd1] 2026-03-31 18:28:53.851013 | mon1 | 2026-03-31 18:28:53.851072 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-31 18:28:53.851247 | mon1 | Tuesday 31 March 2026 18:28:53 +0000 (0:00:00.275) 0:01:40.305 ********* 2026-03-31 18:28:54.047516 | mon1 | ok: [osd1] 2026-03-31 18:28:54.047616 | mon1 | 2026-03-31 18:28:54.047956 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-31 18:28:54.048021 | mon1 | Tuesday 31 March 2026 18:28:54 +0000 (0:00:00.196) 0:01:40.501 ********* 2026-03-31 18:28:54.289061 | mon1 | ok: [osd1] 2026-03-31 18:28:54.289135 | mon1 | 2026-03-31 18:28:54.289433 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-31 18:28:54.289487 | mon1 | Tuesday 31 March 2026 18:28:54 +0000 (0:00:00.241) 0:01:40.743 ********* 2026-03-31 18:28:54.502020 | mon1 | ok: [osd1] 2026-03-31 18:28:54.502089 | mon1 | 2026-03-31 18:28:54.502288 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-31 18:28:54.502336 | mon1 | Tuesday 31 March 2026 18:28:54 +0000 (0:00:00.213) 0:01:40.956 ********* 2026-03-31 18:28:54.724104 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-31 18:28:54.724168 | mon1 | 2026-03-31 18:28:54.724270 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-31 18:28:54.724376 | mon1 | Tuesday 31 March 2026 18:28:54 +0000 (0:00:00.222) 0:01:41.178 ********* 2026-03-31 18:28:54.763023 | mon1 | ok: [osd1] 2026-03-31 18:28:54.763122 | mon1 | 2026-03-31 18:28:54.763411 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-31 18:28:54.763431 | mon1 | Tuesday 31 March 2026 18:28:54 +0000 (0:00:00.038) 0:01:41.217 ********* 2026-03-31 18:28:54.819925 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-31 18:28:54.820025 | mon1 | 2026-03-31 18:28:54.820126 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-31 18:28:54.820256 | mon1 | Tuesday 31 March 2026 18:28:54 +0000 (0:00:00.057) 0:01:41.274 ********* 2026-03-31 18:29:00.709530 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:29:00.709670 | mon1 | 2026-03-31 18:29:00.709870 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-31 18:29:00.710055 | mon1 | Tuesday 31 March 2026 18:29:00 +0000 (0:00:05.889) 0:01:47.163 ********* 2026-03-31 18:29:00.749659 | mon1 | ok: [osd1] => (item=osd1) 2026-03-31 18:29:00.749823 | mon1 | 2026-03-31 18:29:00.750048 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-31 18:29:00.750266 | mon1 | Tuesday 31 March 2026 18:29:00 +0000 (0:00:00.040) 0:01:47.204 ********* 2026-03-31 18:29:01.011636 | mon1 | ok: [osd1] 2026-03-31 18:29:01.011712 | mon1 | 2026-03-31 18:29:01.011855 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-31 18:29:01.011996 | mon1 | Tuesday 31 March 2026 18:29:01 +0000 (0:00:00.261) 0:01:47.465 ********* 2026-03-31 18:29:07.337162 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:29:07.337217 | mon1 | 2026-03-31 18:29:07.337227 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-31 18:29:07.337236 | mon1 | Tuesday 31 March 2026 18:29:07 +0000 (0:00:06.325) 0:01:53.791 ********* 2026-03-31 18:29:12.682760 | mon1 | ok: [osd1] 2026-03-31 18:29:12.682820 | mon1 | 2026-03-31 18:29:12.683155 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-31 18:29:12.683205 | mon1 | Tuesday 31 March 2026 18:29:12 +0000 (0:00:05.345) 0:01:59.136 ********* 2026-03-31 18:29:34.730251 | mon1 | ok: [osd1] 2026-03-31 18:29:34.730333 | mon1 | 2026-03-31 18:29:34.730547 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-31 18:29:34.730596 | mon1 | Tuesday 31 March 2026 18:29:34 +0000 (0:00:22.047) 0:02:21.184 ********* 2026-03-31 18:29:34.797876 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-03-31 18:29:34.798640 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-03-31 18:29:34.798693 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-03-31 18:29:34.798700 | mon1 | skipping: [osd1] 2026-03-31 18:29:34.798706 | mon1 | 2026-03-31 18:29:34.798712 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-31 18:29:34.798719 | mon1 | Tuesday 31 March 2026 18:29:34 +0000 (0:00:00.067) 0:02:21.251 ********* 2026-03-31 18:29:41.148775 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:29:41.148858 | mon1 | 2026-03-31 18:29:41.149191 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-31 18:29:41.149407 | mon1 | Tuesday 31 March 2026 18:29:41 +0000 (0:00:06.351) 0:02:27.603 ********* 2026-03-31 18:29:47.108502 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:29:47.108579 | mon1 | 2026-03-31 18:29:47.108898 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-31 18:29:47.108957 | mon1 | Tuesday 31 March 2026 18:29:47 +0000 (0:00:05.959) 0:02:33.562 ********* 2026-03-31 18:29:47.165854 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-31 18:29:47.165914 | mon1 | 2026-03-31 18:29:47.166113 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-31 18:29:47.166159 | mon1 | Tuesday 31 March 2026 18:29:47 +0000 (0:00:00.057) 0:02:33.620 ********* 2026-03-31 18:29:47.206513 | mon1 | ok: [osd1] 2026-03-31 18:29:47.206622 | mon1 | 2026-03-31 18:29:47.206874 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-31 18:29:47.206924 | mon1 | Tuesday 31 March 2026 18:29:47 +0000 (0:00:00.040) 0:02:33.660 ********* 2026-03-31 18:29:53.176936 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:29:53.177045 | mon1 | 2026-03-31 18:29:53.177333 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-31 18:29:53.177398 | mon1 | Tuesday 31 March 2026 18:29:53 +0000 (0:00:05.970) 0:02:39.631 ********* 2026-03-31 18:29:53.218726 | mon1 | ok: [osd1] 2026-03-31 18:29:53.219136 | mon1 | 2026-03-31 18:29:53.219193 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-31 18:29:53.219202 | mon1 | Tuesday 31 March 2026 18:29:53 +0000 (0:00:00.041) 0:02:39.672 ********* 2026-03-31 18:29:53.271127 | mon1 | skipping: [osd1] => (item=1) 2026-03-31 18:29:53.271223 | mon1 | skipping: [osd1] => (item=1) 2026-03-31 18:29:53.271234 | mon1 | skipping: [osd1] => (item=1) 2026-03-31 18:29:53.271672 | mon1 | skipping: [osd1] 2026-03-31 18:29:53.271725 | mon1 | 2026-03-31 18:29:53.271731 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-31 18:29:53.271737 | mon1 | Tuesday 31 March 2026 18:29:53 +0000 (0:00:00.052) 0:02:39.725 ********* 2026-03-31 18:29:53.306048 | mon1 | skipping: [osd1] 2026-03-31 18:29:53.306122 | mon1 | 2026-03-31 18:29:53.308500 | mon1 | PLAY RECAP ********************************************************************* 2026-03-31 18:29:53.308575 | mon1 | mon1 : ok=49 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-31 18:29:53.308587 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-31 18:29:53.308598 | mon1 | 2026-03-31 18:29:53.308608 | mon1 | 2026-03-31 18:29:53.308617 | mon1 | TASKS RECAP ******************************************************************** 2026-03-31 18:29:53.308627 | mon1 | Tuesday 31 March 2026 18:29:53 +0000 (0:00:00.035) 0:02:39.760 ********* 2026-03-31 18:29:53.308646 | mon1 | =============================================================================== 2026-03-31 18:29:53.308656 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.05s 2026-03-31 18:29:53.308665 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.01s 2026-03-31 18:29:53.308674 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.17s 2026-03-31 18:29:53.308684 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.56s 2026-03-31 18:29:53.308693 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.40s 2026-03-31 18:29:53.308702 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.36s 2026-03-31 18:29:53.308711 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.35s 2026-03-31 18:29:53.308720 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.33s 2026-03-31 18:29:53.308729 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.31s 2026-03-31 18:29:53.308747 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.14s 2026-03-31 18:29:53.308756 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 5.97s 2026-03-31 18:29:53.308859 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 5.96s 2026-03-31 18:29:53.309072 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 5.95s 2026-03-31 18:29:53.309252 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.89s 2026-03-31 18:29:53.309443 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.35s 2026-03-31 18:29:53.309647 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.08s 2026-03-31 18:29:53.309821 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.05s 2026-03-31 18:29:53.309995 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.16s 2026-03-31 18:29:53.310169 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.05s 2026-03-31 18:29:53.310338 | mon1 | Gathering Facts --------------------------------------------------------- 1.39s 2026-03-31 18:29:53.415882 | mon1 | INFO [default > idempotence] Executed: Successful 2026-03-31 18:29:53.426169 | mon1 | INFO [default > side_effect] Executing 2026-03-31 18:29:53.426583 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-31 18:29:53.431758 | mon1 | INFO [default > verify] Executing 2026-03-31 18:29:54.036259 | mon1 | 2026-03-31 18:29:54.036661 | mon1 | PLAY [Verify] ****************************************************************** 2026-03-31 18:29:54.036937 | mon1 | 2026-03-31 18:29:54.037221 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:29:54.037505 | mon1 | Tuesday 31 March 2026 18:29:54 +0000 (0:00:00.006) 0:00:00.006 ********* 2026-03-31 18:29:55.228455 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-31 18:29:55.228514 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-31 18:29:55.228785 | mon1 | interpreter could change the meaning of that path. See 2026-03-31 18:29:55.229041 | mon1 | https://docs.ansible.com/ansible- 2026-03-31 18:29:55.229286 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-31 18:29:55.241041 | mon1 | ok: [mon1] 2026-03-31 18:29:55.241303 | mon1 | 2026-03-31 18:29:55.241602 | mon1 | TASK [Get cluster health status] *********************************************** 2026-03-31 18:29:55.241889 | mon1 | Tuesday 31 March 2026 18:29:55 +0000 (0:00:01.204) 0:00:01.211 ********* 2026-03-31 18:30:05.542444 | mon1 | ok: [mon1] 2026-03-31 18:30:05.542590 | mon1 | 2026-03-31 18:30:05.542795 | mon1 | TASK [Print cluster health status] ********************************************* 2026-03-31 18:30:05.542999 | mon1 | Tuesday 31 March 2026 18:30:05 +0000 (0:00:10.300) 0:00:11.512 ********* 2026-03-31 18:30:05.576625 | mon1 | ok: [mon1] => { 2026-03-31 18:30:05.576742 | mon1 | "_ceph_health": { 2026-03-31 18:30:05.576912 | mon1 | "changed": false, 2026-03-31 18:30:05.577096 | mon1 | "cmd": [ 2026-03-31 18:30:05.577273 | mon1 | "cephadm", 2026-03-31 18:30:05.577488 | mon1 | "shell", 2026-03-31 18:30:05.577668 | mon1 | "--", 2026-03-31 18:30:05.577848 | mon1 | "ceph", 2026-03-31 18:30:05.578031 | mon1 | "health" 2026-03-31 18:30:05.578211 | mon1 | ], 2026-03-31 18:30:05.578399 | mon1 | "delta": "0:00:10.007264", 2026-03-31 18:30:05.578587 | mon1 | "end": "2026-03-31 18:30:05.501754", 2026-03-31 18:30:05.578770 | mon1 | "failed": false, 2026-03-31 18:30:05.578953 | mon1 | "msg": "", 2026-03-31 18:30:05.579133 | mon1 | "rc": 0, 2026-03-31 18:30:05.579324 | mon1 | "start": "2026-03-31 18:29:55.494490", 2026-03-31 18:30:05.579537 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-03-31 18:30:05.579723 | mon1 | "stderr_lines": [ 2026-03-31 18:30:05.579915 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-31 18:30:05.580122 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-03-31 18:30:05.580310 | mon1 | ], 2026-03-31 18:30:05.580549 | mon1 | "stdout": "HEALTH_OK", 2026-03-31 18:30:05.580733 | mon1 | "stdout_lines": [ 2026-03-31 18:30:05.580913 | mon1 | "HEALTH_OK" 2026-03-31 18:30:05.581092 | mon1 | ] 2026-03-31 18:30:05.581280 | mon1 | } 2026-03-31 18:30:05.581577 | mon1 | } 2026-03-31 18:30:05.581805 | mon1 | 2026-03-31 18:30:05.582017 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-31 18:30:05.582174 | mon1 | Tuesday 31 March 2026 18:30:05 +0000 (0:00:00.034) 0:00:11.547 ********* 2026-03-31 18:30:05.611962 | mon1 | ok: [mon1] => { 2026-03-31 18:30:05.612083 | mon1 | "changed": false, 2026-03-31 18:30:05.612100 | mon1 | "msg": "All assertions passed" 2026-03-31 18:30:05.612250 | mon1 | } 2026-03-31 18:30:05.612357 | mon1 | 2026-03-31 18:30:05.612519 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-03-31 18:30:05.612651 | mon1 | Tuesday 31 March 2026 18:30:05 +0000 (0:00:00.035) 0:00:11.582 ********* 2026-03-31 18:30:12.627107 | mon1 | changed: [mon1] 2026-03-31 18:30:12.627292 | mon1 | 2026-03-31 18:30:12.627521 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-03-31 18:30:12.627746 | mon1 | Tuesday 31 March 2026 18:30:12 +0000 (0:00:07.014) 0:00:18.597 ********* 2026-03-31 18:30:15.094523 | mon1 | changed: [mon1] 2026-03-31 18:30:15.094701 | mon1 | 2026-03-31 18:30:15.094933 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-31 18:30:15.095151 | mon1 | Tuesday 31 March 2026 18:30:15 +0000 (0:00:02.467) 0:00:21.064 ********* 2026-03-31 18:30:16.288486 | mon1 | ok: [mon1] 2026-03-31 18:30:16.289277 | mon1 | 2026-03-31 18:30:16.289343 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-03-31 18:30:16.289355 | mon1 | Tuesday 31 March 2026 18:30:16 +0000 (0:00:01.194) 0:00:22.258 ********* 2026-03-31 18:30:16.329353 | mon1 | ok: [mon1] => { 2026-03-31 18:30:16.329433 | mon1 | "changed": false, 2026-03-31 18:30:16.329876 | mon1 | "msg": "All assertions passed" 2026-03-31 18:30:16.329896 | mon1 | } 2026-03-31 18:30:16.329906 | mon1 | 2026-03-31 18:30:16.329915 | mon1 | PLAY RECAP ********************************************************************* 2026-03-31 18:30:16.329927 | mon1 | mon1 : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-31 18:30:16.331084 | mon1 | 2026-03-31 18:30:16.331147 | mon1 | 2026-03-31 18:30:16.331155 | mon1 | TASKS RECAP ******************************************************************** 2026-03-31 18:30:16.331160 | mon1 | Tuesday 31 March 2026 18:30:16 +0000 (0:00:00.041) 0:00:22.300 ********* 2026-03-31 18:30:16.331164 | mon1 | =============================================================================== 2026-03-31 18:30:16.331168 | mon1 | Get cluster health status ---------------------------------------------- 10.30s 2026-03-31 18:30:16.331172 | mon1 | Create a test Ceph pool ------------------------------------------------- 7.01s 2026-03-31 18:30:16.331176 | mon1 | Create a test Ceph key -------------------------------------------------- 2.47s 2026-03-31 18:30:16.331180 | mon1 | Gathering Facts --------------------------------------------------------- 1.20s 2026-03-31 18:30:16.331184 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.19s 2026-03-31 18:30:16.331188 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s 2026-03-31 18:30:16.331192 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.04s 2026-03-31 18:30:16.331195 | mon1 | Print cluster health status --------------------------------------------- 0.03s 2026-03-31 18:30:16.413589 | mon1 | INFO [default > verify] Executed: Successful 2026-03-31 18:30:16.419585 | mon1 | INFO [default > cleanup] Executing 2026-03-31 18:30:16.419876 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-31 18:30:16.424929 | mon1 | INFO [default > destroy] Executing 2026-03-31 18:30:16.424999 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-31 18:30:16.425059 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-31 18:30:16.425314 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-31 18:30:16.946819 | mon1 | ok: Runtime: 0:12:23.780232 2026-03-31 18:30:16.959494 | 2026-03-31 18:30:16.959553 | PLAY RECAP 2026-03-31 18:30:16.959602 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-31 18:30:16.959624 | 2026-03-31 18:30:17.121480 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-31 18:30:17.128607 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-31 18:30:17.859107 | 2026-03-31 18:30:17.859268 | PLAY [all] 2026-03-31 18:30:17.872493 | 2026-03-31 18:30:17.872574 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-31 18:30:17.926557 | mon1 | ok 2026-03-31 18:30:17.931881 | osd1 | ok 2026-03-31 18:30:17.936383 | 2026-03-31 18:30:17.936463 | TASK [fetch-output : Set log path for single node] 2026-03-31 18:30:17.970011 | mon1 | skipping: Conditional result was False 2026-03-31 18:30:17.981322 | osd1 | skipping: Conditional result was False 2026-03-31 18:30:17.989907 | 2026-03-31 18:30:17.990031 | LOOP [fetch-output : Ensure local output dirs] 2026-03-31 18:30:18.408078 | mon1 -> localhost | changed: "/var/lib/zuul/builds/a118900b07804a978846eb908927944a/work/logs/mon1" 2026-03-31 18:30:18.415033 | osd1 -> localhost | changed: "/var/lib/zuul/builds/a118900b07804a978846eb908927944a/work/logs/osd1" 2026-03-31 18:30:18.669162 | mon1 -> localhost | changed: "/var/lib/zuul/builds/a118900b07804a978846eb908927944a/work/artifacts" 2026-03-31 18:30:18.677791 | osd1 -> localhost | ok: "/var/lib/zuul/builds/a118900b07804a978846eb908927944a/work/artifacts" 2026-03-31 18:30:18.898911 | mon1 -> localhost | changed: "/var/lib/zuul/builds/a118900b07804a978846eb908927944a/work/docs" 2026-03-31 18:30:18.904828 | osd1 -> localhost | ok: "/var/lib/zuul/builds/a118900b07804a978846eb908927944a/work/docs" 2026-03-31 18:30:18.924787 | 2026-03-31 18:30:18.925046 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-31 18:30:19.574648 | osd1 | changed: .d..t...... ./ 2026-03-31 18:30:19.574942 | osd1 | changed: All items complete 2026-03-31 18:30:19.574985 | 2026-03-31 18:30:19.586098 | mon1 | changed: .d..t...... ./ 2026-03-31 18:30:20.043674 | osd1 | changed: .d..t...... ./ 2026-03-31 18:30:20.059929 | mon1 | ok 2026-03-31 18:30:20.516386 | osd1 | changed: .d..t...... ./ 2026-03-31 18:30:20.543214 | mon1 | ok 2026-03-31 18:30:20.572300 | 2026-03-31 18:30:20.572428 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-31 18:30:21.001311 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007616 2026-03-31 18:30:21.001623 | mon1 -> localhost | changed: All items complete 2026-03-31 18:30:21.001684 | 2026-03-31 18:30:21.229251 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.005721 2026-03-31 18:30:21.254946 | 2026-03-31 18:30:21.255065 | PLAY [all] 2026-03-31 18:30:21.261569 | 2026-03-31 18:30:21.261640 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-31 18:30:21.661907 | mon1 | changed 2026-03-31 18:30:21.873879 | osd1 | changed 2026-03-31 18:30:21.886812 | 2026-03-31 18:30:21.886878 | PLAY RECAP 2026-03-31 18:30:21.886926 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-31 18:30:21.886969 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-31 18:30:21.886990 | 2026-03-31 18:30:22.052461 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-31 18:30:22.058542 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-31 18:30:22.832661 | 2026-03-31 18:30:22.832846 | PLAY [localhost] 2026-03-31 18:30:22.844481 | 2026-03-31 18:30:22.844627 | TASK [Generate Zuul manifest] 2026-03-31 18:30:22.867830 | localhost | ok 2026-03-31 18:30:22.991320 | 2026-03-31 18:30:22.991522 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-31 18:30:23.349057 | localhost | changed 2026-03-31 18:30:23.364013 | 2026-03-31 18:30:23.364176 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-31 18:30:23.933101 | localhost | ok 2026-03-31 18:30:23.942107 | 2026-03-31 18:30:23.942184 | TASK [Upload logs] 2026-03-31 18:30:23.965482 | localhost | ok 2026-03-31 18:30:24.517675 | 2026-03-31 18:30:24.517796 | TASK [Set zuul-log-path fact] 2026-03-31 18:30:24.535857 | localhost | ok 2026-03-31 18:30:24.546476 | 2026-03-31 18:30:24.546544 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-31 18:30:24.574040 | localhost | ok 2026-03-31 18:30:24.580283 | 2026-03-31 18:30:24.580347 | TASK [upload-logs : Create log directories] 2026-03-31 18:30:25.089404 | localhost | changed 2026-03-31 18:30:25.096621 | 2026-03-31 18:30:25.096774 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-31 18:30:25.523247 | localhost -> localhost | ok: Runtime: 0:00:00.003084 2026-03-31 18:30:25.532428 | 2026-03-31 18:30:25.532517 | TASK [upload-logs : Upload logs to log server] 2026-03-31 18:30:26.102732 | localhost | Output suppressed because no_log was given 2026-03-31 18:30:26.107966 | 2026-03-31 18:30:26.108057 | LOOP [upload-logs : Compress console log and json output] 2026-03-31 18:30:26.167989 | localhost | skipping: Conditional result was False 2026-03-31 18:30:26.176922 | localhost | skipping: Conditional result was False 2026-03-31 18:30:26.192934 | 2026-03-31 18:30:26.193193 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-31 18:30:26.234859 | localhost | skipping: Conditional result was False 2026-03-31 18:30:26.235299 | 2026-03-31 18:30:26.238521 | localhost | skipping: Conditional result was False 2026-03-31 18:30:26.249976 | 2026-03-31 18:30:26.250184 | LOOP [upload-logs : Upload console log and json output]