2026-03-05 16:31:45.641089 | Job console starting 2026-03-05 16:31:46.045553 | Updating git repos 2026-03-05 16:31:46.068358 | Cloning repos into workspace 2026-03-05 16:31:48.248403 | Restoring repo states 2026-03-05 16:31:48.255012 | Merging changes 2026-03-05 16:31:48.530498 | Checking out repos 2026-03-05 16:31:48.683989 | Preparing playbooks 2026-03-05 16:31:51.677716 | Running Ansible setup 2026-03-05 16:31:58.384250 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 16:31:58.963030 | 2026-03-05 16:31:58.963150 | PLAY [localhost] 2026-03-05 16:31:59.279958 | 2026-03-05 16:31:59.280192 | TASK [Gathering Facts] 2026-03-05 16:32:00.150054 | localhost | ok 2026-03-05 16:32:00.157140 | 2026-03-05 16:32:00.157219 | TASK [Setup log path fact] 2026-03-05 16:32:00.179677 | localhost | ok 2026-03-05 16:32:00.192538 | 2026-03-05 16:32:00.192623 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 16:32:00.222120 | localhost | ok 2026-03-05 16:32:00.231619 | 2026-03-05 16:32:00.231724 | TASK [emit-job-header : Print job information] 2026-03-05 16:32:00.273299 | # Job Information 2026-03-05 16:32:00.273595 | Ansible Version: 2.16.16 2026-03-05 16:32:00.273686 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy 2026-03-05 16:32:00.273737 | Pipeline: check 2026-03-05 16:32:00.273783 | Executor: 0a8996d2b663 2026-03-05 16:32:00.273836 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/93 2026-03-05 16:32:00.273903 | Event ID: 6c11fb90-18ae-11f1-8dd1-418c053b88bb 2026-03-05 16:32:00.279132 | 2026-03-05 16:32:00.279229 | LOOP [emit-job-header : Print node information] 2026-03-05 16:32:00.415986 | localhost | ok: 2026-03-05 16:32:00.416424 | localhost | # Node Information 2026-03-05 16:32:00.416497 | localhost | Inventory Hostname: mon1 2026-03-05 16:32:00.416547 | localhost | Hostname: np0000157929 2026-03-05 16:32:00.416593 | localhost | Username: zuul 2026-03-05 16:32:00.416644 | localhost | Distro: Ubuntu 22.04 2026-03-05 16:32:00.416688 | localhost | Provider: yul1 2026-03-05 16:32:00.416731 | localhost | Region: ca-ymq-1 2026-03-05 16:32:00.416772 | localhost | Label: ubuntu-jammy 2026-03-05 16:32:00.416813 | localhost | Product Name: OpenStack Nova 2026-03-05 16:32:00.416854 | localhost | Interface IP: 199.204.45.155 2026-03-05 16:32:00.457659 | localhost | ok: 2026-03-05 16:32:00.457779 | localhost | # Node Information 2026-03-05 16:32:00.457844 | localhost | Inventory Hostname: osd1 2026-03-05 16:32:00.457900 | localhost | Hostname: np0000157930 2026-03-05 16:32:00.457951 | localhost | Username: zuul 2026-03-05 16:32:00.458001 | localhost | Distro: Ubuntu 22.04 2026-03-05 16:32:00.458051 | localhost | Provider: yul1 2026-03-05 16:32:00.458100 | localhost | Region: ca-ymq-1 2026-03-05 16:32:00.458149 | localhost | Label: ubuntu-jammy 2026-03-05 16:32:00.458197 | localhost | Product Name: OpenStack Nova 2026-03-05 16:32:00.458247 | localhost | Interface IP: 199.204.45.129 2026-03-05 16:32:00.470018 | 2026-03-05 16:32:00.470143 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-05 16:32:00.818587 | localhost -> localhost | changed 2026-03-05 16:32:00.826372 | 2026-03-05 16:32:00.826459 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-05 16:32:01.633142 | localhost -> localhost | changed 2026-03-05 16:32:01.642684 | 2026-03-05 16:32:01.642759 | PLAY [all] 2026-03-05 16:32:01.652918 | 2026-03-05 16:32:01.652994 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-05 16:32:01.893103 | mon1 -> localhost | ok 2026-03-05 16:32:01.906820 | 2026-03-05 16:32:01.906921 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-05 16:32:01.936189 | mon1 | ok 2026-03-05 16:32:01.942393 | osd1 | ok 2026-03-05 16:32:01.960890 | mon1 | included: /var/lib/zuul/builds/1a70a4f17492419fa77adeca1cad362a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 16:32:01.961008 | osd1 | included: /var/lib/zuul/builds/1a70a4f17492419fa77adeca1cad362a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 16:32:01.967857 | 2026-03-05 16:32:01.967920 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-05 16:32:03.618589 | mon1 -> localhost | Generating public/private rsa key pair. 2026-03-05 16:32:03.618746 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/1a70a4f17492419fa77adeca1cad362a/work/1a70a4f17492419fa77adeca1cad362a_id_rsa 2026-03-05 16:32:03.618777 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/1a70a4f17492419fa77adeca1cad362a/work/1a70a4f17492419fa77adeca1cad362a_id_rsa.pub 2026-03-05 16:32:03.618802 | mon1 -> localhost | The key fingerprint is: 2026-03-05 16:32:03.618824 | mon1 -> localhost | SHA256:DFEb9HTY2i7G3Sj1k+bZS+smD2fVo7r41DkbXmns/pc zuul-build-sshkey 2026-03-05 16:32:03.618845 | mon1 -> localhost | The key's randomart image is: 2026-03-05 16:32:03.618866 | mon1 -> localhost | +---[RSA 3072]----+ 2026-03-05 16:32:03.618887 | mon1 -> localhost | | .o+ .o. | 2026-03-05 16:32:03.618907 | mon1 -> localhost | | . =... | 2026-03-05 16:32:03.618928 | mon1 -> localhost | | . . .o | 2026-03-05 16:32:03.618948 | mon1 -> localhost | | o . o .| 2026-03-05 16:32:03.618968 | mon1 -> localhost | | S. + + oo| 2026-03-05 16:32:03.618987 | mon1 -> localhost | | = = X +| 2026-03-05 16:32:03.619007 | mon1 -> localhost | | . + X %.| 2026-03-05 16:32:03.619026 | mon1 -> localhost | | o o.#E+| 2026-03-05 16:32:03.619046 | mon1 -> localhost | | ..+.o*B=| 2026-03-05 16:32:03.619065 | mon1 -> localhost | +----[SHA256]-----+ 2026-03-05 16:32:03.619108 | mon1 -> localhost | ok: Runtime: 0:00:01.267211 2026-03-05 16:32:03.623939 | 2026-03-05 16:32:03.623999 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-05 16:32:03.656869 | mon1 | ok 2026-03-05 16:32:03.662642 | osd1 | ok 2026-03-05 16:32:03.675743 | mon1 | included: /var/lib/zuul/builds/1a70a4f17492419fa77adeca1cad362a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 16:32:03.675792 | osd1 | included: /var/lib/zuul/builds/1a70a4f17492419fa77adeca1cad362a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 16:32:03.685787 | 2026-03-05 16:32:03.685855 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-05 16:32:03.706359 | mon1 | skipping: Conditional result was False 2026-03-05 16:32:03.727454 | osd1 | skipping: Conditional result was False 2026-03-05 16:32:03.737806 | 2026-03-05 16:32:03.737895 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-05 16:32:04.171262 | mon1 | changed 2026-03-05 16:32:04.175972 | osd1 | changed 2026-03-05 16:32:04.180880 | 2026-03-05 16:32:04.180972 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-05 16:32:04.370199 | mon1 | ok 2026-03-05 16:32:04.377311 | osd1 | ok 2026-03-05 16:32:04.383614 | 2026-03-05 16:32:04.383683 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-05 16:32:04.867994 | osd1 | changed 2026-03-05 16:32:04.917263 | mon1 | changed 2026-03-05 16:32:04.924559 | 2026-03-05 16:32:04.924621 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-05 16:32:05.381533 | osd1 | changed 2026-03-05 16:32:05.401072 | mon1 | changed 2026-03-05 16:32:05.409913 | 2026-03-05 16:32:05.409992 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-05 16:32:05.436866 | mon1 | skipping: Conditional result was False 2026-03-05 16:32:05.447726 | osd1 | skipping: Conditional result was False 2026-03-05 16:32:05.494927 | 2026-03-05 16:32:05.495071 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-05 16:32:05.896914 | mon1 -> localhost | changed 2026-03-05 16:32:05.916369 | 2026-03-05 16:32:05.916439 | TASK [add-build-sshkey : Add back temp key] 2026-03-05 16:32:06.174862 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/1a70a4f17492419fa77adeca1cad362a/work/1a70a4f17492419fa77adeca1cad362a_id_rsa (zuul-build-sshkey) 2026-03-05 16:32:06.175094 | mon1 -> localhost | ok: Runtime: 0:00:00.015581 2026-03-05 16:32:06.181640 | 2026-03-05 16:32:06.181703 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-05 16:32:06.442215 | mon1 | ok 2026-03-05 16:32:06.448739 | osd1 | ok 2026-03-05 16:32:06.463428 | 2026-03-05 16:32:06.463508 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-05 16:32:06.487047 | mon1 | skipping: Conditional result was False 2026-03-05 16:32:06.546937 | osd1 | skipping: Conditional result was False 2026-03-05 16:32:06.566039 | 2026-03-05 16:32:06.566103 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-05 16:32:06.827660 | osd1 | ok 2026-03-05 16:32:06.844978 | mon1 | ok 2026-03-05 16:32:06.850711 | 2026-03-05 16:32:06.850778 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-05 16:32:07.534909 | mon1 | Output suppressed because no_log was given 2026-03-05 16:32:07.576027 | osd1 | Output suppressed because no_log was given 2026-03-05 16:32:07.590722 | 2026-03-05 16:32:07.590874 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-05 16:32:07.772772 | mon1 | ok: "logs" 2026-03-05 16:32:07.773070 | mon1 | ok: All items complete 2026-03-05 16:32:07.773126 | 2026-03-05 16:32:07.790622 | osd1 | ok: "logs" 2026-03-05 16:32:07.919988 | mon1 | ok: "artifacts" 2026-03-05 16:32:07.950560 | osd1 | ok: "artifacts" 2026-03-05 16:32:08.070689 | mon1 | ok: "docs" 2026-03-05 16:32:08.111801 | osd1 | ok: "docs" 2026-03-05 16:32:08.129551 | 2026-03-05 16:32:08.129671 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-05 16:32:08.317117 | osd1 | changed: "logs" 2026-03-05 16:32:08.317457 | osd1 | ok: All items complete 2026-03-05 16:32:08.317504 | 2026-03-05 16:32:08.323370 | mon1 | changed: "logs" 2026-03-05 16:32:08.465413 | osd1 | changed: "artifacts" 2026-03-05 16:32:08.470577 | mon1 | changed: "artifacts" 2026-03-05 16:32:08.612976 | osd1 | changed: "docs" 2026-03-05 16:32:08.618536 | mon1 | changed: "docs" 2026-03-05 16:32:08.639827 | 2026-03-05 16:32:08.639931 | PLAY RECAP 2026-03-05 16:32:08.639976 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 16:32:08.640004 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 16:32:08.640028 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 16:32:08.640046 | 2026-03-05 16:32:08.788974 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 16:32:08.793864 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 16:32:09.378556 | 2026-03-05 16:32:09.378728 | PLAY [all] 2026-03-05 16:32:09.390547 | 2026-03-05 16:32:09.390662 | TASK [setup-uv : Extract archive] 2026-03-05 16:32:11.481192 | osd1 | changed 2026-03-05 16:32:11.563044 | mon1 | changed 2026-03-05 16:32:11.570335 | 2026-03-05 16:32:11.570410 | TASK [setup-uv : Print version] 2026-03-05 16:32:11.641084 | osd1 | uv 0.8.13 2026-03-05 16:32:11.921314 | mon1 | uv 0.8.13 2026-03-05 16:32:12.129565 | mon1 | ok: Runtime: 0:00:00.013864 2026-03-05 16:32:12.137954 | osd1 | ok: Runtime: 0:00:00.010825 2026-03-05 16:32:12.147483 | 2026-03-05 16:32:12.147534 | PLAY RECAP 2026-03-05 16:32:12.147580 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 16:32:12.147608 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 16:32:12.147627 | 2026-03-05 16:32:12.253923 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 16:32:12.257640 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 16:32:12.810984 | 2026-03-05 16:32:12.811117 | PLAY [all] 2026-03-05 16:32:12.822110 | 2026-03-05 16:32:12.822237 | TASK [Copy inventory file for Zuul] 2026-03-05 16:32:13.641771 | mon1 | changed 2026-03-05 16:32:13.647480 | 2026-03-05 16:32:13.647552 | TASK [Switch "ansible_host" to private IP] 2026-03-05 16:32:13.916601 | mon1 | changed: 2 replacements made 2026-03-05 16:32:13.924090 | 2026-03-05 16:32:13.924157 | TASK [Run Molecule scenario] 2026-03-05 16:32:14.476131 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-03-05 16:32:15.146458 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-03-05 16:32:15.345315 | mon1 | Using CPython 3.13.7 2026-03-05 16:32:15.345381 | mon1 | Creating virtual environment at: .venv 2026-03-05 16:32:15.568973 | mon1 | Downloading pygments (1.2MiB) 2026-03-05 16:32:15.580494 | mon1 | Downloading netaddr (2.2MiB) 2026-03-05 16:32:15.581369 | mon1 | Downloading ansible-core (2.1MiB) 2026-03-05 16:32:15.581561 | mon1 | Downloading cryptography (4.3MiB) 2026-03-05 16:32:15.759118 | mon1 | Downloading netaddr 2026-03-05 16:32:15.769035 | mon1 | Downloading cryptography 2026-03-05 16:32:15.814136 | mon1 | Downloading pygments 2026-03-05 16:32:15.951390 | mon1 | Downloading ansible-core 2026-03-05 16:32:15.979592 | mon1 | Installed 36 packages in 27ms 2026-03-05 16:32:17.060164 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-03-05 16:32:17.060251 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-03-05 16:32:17.655186 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-05 16:32:17.655272 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-05 16:32:30.018189 | mon1 | INFO [default > dependency] Executing 2026-03-05 16:32:30.018330 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-05 16:32:30.018501 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-05 16:32:30.018616 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-05 16:32:30.023675 | mon1 | INFO [default > cleanup] Executing 2026-03-05 16:32:30.024006 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 16:32:30.028980 | mon1 | INFO [default > destroy] Executing 2026-03-05 16:32:30.029017 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 16:32:30.029052 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-05 16:32:30.034035 | mon1 | INFO [default > syntax] Executing 2026-03-05 16:32:31.078656 | mon1 | 2026-03-05 16:32:31.078928 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-05 16:32:31.129193 | mon1 | INFO [default > syntax] Executed: Successful 2026-03-05 16:32:31.138038 | mon1 | INFO [default > create] Executing 2026-03-05 16:32:31.139849 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 16:32:31.145970 | mon1 | INFO [default > prepare] Executing 2026-03-05 16:32:31.780301 | mon1 | 2026-03-05 16:32:31.780537 | mon1 | PLAY [Prepare] ***************************************************************** 2026-03-05 16:32:31.780911 | mon1 | 2026-03-05 16:32:31.781195 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:32:31.781464 | mon1 | Thursday 05 March 2026 16:32:31 +0000 (0:00:00.029) 0:00:00.029 ******** 2026-03-05 16:32:32.860337 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 16:32:32.860584 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 16:32:32.860807 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 16:32:32.861018 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 16:32:32.861241 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:32:32.904298 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 16:32:32.904510 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 16:32:32.904703 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 16:32:32.904895 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 16:32:32.905092 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:32:32.912717 | mon1 | ok: [mon1] 2026-03-05 16:32:32.912923 | mon1 | ok: [osd1] 2026-03-05 16:32:32.913120 | mon1 | 2026-03-05 16:32:32.913337 | mon1 | TASK [Configure short hostname] ************************************************ 2026-03-05 16:32:32.913963 | mon1 | Thursday 05 March 2026 16:32:32 +0000 (0:00:01.133) 0:00:01.163 ******** 2026-03-05 16:32:33.616791 | mon1 | changed: [osd1] 2026-03-05 16:32:33.616968 | mon1 | changed: [mon1] 2026-03-05 16:32:33.617156 | mon1 | 2026-03-05 16:32:33.617367 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-05 16:32:33.617586 | mon1 | Thursday 05 March 2026 16:32:33 +0000 (0:00:00.703) 0:00:01.866 ******** 2026-03-05 16:32:33.882677 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-05 16:32:33.882795 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-03-05 16:32:33.882931 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-05 16:32:33.895389 | mon1 | changed: [mon1] 2026-03-05 16:32:33.895518 | mon1 | changed: [osd1] 2026-03-05 16:32:33.895644 | mon1 | 2026-03-05 16:32:33.895784 | mon1 | TASK [Update apt cache] ******************************************************** 2026-03-05 16:32:33.895959 | mon1 | Thursday 05 March 2026 16:32:33 +0000 (0:00:00.279) 0:00:02.145 ******** 2026-03-05 16:32:41.633019 | mon1 | changed: [osd1] 2026-03-05 16:32:41.633162 | mon1 | changed: [mon1] 2026-03-05 16:32:41.633399 | mon1 | 2026-03-05 16:32:41.633606 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-03-05 16:32:41.633744 | mon1 | 2026-03-05 16:32:41.633989 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:32:41.634145 | mon1 | Thursday 05 March 2026 16:32:41 +0000 (0:00:07.737) 0:00:09.883 ******** 2026-03-05 16:32:42.315647 | mon1 | ok: [osd1] 2026-03-05 16:32:42.315769 | mon1 | 2026-03-05 16:32:42.316070 | mon1 | TASK [Install depedencies] ***************************************************** 2026-03-05 16:32:42.316302 | mon1 | Thursday 05 March 2026 16:32:42 +0000 (0:00:00.682) 0:00:10.565 ******** 2026-03-05 16:33:02.739043 | mon1 | changed: [osd1] 2026-03-05 16:33:02.739107 | mon1 | 2026-03-05 16:33:02.739141 | mon1 | TASK [Start up service] ******************************************************** 2026-03-05 16:33:02.739244 | mon1 | Thursday 05 March 2026 16:33:02 +0000 (0:00:20.423) 0:00:30.989 ******** 2026-03-05 16:33:03.295725 | mon1 | ok: [osd1] 2026-03-05 16:33:03.295802 | mon1 | 2026-03-05 16:33:03.295964 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-03-05 16:33:03.296092 | mon1 | Thursday 05 March 2026 16:33:03 +0000 (0:00:00.555) 0:00:31.545 ******** 2026-03-05 16:33:03.595642 | mon1 | ok: [osd1] 2026-03-05 16:33:03.595820 | mon1 | 2026-03-05 16:33:03.596066 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-05 16:33:03.596308 | mon1 | Thursday 05 March 2026 16:33:03 +0000 (0:00:00.300) 0:00:31.845 ******** 2026-03-05 16:33:04.261256 | mon1 | changed: [osd1] 2026-03-05 16:33:04.261424 | mon1 | 2026-03-05 16:33:04.261668 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-03-05 16:33:04.261917 | mon1 | Thursday 05 March 2026 16:33:04 +0000 (0:00:00.665) 0:00:32.510 ******** 2026-03-05 16:33:04.456598 | mon1 | ok: [osd1] 2026-03-05 16:33:04.456766 | mon1 | 2026-03-05 16:33:04.456993 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-05 16:33:04.457271 | mon1 | Thursday 05 March 2026 16:33:04 +0000 (0:00:00.195) 0:00:32.706 ******** 2026-03-05 16:33:04.475817 | mon1 | skipping: [osd1] 2026-03-05 16:33:04.475995 | mon1 | 2026-03-05 16:33:04.476134 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-03-05 16:33:04.476263 | mon1 | Thursday 05 March 2026 16:33:04 +0000 (0:00:00.019) 0:00:32.726 ******** 2026-03-05 16:33:04.996430 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 16:33:04.996501 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 16:33:04.996635 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 16:33:04.996754 | mon1 | 2026-03-05 16:33:04.996884 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-03-05 16:33:04.997014 | mon1 | Thursday 05 March 2026 16:33:04 +0000 (0:00:00.519) 0:00:33.246 ******** 2026-03-05 16:33:05.628764 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 16:33:05.628938 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 16:33:05.629161 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 16:33:05.629346 | mon1 | 2026-03-05 16:33:05.629542 | mon1 | TASK [Start loop devices] ****************************************************** 2026-03-05 16:33:05.629739 | mon1 | Thursday 05 March 2026 16:33:05 +0000 (0:00:00.631) 0:00:33.878 ******** 2026-03-05 16:33:06.327827 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 16:33:06.328045 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 16:33:06.328243 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 16:33:06.328427 | mon1 | 2026-03-05 16:33:06.328632 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-03-05 16:33:06.328829 | mon1 | Thursday 05 March 2026 16:33:06 +0000 (0:00:00.699) 0:00:34.577 ******** 2026-03-05 16:33:09.460174 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 16:33:09.460370 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 16:33:09.460585 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 16:33:09.460784 | mon1 | 2026-03-05 16:33:09.461002 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-03-05 16:33:09.461213 | mon1 | Thursday 05 March 2026 16:33:09 +0000 (0:00:03.132) 0:00:37.710 ******** 2026-03-05 16:33:11.285693 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-03-05 16:33:11.285840 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-03-05 16:33:11.286131 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-03-05 16:33:11.286353 | mon1 | 2026-03-05 16:33:11.286572 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 16:33:11.286815 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 16:33:11.287054 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-05 16:33:11.287196 | mon1 | 2026-03-05 16:33:11.287400 | mon1 | 2026-03-05 16:33:11.287614 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 16:33:11.287828 | mon1 | Thursday 05 March 2026 16:33:11 +0000 (0:00:01.825) 0:00:39.536 ******** 2026-03-05 16:33:11.288078 | mon1 | =============================================================================== 2026-03-05 16:33:11.288287 | mon1 | Install depedencies ---------------------------------------------------- 20.42s 2026-03-05 16:33:11.288501 | mon1 | Update apt cache -------------------------------------------------------- 7.74s 2026-03-05 16:33:11.288771 | mon1 | Create a volume group for each loop device ------------------------------ 3.13s 2026-03-05 16:33:11.288973 | mon1 | Create a logical volume for each loop device ---------------------------- 1.83s 2026-03-05 16:33:11.289093 | mon1 | Gathering Facts --------------------------------------------------------- 1.13s 2026-03-05 16:33:11.289217 | mon1 | Configure short hostname ------------------------------------------------ 0.70s 2026-03-05 16:33:11.289341 | mon1 | Start loop devices ------------------------------------------------------ 0.70s 2026-03-05 16:33:11.289464 | mon1 | Gathering Facts --------------------------------------------------------- 0.68s 2026-03-05 16:33:11.289580 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.67s 2026-03-05 16:33:11.289702 | mon1 | Set permissions on loopback devices ------------------------------------- 0.63s 2026-03-05 16:33:11.289823 | mon1 | Start up service -------------------------------------------------------- 0.56s 2026-03-05 16:33:11.289945 | mon1 | Create devices for Ceph ------------------------------------------------- 0.52s 2026-03-05 16:33:11.290066 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.30s 2026-03-05 16:33:11.290190 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.28s 2026-03-05 16:33:11.290316 | mon1 | Get list of all loopback devices ---------------------------------------- 0.20s 2026-03-05 16:33:11.290441 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-03-05 16:33:11.349878 | mon1 | INFO [default > prepare] Executed: Successful 2026-03-05 16:33:11.359488 | mon1 | INFO [default > converge] Executing 2026-03-05 16:33:12.199169 | mon1 | 2026-03-05 16:33:12.199330 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 16:33:12.199580 | mon1 | 2026-03-05 16:33:12.199747 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:33:12.200068 | mon1 | Thursday 05 March 2026 16:33:12 +0000 (0:00:00.047) 0:00:00.047 ******** 2026-03-05 16:33:13.183038 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 16:33:13.183307 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 16:33:13.183566 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 16:33:13.183779 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 16:33:13.184061 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:33:13.194909 | mon1 | ok: [mon1] 2026-03-05 16:33:13.195124 | mon1 | 2026-03-05 16:33:13.195351 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:33:13.195599 | mon1 | Thursday 05 March 2026 16:33:13 +0000 (0:00:00.996) 0:00:01.043 ******** 2026-03-05 16:33:13.485805 | mon1 | ok: [mon1] 2026-03-05 16:33:13.485961 | mon1 | 2026-03-05 16:33:13.486179 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:33:13.486386 | mon1 | Thursday 05 March 2026 16:33:13 +0000 (0:00:00.290) 0:00:01.333 ******** 2026-03-05 16:33:13.522218 | mon1 | skipping: [mon1] 2026-03-05 16:33:13.522382 | mon1 | 2026-03-05 16:33:13.522590 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 16:33:13.522791 | mon1 | Thursday 05 March 2026 16:33:13 +0000 (0:00:00.036) 0:00:01.370 ******** 2026-03-05 16:33:13.818248 | mon1 | changed: [mon1] 2026-03-05 16:33:13.818304 | mon1 | 2026-03-05 16:33:13.818401 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:33:13.818498 | mon1 | Thursday 05 March 2026 16:33:13 +0000 (0:00:00.295) 0:00:01.666 ******** 2026-03-05 16:33:13.913200 | mon1 | ok: [mon1] => { 2026-03-05 16:33:13.913404 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 16:33:13.913587 | mon1 | } 2026-03-05 16:33:13.913758 | mon1 | 2026-03-05 16:33:13.913947 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:33:13.914131 | mon1 | Thursday 05 March 2026 16:33:13 +0000 (0:00:00.095) 0:00:01.761 ******** 2026-03-05 16:33:14.561558 | mon1 | changed: [mon1] 2026-03-05 16:33:14.561731 | mon1 | 2026-03-05 16:33:14.561959 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:33:14.562164 | mon1 | Thursday 05 March 2026 16:33:14 +0000 (0:00:00.648) 0:00:02.409 ******** 2026-03-05 16:33:14.601717 | mon1 | skipping: [mon1] 2026-03-05 16:33:14.601923 | mon1 | 2026-03-05 16:33:14.602137 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:33:14.602340 | mon1 | Thursday 05 March 2026 16:33:14 +0000 (0:00:00.040) 0:00:02.450 ******** 2026-03-05 16:33:14.636770 | mon1 | skipping: [mon1] 2026-03-05 16:33:14.636838 | mon1 | 2026-03-05 16:33:14.636983 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:33:14.637109 | mon1 | Thursday 05 March 2026 16:33:14 +0000 (0:00:00.034) 0:00:02.484 ******** 2026-03-05 16:33:14.848537 | mon1 | ok: [mon1] 2026-03-05 16:33:14.848704 | mon1 | 2026-03-05 16:33:14.848919 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:33:14.849175 | mon1 | Thursday 05 March 2026 16:33:14 +0000 (0:00:00.211) 0:00:02.696 ******** 2026-03-05 16:33:16.073680 | mon1 | ok: [mon1] 2026-03-05 16:33:16.073738 | mon1 | 2026-03-05 16:33:16.073750 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:33:16.073760 | mon1 | Thursday 05 March 2026 16:33:16 +0000 (0:00:01.224) 0:00:03.921 ******** 2026-03-05 16:33:16.147681 | mon1 | ok: [mon1] => { 2026-03-05 16:33:16.147716 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 16:33:16.147732 | mon1 | } 2026-03-05 16:33:16.148001 | mon1 | 2026-03-05 16:33:16.148313 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:33:16.148328 | mon1 | Thursday 05 March 2026 16:33:16 +0000 (0:00:00.074) 0:00:03.995 ******** 2026-03-05 16:33:16.890182 | mon1 | changed: [mon1] 2026-03-05 16:33:16.890269 | mon1 | 2026-03-05 16:33:16.890579 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:33:16.890644 | mon1 | Thursday 05 March 2026 16:33:16 +0000 (0:00:00.742) 0:00:04.738 ******** 2026-03-05 16:33:19.789950 | mon1 | changed: [mon1] 2026-03-05 16:33:19.790015 | mon1 | 2026-03-05 16:33:19.790189 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 16:33:19.790208 | mon1 | Thursday 05 March 2026 16:33:19 +0000 (0:00:02.900) 0:00:07.638 ******** 2026-03-05 16:33:19.816917 | mon1 | skipping: [mon1] 2026-03-05 16:33:19.817031 | mon1 | 2026-03-05 16:33:19.817175 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 16:33:19.817320 | mon1 | Thursday 05 March 2026 16:33:19 +0000 (0:00:00.027) 0:00:07.665 ******** 2026-03-05 16:33:19.841982 | mon1 | skipping: [mon1] 2026-03-05 16:33:19.842060 | mon1 | 2026-03-05 16:33:19.842159 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 16:33:19.842251 | mon1 | Thursday 05 March 2026 16:33:19 +0000 (0:00:00.025) 0:00:07.690 ******** 2026-03-05 16:33:19.868659 | mon1 | skipping: [mon1] 2026-03-05 16:33:19.868719 | mon1 | 2026-03-05 16:33:19.868824 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 16:33:19.868913 | mon1 | Thursday 05 March 2026 16:33:19 +0000 (0:00:00.026) 0:00:07.717 ******** 2026-03-05 16:33:25.276364 | mon1 | changed: [mon1] 2026-03-05 16:33:25.276450 | mon1 | 2026-03-05 16:33:25.276787 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 16:33:25.276833 | mon1 | Thursday 05 March 2026 16:33:25 +0000 (0:00:05.406) 0:00:13.124 ******** 2026-03-05 16:33:25.801513 | mon1 | changed: [mon1] 2026-03-05 16:33:25.801566 | mon1 | 2026-03-05 16:33:25.801800 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 16:33:25.801843 | mon1 | Thursday 05 March 2026 16:33:25 +0000 (0:00:00.525) 0:00:13.649 ******** 2026-03-05 16:33:26.724231 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-05 16:33:26.724318 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 16:33:26.724904 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 16:33:26.725076 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 16:33:26.725084 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 16:33:26.725089 | mon1 | 2026-03-05 16:33:26.725094 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 16:33:26.725099 | mon1 | Thursday 05 March 2026 16:33:26 +0000 (0:00:00.922) 0:00:14.572 ******** 2026-03-05 16:33:27.267886 | mon1 | changed: [mon1] 2026-03-05 16:33:27.267999 | mon1 | 2026-03-05 16:33:27.268508 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 16:33:27.268545 | mon1 | Thursday 05 March 2026 16:33:27 +0000 (0:00:00.536) 0:00:15.109 ******** 2026-03-05 16:33:27.268550 | mon1 | 2026-03-05 16:33:27.268555 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 16:33:27.268560 | mon1 | Thursday 05 March 2026 16:33:27 +0000 (0:00:00.006) 0:00:15.116 ******** 2026-03-05 16:33:28.156422 | mon1 | ok: [mon1] 2026-03-05 16:33:28.156483 | mon1 | 2026-03-05 16:33:28.156569 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 16:33:28.156702 | mon1 | Thursday 05 March 2026 16:33:28 +0000 (0:00:00.888) 0:00:16.004 ******** 2026-03-05 16:33:28.624988 | mon1 | changed: [mon1] 2026-03-05 16:33:28.625077 | mon1 | 2026-03-05 16:33:28.625144 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 16:33:28.625268 | mon1 | Thursday 05 March 2026 16:33:28 +0000 (0:00:00.468) 0:00:16.473 ******** 2026-03-05 16:33:29.176310 | mon1 | changed: [mon1] 2026-03-05 16:33:29.176374 | mon1 | 2026-03-05 16:33:29.176626 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:33:29.176672 | mon1 | Thursday 05 March 2026 16:33:29 +0000 (0:00:00.551) 0:00:17.024 ******** 2026-03-05 16:33:29.371283 | mon1 | ok: [mon1] 2026-03-05 16:33:29.371353 | mon1 | 2026-03-05 16:33:29.371564 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:33:29.371608 | mon1 | Thursday 05 March 2026 16:33:29 +0000 (0:00:00.194) 0:00:17.219 ******** 2026-03-05 16:33:29.437715 | mon1 | ok: [mon1] => { 2026-03-05 16:33:29.437784 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 16:33:29.438148 | mon1 | } 2026-03-05 16:33:29.438173 | mon1 | 2026-03-05 16:33:29.438179 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:33:29.438184 | mon1 | Thursday 05 March 2026 16:33:29 +0000 (0:00:00.066) 0:00:17.286 ******** 2026-03-05 16:33:30.286923 | mon1 | changed: [mon1] 2026-03-05 16:33:30.286974 | mon1 | 2026-03-05 16:33:30.286981 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:33:30.286988 | mon1 | Thursday 05 March 2026 16:33:30 +0000 (0:00:00.848) 0:00:18.134 ******** 2026-03-05 16:33:34.621774 | mon1 | changed: [mon1] 2026-03-05 16:33:34.621833 | mon1 | 2026-03-05 16:33:34.621934 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 16:33:34.622034 | mon1 | Thursday 05 March 2026 16:33:34 +0000 (0:00:04.308) 0:00:22.443 ******** 2026-03-05 16:33:35.529361 | mon1 | ok: [mon1] 2026-03-05 16:33:35.529438 | mon1 | 2026-03-05 16:33:35.529595 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 16:33:35.529726 | mon1 | Thursday 05 March 2026 16:33:35 +0000 (0:00:00.933) 0:00:23.376 ******** 2026-03-05 16:33:35.844114 | mon1 | changed: [mon1] 2026-03-05 16:33:35.844318 | mon1 | 2026-03-05 16:33:35.844558 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 16:33:35.844774 | mon1 | Thursday 05 March 2026 16:33:35 +0000 (0:00:00.315) 0:00:23.691 ******** 2026-03-05 16:33:36.292479 | mon1 | changed: [mon1] 2026-03-05 16:33:36.292646 | mon1 | 2026-03-05 16:33:36.292863 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 16:33:36.293064 | mon1 | Thursday 05 March 2026 16:33:36 +0000 (0:00:00.448) 0:00:24.140 ******** 2026-03-05 16:33:36.872970 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-03-05 16:33:36.873235 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 16:33:36.873479 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 16:33:36.873672 | mon1 | 2026-03-05 16:33:36.873838 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 16:33:36.874040 | mon1 | Thursday 05 March 2026 16:33:36 +0000 (0:00:00.580) 0:00:24.720 ******** 2026-03-05 16:33:37.319237 | mon1 | changed: [mon1] 2026-03-05 16:33:37.319410 | mon1 | 2026-03-05 16:33:37.319641 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 16:33:37.319877 | mon1 | Thursday 05 March 2026 16:33:37 +0000 (0:00:00.446) 0:00:25.166 ******** 2026-03-05 16:33:37.776102 | mon1 | changed: [mon1] 2026-03-05 16:33:37.776167 | mon1 | 2026-03-05 16:33:37.776343 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 16:33:37.776434 | mon1 | Thursday 05 March 2026 16:33:37 +0000 (0:00:00.450) 0:00:25.617 ******** 2026-03-05 16:33:37.776554 | mon1 | 2026-03-05 16:33:37.776683 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 16:33:37.776802 | mon1 | Thursday 05 March 2026 16:33:37 +0000 (0:00:00.006) 0:00:25.624 ******** 2026-03-05 16:33:38.445732 | mon1 | ok: [mon1] 2026-03-05 16:33:38.445800 | mon1 | 2026-03-05 16:33:38.445976 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 16:33:38.446108 | mon1 | Thursday 05 March 2026 16:33:38 +0000 (0:00:00.669) 0:00:26.293 ******** 2026-03-05 16:33:39.499971 | mon1 | changed: [mon1] 2026-03-05 16:33:39.500049 | mon1 | 2026-03-05 16:33:39.500066 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 16:33:39.500080 | mon1 | Thursday 05 March 2026 16:33:39 +0000 (0:00:01.053) 0:00:27.347 ******** 2026-03-05 16:33:40.022730 | mon1 | changed: [mon1] 2026-03-05 16:33:40.022793 | mon1 | 2026-03-05 16:33:40.023004 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 16:33:40.023044 | mon1 | Thursday 05 March 2026 16:33:40 +0000 (0:00:00.523) 0:00:27.870 ******** 2026-03-05 16:33:40.070186 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 16:33:40.070582 | mon1 | 2026-03-05 16:33:40.070608 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 16:33:40.070616 | mon1 | Thursday 05 March 2026 16:33:40 +0000 (0:00:00.047) 0:00:27.918 ******** 2026-03-05 16:34:04.617860 | mon1 | changed: [mon1] 2026-03-05 16:34:04.617914 | mon1 | 2026-03-05 16:34:04.617920 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 16:34:04.617925 | mon1 | Thursday 05 March 2026 16:34:04 +0000 (0:00:24.547) 0:00:52.465 ******** 2026-03-05 16:34:05.278341 | mon1 | ok: [mon1] => (item=chronyd) 2026-03-05 16:34:05.278609 | mon1 | ok: [mon1] => (item=sshd) 2026-03-05 16:34:05.278623 | mon1 | 2026-03-05 16:34:05.278638 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 16:34:05.278776 | mon1 | Thursday 05 March 2026 16:34:05 +0000 (0:00:00.660) 0:00:53.126 ******** 2026-03-05 16:34:05.964404 | mon1 | changed: [mon1] 2026-03-05 16:34:05.964478 | mon1 | 2026-03-05 16:34:05.964820 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 16:34:05.964877 | mon1 | Thursday 05 March 2026 16:34:05 +0000 (0:00:00.686) 0:00:53.812 ******** 2026-03-05 16:34:06.150298 | mon1 | ok: [mon1] 2026-03-05 16:34:06.150362 | mon1 | 2026-03-05 16:34:06.150698 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 16:34:06.150746 | mon1 | Thursday 05 March 2026 16:34:06 +0000 (0:00:00.185) 0:00:53.998 ******** 2026-03-05 16:34:06.606711 | mon1 | changed: [mon1] 2026-03-05 16:34:06.606769 | mon1 | 2026-03-05 16:34:06.606986 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 16:34:06.607032 | mon1 | Thursday 05 March 2026 16:34:06 +0000 (0:00:00.456) 0:00:54.454 ******** 2026-03-05 16:34:06.930552 | mon1 | changed: [mon1] 2026-03-05 16:34:06.930607 | mon1 | 2026-03-05 16:34:06.930874 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 16:34:06.930936 | mon1 | Thursday 05 March 2026 16:34:06 +0000 (0:00:00.323) 0:00:54.778 ******** 2026-03-05 16:34:07.047062 | mon1 | ok: [mon1] 2026-03-05 16:34:07.047472 | mon1 | 2026-03-05 16:34:07.047506 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 16:34:07.047515 | mon1 | Thursday 05 March 2026 16:34:07 +0000 (0:00:00.116) 0:00:54.895 ******** 2026-03-05 16:34:07.248889 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 16:34:07.248943 | mon1 | 2026-03-05 16:34:07.249166 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 16:34:07.249208 | mon1 | Thursday 05 March 2026 16:34:07 +0000 (0:00:00.201) 0:00:55.096 ******** 2026-03-05 16:34:07.292542 | mon1 | ok: [mon1] 2026-03-05 16:34:07.292844 | mon1 | 2026-03-05 16:34:07.292869 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 16:34:07.292876 | mon1 | Thursday 05 March 2026 16:34:07 +0000 (0:00:00.043) 0:00:55.140 ******** 2026-03-05 16:34:07.386587 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-03-05 16:34:07.386625 | mon1 | 2026-03-05 16:34:07.386882 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-05 16:34:07.386942 | mon1 | Thursday 05 March 2026 16:34:07 +0000 (0:00:00.094) 0:00:55.234 ******** 2026-03-05 16:34:07.642778 | mon1 | changed: [mon1] 2026-03-05 16:34:07.642846 | mon1 | 2026-03-05 16:34:07.643054 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-05 16:34:07.643095 | mon1 | Thursday 05 March 2026 16:34:07 +0000 (0:00:00.256) 0:00:55.490 ******** 2026-03-05 16:34:08.264357 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-05 16:34:08.264421 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-05 16:34:08.264827 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-05 16:34:08.264876 | mon1 | 2026-03-05 16:34:08.264882 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-05 16:34:08.264887 | mon1 | Thursday 05 March 2026 16:34:08 +0000 (0:00:00.621) 0:00:56.112 ******** 2026-03-05 16:36:11.910369 | mon1 | ok: [mon1] 2026-03-05 16:36:11.910479 | mon1 | 2026-03-05 16:36:11.910492 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-05 16:36:11.910650 | mon1 | Thursday 05 March 2026 16:36:11 +0000 (0:02:03.645) 0:02:59.758 ******** 2026-03-05 16:36:12.119091 | mon1 | changed: [mon1] 2026-03-05 16:36:12.119196 | mon1 | 2026-03-05 16:36:12.119447 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-05 16:36:12.119507 | mon1 | Thursday 05 March 2026 16:36:12 +0000 (0:00:00.208) 0:02:59.967 ******** 2026-03-05 16:36:12.157067 | mon1 | ok: [mon1] 2026-03-05 16:36:12.157514 | mon1 | 2026-03-05 16:36:12.157561 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:36:12.157569 | mon1 | Thursday 05 March 2026 16:36:12 +0000 (0:00:00.037) 0:03:00.004 ******** 2026-03-05 16:36:12.222561 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 16:36:12.222624 | mon1 | 2026-03-05 16:36:12.222741 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:36:12.222844 | mon1 | Thursday 05 March 2026 16:36:12 +0000 (0:00:00.066) 0:03:00.071 ******** 2026-03-05 16:36:18.735569 | mon1 | ok: [mon1] 2026-03-05 16:36:18.735624 | mon1 | 2026-03-05 16:36:18.735630 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:36:18.735635 | mon1 | Thursday 05 March 2026 16:36:18 +0000 (0:00:06.512) 0:03:06.583 ******** 2026-03-05 16:36:18.781613 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 16:36:18.781632 | mon1 | 2026-03-05 16:36:18.781637 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:36:18.781641 | mon1 | Thursday 05 March 2026 16:36:18 +0000 (0:00:00.046) 0:03:06.629 ******** 2026-03-05 16:36:19.150720 | mon1 | ok: [mon1] 2026-03-05 16:36:19.150786 | mon1 | 2026-03-05 16:36:19.150792 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:36:19.150797 | mon1 | Thursday 05 March 2026 16:36:19 +0000 (0:00:00.368) 0:03:06.998 ******** 2026-03-05 16:36:25.704875 | mon1 | ok: [mon1] 2026-03-05 16:36:25.704959 | mon1 | 2026-03-05 16:36:25.705031 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 16:36:25.705125 | mon1 | Thursday 05 March 2026 16:36:25 +0000 (0:00:06.554) 0:03:13.553 ******** 2026-03-05 16:36:38.354783 | mon1 | changed: [mon1] 2026-03-05 16:36:38.354971 | mon1 | 2026-03-05 16:36:38.355100 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 16:36:38.355222 | mon1 | Thursday 05 March 2026 16:36:38 +0000 (0:00:12.639) 0:03:26.193 ******** 2026-03-05 16:36:52.617526 | mon1 | ok: [mon1] 2026-03-05 16:36:52.617594 | mon1 | 2026-03-05 16:36:52.617676 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:36:52.617799 | mon1 | Thursday 05 March 2026 16:36:52 +0000 (0:00:14.272) 0:03:40.465 ******** 2026-03-05 16:36:52.681989 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 16:36:52.682263 | mon1 | 2026-03-05 16:36:52.682283 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:36:52.682289 | mon1 | Thursday 05 March 2026 16:36:52 +0000 (0:00:00.064) 0:03:40.530 ******** 2026-03-05 16:36:52.724581 | mon1 | skipping: [mon1] 2026-03-05 16:36:52.724703 | mon1 | 2026-03-05 16:36:52.724852 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:36:52.725007 | mon1 | Thursday 05 March 2026 16:36:52 +0000 (0:00:00.042) 0:03:40.572 ******** 2026-03-05 16:36:52.766779 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-05 16:36:52.766897 | mon1 | skipping: [mon1] 2026-03-05 16:36:52.767277 | mon1 | 2026-03-05 16:36:52.767299 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:36:52.767307 | mon1 | Thursday 05 March 2026 16:36:52 +0000 (0:00:00.042) 0:03:40.615 ******** 2026-03-05 16:36:53.017649 | mon1 | ok: [mon1] 2026-03-05 16:36:53.017696 | mon1 | 2026-03-05 16:36:53.017910 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:36:53.017973 | mon1 | Thursday 05 March 2026 16:36:53 +0000 (0:00:00.250) 0:03:40.865 ******** 2026-03-05 16:36:59.554517 | mon1 | ok: [mon1] 2026-03-05 16:36:59.554595 | mon1 | 2026-03-05 16:36:59.554891 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 16:36:59.554913 | mon1 | Thursday 05 March 2026 16:36:59 +0000 (0:00:06.536) 0:03:47.402 ******** 2026-03-05 16:37:11.578622 | mon1 | changed: [mon1] 2026-03-05 16:37:11.578693 | mon1 | 2026-03-05 16:37:11.578777 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 16:37:11.578867 | mon1 | Thursday 05 March 2026 16:37:11 +0000 (0:00:12.023) 0:03:59.426 ******** 2026-03-05 16:37:17.769572 | mon1 | ok: [mon1] 2026-03-05 16:37:17.769642 | mon1 | 2026-03-05 16:37:17.769924 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 16:37:17.769946 | mon1 | Thursday 05 March 2026 16:37:17 +0000 (0:00:06.190) 0:04:05.617 ******** 2026-03-05 16:37:24.763102 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-05 16:37:24.763169 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-05 16:37:24.763256 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-03-05 16:37:24.763346 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-05 16:37:24.763434 | mon1 | 2026-03-05 16:37:24.763528 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 16:37:24.763604 | mon1 | 2026-03-05 16:37:24.763695 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:37:24.763792 | mon1 | Thursday 05 March 2026 16:37:24 +0000 (0:00:06.993) 0:04:12.611 ******** 2026-03-05 16:37:25.825764 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 16:37:25.825948 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 16:37:25.826147 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 16:37:25.826361 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 16:37:25.826506 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:37:25.840173 | mon1 | ok: [osd1] 2026-03-05 16:37:25.840212 | mon1 | 2026-03-05 16:37:25.840302 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:37:25.840396 | mon1 | Thursday 05 March 2026 16:37:25 +0000 (0:00:01.076) 0:04:13.688 ******** 2026-03-05 16:37:26.041600 | mon1 | ok: [osd1] 2026-03-05 16:37:26.041646 | mon1 | 2026-03-05 16:37:26.041754 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:37:26.041847 | mon1 | Thursday 05 March 2026 16:37:26 +0000 (0:00:00.200) 0:04:13.889 ******** 2026-03-05 16:37:26.079173 | mon1 | skipping: [osd1] 2026-03-05 16:37:26.079206 | mon1 | 2026-03-05 16:37:26.079411 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 16:37:26.079439 | mon1 | Thursday 05 March 2026 16:37:26 +0000 (0:00:00.038) 0:04:13.927 ******** 2026-03-05 16:37:26.278834 | mon1 | changed: [osd1] 2026-03-05 16:37:26.278867 | mon1 | 2026-03-05 16:37:26.278969 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:37:26.279056 | mon1 | Thursday 05 March 2026 16:37:26 +0000 (0:00:00.199) 0:04:14.127 ******** 2026-03-05 16:37:26.328106 | mon1 | ok: [osd1] => { 2026-03-05 16:37:26.328159 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 16:37:26.328304 | mon1 | } 2026-03-05 16:37:26.328335 | mon1 | 2026-03-05 16:37:26.328439 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:37:26.328551 | mon1 | Thursday 05 March 2026 16:37:26 +0000 (0:00:00.049) 0:04:14.176 ******** 2026-03-05 16:37:26.993379 | mon1 | changed: [osd1] 2026-03-05 16:37:26.993510 | mon1 | 2026-03-05 16:37:26.993718 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:37:26.993919 | mon1 | Thursday 05 March 2026 16:37:26 +0000 (0:00:00.664) 0:04:14.840 ******** 2026-03-05 16:37:27.030397 | mon1 | skipping: [osd1] 2026-03-05 16:37:27.030434 | mon1 | 2026-03-05 16:37:27.030520 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:37:27.030615 | mon1 | Thursday 05 March 2026 16:37:27 +0000 (0:00:00.038) 0:04:14.879 ******** 2026-03-05 16:37:27.069834 | mon1 | skipping: [osd1] 2026-03-05 16:37:27.069871 | mon1 | 2026-03-05 16:37:27.069963 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:37:27.070039 | mon1 | Thursday 05 March 2026 16:37:27 +0000 (0:00:00.039) 0:04:14.918 ******** 2026-03-05 16:37:27.268825 | mon1 | ok: [osd1] 2026-03-05 16:37:27.268923 | mon1 | 2026-03-05 16:37:27.269204 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:37:27.269238 | mon1 | Thursday 05 March 2026 16:37:27 +0000 (0:00:00.198) 0:04:15.117 ******** 2026-03-05 16:37:28.521784 | mon1 | ok: [osd1] 2026-03-05 16:37:28.521862 | mon1 | 2026-03-05 16:37:28.521900 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:37:28.521996 | mon1 | Thursday 05 March 2026 16:37:28 +0000 (0:00:01.252) 0:04:16.370 ******** 2026-03-05 16:37:28.591500 | mon1 | ok: [osd1] => { 2026-03-05 16:37:28.591710 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 16:37:28.591936 | mon1 | } 2026-03-05 16:37:28.592167 | mon1 | 2026-03-05 16:37:28.592495 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:37:28.592723 | mon1 | Thursday 05 March 2026 16:37:28 +0000 (0:00:00.069) 0:04:16.439 ******** 2026-03-05 16:37:29.283978 | mon1 | changed: [osd1] 2026-03-05 16:37:29.284049 | mon1 | 2026-03-05 16:37:29.284089 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:37:29.284234 | mon1 | Thursday 05 March 2026 16:37:29 +0000 (0:00:00.692) 0:04:17.132 ******** 2026-03-05 16:37:31.984342 | mon1 | changed: [osd1] 2026-03-05 16:37:31.984411 | mon1 | 2026-03-05 16:37:31.984426 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 16:37:31.984556 | mon1 | Thursday 05 March 2026 16:37:31 +0000 (0:00:02.700) 0:04:19.832 ******** 2026-03-05 16:37:32.014112 | mon1 | skipping: [osd1] 2026-03-05 16:37:32.014173 | mon1 | 2026-03-05 16:37:32.014184 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 16:37:32.014194 | mon1 | Thursday 05 March 2026 16:37:32 +0000 (0:00:00.029) 0:04:19.862 ******** 2026-03-05 16:37:32.043831 | mon1 | skipping: [osd1] 2026-03-05 16:37:32.043963 | mon1 | 2026-03-05 16:37:32.044172 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 16:37:32.044264 | mon1 | Thursday 05 March 2026 16:37:32 +0000 (0:00:00.029) 0:04:19.892 ******** 2026-03-05 16:37:32.072134 | mon1 | skipping: [osd1] 2026-03-05 16:37:32.072183 | mon1 | 2026-03-05 16:37:32.072411 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 16:37:32.072508 | mon1 | Thursday 05 March 2026 16:37:32 +0000 (0:00:00.028) 0:04:19.920 ******** 2026-03-05 16:37:38.345737 | mon1 | changed: [osd1] 2026-03-05 16:37:38.345808 | mon1 | 2026-03-05 16:37:38.345862 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 16:37:38.345964 | mon1 | Thursday 05 March 2026 16:37:38 +0000 (0:00:06.273) 0:04:26.194 ******** 2026-03-05 16:37:38.792610 | mon1 | changed: [osd1] 2026-03-05 16:37:38.792742 | mon1 | 2026-03-05 16:37:38.792915 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 16:37:38.793074 | mon1 | Thursday 05 March 2026 16:37:38 +0000 (0:00:00.446) 0:04:26.640 ******** 2026-03-05 16:37:39.716396 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-05 16:37:39.716476 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 16:37:39.716599 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 16:37:39.716712 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 16:37:39.716832 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 16:37:39.716928 | mon1 | 2026-03-05 16:37:39.717060 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 16:37:39.717139 | mon1 | Thursday 05 March 2026 16:37:39 +0000 (0:00:00.923) 0:04:27.564 ******** 2026-03-05 16:37:40.228593 | mon1 | changed: [osd1] 2026-03-05 16:37:40.228650 | mon1 | 2026-03-05 16:37:40.228743 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 16:37:40.228836 | mon1 | Thursday 05 March 2026 16:37:40 +0000 (0:00:00.507) 0:04:28.071 ******** 2026-03-05 16:37:40.228919 | mon1 | 2026-03-05 16:37:40.229014 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 16:37:40.229102 | mon1 | Thursday 05 March 2026 16:37:40 +0000 (0:00:00.005) 0:04:28.077 ******** 2026-03-05 16:37:40.920747 | mon1 | ok: [osd1] 2026-03-05 16:37:40.920862 | mon1 | 2026-03-05 16:37:40.920875 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 16:37:40.920964 | mon1 | Thursday 05 March 2026 16:37:40 +0000 (0:00:00.691) 0:04:28.769 ******** 2026-03-05 16:37:41.382352 | mon1 | changed: [osd1] 2026-03-05 16:37:41.382465 | mon1 | 2026-03-05 16:37:41.382545 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 16:37:41.382677 | mon1 | Thursday 05 March 2026 16:37:41 +0000 (0:00:00.461) 0:04:29.230 ******** 2026-03-05 16:37:41.931660 | mon1 | changed: [osd1] 2026-03-05 16:37:41.931782 | mon1 | 2026-03-05 16:37:41.931797 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:37:41.931814 | mon1 | Thursday 05 March 2026 16:37:41 +0000 (0:00:00.549) 0:04:29.780 ******** 2026-03-05 16:37:42.126844 | mon1 | ok: [osd1] 2026-03-05 16:37:42.126970 | mon1 | 2026-03-05 16:37:42.126983 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:37:42.126997 | mon1 | Thursday 05 March 2026 16:37:42 +0000 (0:00:00.195) 0:04:29.975 ******** 2026-03-05 16:37:42.176201 | mon1 | ok: [osd1] => { 2026-03-05 16:37:42.176327 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 16:37:42.176456 | mon1 | } 2026-03-05 16:37:42.176568 | mon1 | 2026-03-05 16:37:42.176695 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:37:42.176814 | mon1 | Thursday 05 March 2026 16:37:42 +0000 (0:00:00.049) 0:04:30.024 ******** 2026-03-05 16:37:47.370456 | mon1 | changed: [osd1] 2026-03-05 16:37:47.370511 | mon1 | 2026-03-05 16:37:47.370519 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:37:47.370526 | mon1 | Thursday 05 March 2026 16:37:47 +0000 (0:00:05.193) 0:04:35.218 ******** 2026-03-05 16:37:52.687672 | mon1 | changed: [osd1] 2026-03-05 16:37:52.687719 | mon1 | 2026-03-05 16:37:52.687724 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 16:37:52.687729 | mon1 | Thursday 05 March 2026 16:37:52 +0000 (0:00:05.317) 0:04:40.535 ******** 2026-03-05 16:37:53.822933 | mon1 | ok: [osd1] 2026-03-05 16:37:53.823001 | mon1 | 2026-03-05 16:37:53.823327 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 16:37:53.823378 | mon1 | Thursday 05 March 2026 16:37:53 +0000 (0:00:01.135) 0:04:41.671 ******** 2026-03-05 16:37:54.047040 | mon1 | changed: [osd1] 2026-03-05 16:37:54.047096 | mon1 | 2026-03-05 16:37:54.047193 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 16:37:54.047332 | mon1 | Thursday 05 March 2026 16:37:54 +0000 (0:00:00.224) 0:04:41.895 ******** 2026-03-05 16:37:54.541832 | mon1 | changed: [osd1] 2026-03-05 16:37:54.541947 | mon1 | 2026-03-05 16:37:54.542155 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 16:37:54.542210 | mon1 | Thursday 05 March 2026 16:37:54 +0000 (0:00:00.494) 0:04:42.390 ******** 2026-03-05 16:37:55.076011 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-03-05 16:37:55.076089 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 16:37:55.076459 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 16:37:55.076509 | mon1 | 2026-03-05 16:37:55.076515 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 16:37:55.076520 | mon1 | Thursday 05 March 2026 16:37:55 +0000 (0:00:00.534) 0:04:42.924 ******** 2026-03-05 16:37:55.511014 | mon1 | changed: [osd1] 2026-03-05 16:37:55.511121 | mon1 | 2026-03-05 16:37:55.511416 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 16:37:55.511438 | mon1 | Thursday 05 March 2026 16:37:55 +0000 (0:00:00.434) 0:04:43.359 ******** 2026-03-05 16:37:55.957190 | mon1 | changed: [osd1] 2026-03-05 16:37:55.957265 | mon1 | 2026-03-05 16:37:55.957339 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 16:37:55.957735 | mon1 | Thursday 05 March 2026 16:37:55 +0000 (0:00:00.440) 0:04:43.799 ******** 2026-03-05 16:37:55.957780 | mon1 | 2026-03-05 16:37:55.957786 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 16:37:55.957791 | mon1 | Thursday 05 March 2026 16:37:55 +0000 (0:00:00.006) 0:04:43.805 ******** 2026-03-05 16:37:56.658107 | mon1 | ok: [osd1] 2026-03-05 16:37:56.658175 | mon1 | 2026-03-05 16:37:56.658187 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 16:37:56.658316 | mon1 | Thursday 05 March 2026 16:37:56 +0000 (0:00:00.700) 0:04:44.506 ******** 2026-03-05 16:37:57.866535 | mon1 | changed: [osd1] 2026-03-05 16:37:57.866583 | mon1 | 2026-03-05 16:37:57.866588 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 16:37:57.866593 | mon1 | Thursday 05 March 2026 16:37:57 +0000 (0:00:01.208) 0:04:45.714 ******** 2026-03-05 16:37:58.398800 | mon1 | changed: [osd1] 2026-03-05 16:37:58.398874 | mon1 | 2026-03-05 16:37:58.398936 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 16:37:58.399103 | mon1 | Thursday 05 March 2026 16:37:58 +0000 (0:00:00.532) 0:04:46.246 ******** 2026-03-05 16:37:58.443456 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 16:37:58.443566 | mon1 | 2026-03-05 16:37:58.443794 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 16:37:58.443849 | mon1 | Thursday 05 March 2026 16:37:58 +0000 (0:00:00.044) 0:04:46.291 ******** 2026-03-05 16:38:03.618030 | mon1 | changed: [osd1] 2026-03-05 16:38:03.618112 | mon1 | 2026-03-05 16:38:03.618149 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 16:38:03.618218 | mon1 | Thursday 05 March 2026 16:38:03 +0000 (0:00:05.174) 0:04:51.465 ******** 2026-03-05 16:38:04.286590 | mon1 | ok: [osd1] => (item=chronyd) 2026-03-05 16:38:04.286669 | mon1 | ok: [osd1] => (item=sshd) 2026-03-05 16:38:04.286725 | mon1 | 2026-03-05 16:38:04.286930 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 16:38:04.286975 | mon1 | Thursday 05 March 2026 16:38:04 +0000 (0:00:00.668) 0:04:52.134 ******** 2026-03-05 16:38:04.600159 | mon1 | changed: [osd1] 2026-03-05 16:38:04.600274 | mon1 | 2026-03-05 16:38:04.600288 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 16:38:04.600405 | mon1 | Thursday 05 March 2026 16:38:04 +0000 (0:00:00.313) 0:04:52.448 ******** 2026-03-05 16:38:04.801142 | mon1 | ok: [osd1] 2026-03-05 16:38:04.801240 | mon1 | 2026-03-05 16:38:04.802685 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 16:38:04.802719 | mon1 | Thursday 05 March 2026 16:38:04 +0000 (0:00:00.200) 0:04:52.648 ******** 2026-03-05 16:38:05.123746 | mon1 | changed: [osd1] 2026-03-05 16:38:05.123813 | mon1 | 2026-03-05 16:38:05.123896 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 16:38:05.123975 | mon1 | Thursday 05 March 2026 16:38:05 +0000 (0:00:00.323) 0:04:52.972 ******** 2026-03-05 16:38:05.334625 | mon1 | changed: [osd1] 2026-03-05 16:38:05.334696 | mon1 | 2026-03-05 16:38:05.334711 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 16:38:05.334858 | mon1 | Thursday 05 March 2026 16:38:05 +0000 (0:00:00.210) 0:04:53.183 ******** 2026-03-05 16:38:05.544439 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-05 16:38:05.544523 | mon1 | 2026-03-05 16:38:05.544769 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 16:38:05.544814 | mon1 | Thursday 05 March 2026 16:38:05 +0000 (0:00:00.209) 0:04:53.392 ******** 2026-03-05 16:38:05.583298 | mon1 | ok: [osd1] 2026-03-05 16:38:05.583335 | mon1 | 2026-03-05 16:38:05.583453 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:38:05.583555 | mon1 | Thursday 05 March 2026 16:38:05 +0000 (0:00:00.039) 0:04:53.431 ******** 2026-03-05 16:38:05.634383 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-05 16:38:05.634467 | mon1 | 2026-03-05 16:38:05.634568 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:38:05.634662 | mon1 | Thursday 05 March 2026 16:38:05 +0000 (0:00:00.051) 0:04:53.483 ******** 2026-03-05 16:38:11.776555 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:38:11.776628 | mon1 | 2026-03-05 16:38:11.776850 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:38:11.776893 | mon1 | Thursday 05 March 2026 16:38:11 +0000 (0:00:06.141) 0:04:59.624 ******** 2026-03-05 16:38:11.822055 | mon1 | ok: [osd1] => (item=osd1) 2026-03-05 16:38:11.822451 | mon1 | 2026-03-05 16:38:11.822492 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:38:11.822498 | mon1 | Thursday 05 March 2026 16:38:11 +0000 (0:00:00.045) 0:04:59.670 ******** 2026-03-05 16:38:12.080344 | mon1 | changed: [osd1] 2026-03-05 16:38:12.080421 | mon1 | 2026-03-05 16:38:12.080455 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:38:12.080593 | mon1 | Thursday 05 March 2026 16:38:12 +0000 (0:00:00.258) 0:04:59.928 ******** 2026-03-05 16:38:22.269396 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:38:22.269536 | mon1 | 2026-03-05 16:38:22.269549 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 16:38:22.269614 | mon1 | Thursday 05 March 2026 16:38:22 +0000 (0:00:10.188) 0:05:10.117 ******** 2026-03-05 16:38:23.826049 | mon1 | ok: [osd1] 2026-03-05 16:38:23.826133 | mon1 | 2026-03-05 16:38:23.826394 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 16:38:23.826474 | mon1 | Thursday 05 March 2026 16:38:23 +0000 (0:00:01.556) 0:05:11.673 ******** 2026-03-05 16:39:07.520458 | mon1 | ok: [osd1] 2026-03-05 16:39:07.520577 | mon1 | 2026-03-05 16:39:07.520590 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 16:39:07.520709 | mon1 | Thursday 05 March 2026 16:39:07 +0000 (0:00:43.694) 0:05:55.368 ******** 2026-03-05 16:40:57.347877 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-03-05 16:40:57.347956 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-03-05 16:40:57.348393 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-03-05 16:40:57.348440 | mon1 | 2026-03-05 16:40:57.348446 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 16:40:57.348451 | mon1 | Thursday 05 March 2026 16:40:57 +0000 (0:01:49.827) 0:07:45.196 ******** 2026-03-05 16:41:03.698918 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:41:03.698971 | mon1 | 2026-03-05 16:41:03.698977 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 16:41:03.698982 | mon1 | Thursday 05 March 2026 16:41:03 +0000 (0:00:06.350) 0:07:51.547 ******** 2026-03-05 16:41:09.864477 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:41:09.864547 | mon1 | 2026-03-05 16:41:09.864844 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 16:41:09.864865 | mon1 | Thursday 05 March 2026 16:41:09 +0000 (0:00:06.165) 0:07:57.712 ******** 2026-03-05 16:41:09.914859 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-05 16:41:09.914957 | mon1 | 2026-03-05 16:41:09.915078 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 16:41:09.915188 | mon1 | Thursday 05 March 2026 16:41:09 +0000 (0:00:00.050) 0:07:57.763 ******** 2026-03-05 16:41:09.950176 | mon1 | ok: [osd1] 2026-03-05 16:41:09.950235 | mon1 | 2026-03-05 16:41:09.950338 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 16:41:09.950442 | mon1 | Thursday 05 March 2026 16:41:09 +0000 (0:00:00.035) 0:07:57.798 ******** 2026-03-05 16:41:17.207662 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:41:17.207739 | mon1 | 2026-03-05 16:41:17.207943 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 16:41:17.208007 | mon1 | Thursday 05 March 2026 16:41:17 +0000 (0:00:07.257) 0:08:05.056 ******** 2026-03-05 16:41:17.248588 | mon1 | ok: [osd1] 2026-03-05 16:41:17.249057 | mon1 | 2026-03-05 16:41:17.249110 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 16:41:17.249118 | mon1 | Thursday 05 March 2026 16:41:17 +0000 (0:00:00.040) 0:08:05.096 ******** 2026-03-05 16:41:17.282983 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 16:41:17.283057 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 16:41:17.283632 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 16:41:17.283676 | mon1 | skipping: [osd1] 2026-03-05 16:41:17.283682 | mon1 | 2026-03-05 16:41:17.283687 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 16:41:17.283692 | mon1 | Thursday 05 March 2026 16:41:17 +0000 (0:00:00.034) 0:08:05.131 ******** 2026-03-05 16:41:17.315583 | mon1 | skipping: [osd1] 2026-03-05 16:41:17.315924 | mon1 | 2026-03-05 16:41:17.315969 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 16:41:17.315976 | mon1 | mon1 : ok=59 changed=29 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-05 16:41:17.318352 | mon1 | osd1 : ok=53 changed=24 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-05 16:41:17.318365 | mon1 | 2026-03-05 16:41:17.318370 | mon1 | 2026-03-05 16:41:17.318374 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 16:41:17.318379 | mon1 | Thursday 05 March 2026 16:41:17 +0000 (0:00:00.032) 0:08:05.164 ******** 2026-03-05 16:41:17.318383 | mon1 | =============================================================================== 2026-03-05 16:41:17.318400 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 123.65s 2026-03-05 16:41:17.318404 | mon1 | vexxhost.ceph.osd : Install OSDs -------------------------------------- 109.83s 2026-03-05 16:41:17.318408 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 43.69s 2026-03-05 16:41:17.318412 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 24.55s 2026-03-05 16:41:17.318416 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.27s 2026-03-05 16:41:17.318420 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 12.64s 2026-03-05 16:41:17.318423 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.02s 2026-03-05 16:41:17.318427 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 10.19s 2026-03-05 16:41:17.318431 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 7.26s 2026-03-05 16:41:17.318435 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 6.99s 2026-03-05 16:41:17.318439 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.55s 2026-03-05 16:41:17.318443 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.54s 2026-03-05 16:41:17.318447 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.51s 2026-03-05 16:41:17.318451 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.35s 2026-03-05 16:41:17.318455 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 6.27s 2026-03-05 16:41:17.318459 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.19s 2026-03-05 16:41:17.318463 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.17s 2026-03-05 16:41:17.318467 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.14s 2026-03-05 16:41:17.318470 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.41s 2026-03-05 16:41:17.318474 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 5.32s 2026-03-05 16:41:17.404853 | mon1 | INFO [default > converge] Executed: Successful 2026-03-05 16:41:17.416017 | mon1 | INFO [default > idempotence] Executing 2026-03-05 16:41:18.218609 | mon1 | 2026-03-05 16:41:18.218992 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 16:41:18.219364 | mon1 | 2026-03-05 16:41:18.219655 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:41:18.219964 | mon1 | Thursday 05 March 2026 16:41:18 +0000 (0:00:00.045) 0:00:00.045 ******** 2026-03-05 16:41:19.321148 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 16:41:19.321208 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 16:41:19.321215 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 16:41:19.321222 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 16:41:19.321228 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:41:19.333099 | mon1 | ok: [mon1] 2026-03-05 16:41:19.333119 | mon1 | 2026-03-05 16:41:19.333127 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:41:19.333132 | mon1 | Thursday 05 March 2026 16:41:19 +0000 (0:00:01.114) 0:00:01.160 ******** 2026-03-05 16:41:19.626755 | mon1 | ok: [mon1] 2026-03-05 16:41:19.626817 | mon1 | 2026-03-05 16:41:19.626829 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:41:19.626839 | mon1 | Thursday 05 March 2026 16:41:19 +0000 (0:00:00.293) 0:00:01.453 ******** 2026-03-05 16:41:19.662434 | mon1 | skipping: [mon1] 2026-03-05 16:41:19.662466 | mon1 | 2026-03-05 16:41:19.662477 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 16:41:19.662487 | mon1 | Thursday 05 March 2026 16:41:19 +0000 (0:00:00.036) 0:00:01.489 ******** 2026-03-05 16:41:19.959935 | mon1 | ok: [mon1] 2026-03-05 16:41:19.960633 | mon1 | 2026-03-05 16:41:19.960659 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:41:19.960714 | mon1 | Thursday 05 March 2026 16:41:19 +0000 (0:00:00.297) 0:00:01.786 ******** 2026-03-05 16:41:20.027694 | mon1 | ok: [mon1] => { 2026-03-05 16:41:20.027746 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 16:41:20.027754 | mon1 | } 2026-03-05 16:41:20.027760 | mon1 | 2026-03-05 16:41:20.027772 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:41:20.027947 | mon1 | Thursday 05 March 2026 16:41:20 +0000 (0:00:00.067) 0:00:01.854 ******** 2026-03-05 16:41:20.411731 | mon1 | ok: [mon1] 2026-03-05 16:41:20.411948 | mon1 | 2026-03-05 16:41:20.412198 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:41:20.412437 | mon1 | Thursday 05 March 2026 16:41:20 +0000 (0:00:00.384) 0:00:02.238 ******** 2026-03-05 16:41:20.452187 | mon1 | skipping: [mon1] 2026-03-05 16:41:20.452387 | mon1 | 2026-03-05 16:41:20.452614 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:41:20.452833 | mon1 | Thursday 05 March 2026 16:41:20 +0000 (0:00:00.040) 0:00:02.279 ******** 2026-03-05 16:41:20.492399 | mon1 | skipping: [mon1] 2026-03-05 16:41:20.492666 | mon1 | 2026-03-05 16:41:20.492956 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:41:20.493279 | mon1 | Thursday 05 March 2026 16:41:20 +0000 (0:00:00.040) 0:00:02.319 ******** 2026-03-05 16:41:20.688326 | mon1 | ok: [mon1] 2026-03-05 16:41:20.688504 | mon1 | 2026-03-05 16:41:20.688733 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:41:20.688947 | mon1 | Thursday 05 March 2026 16:41:20 +0000 (0:00:00.195) 0:00:02.515 ******** 2026-03-05 16:41:21.780785 | mon1 | ok: [mon1] 2026-03-05 16:41:21.780977 | mon1 | 2026-03-05 16:41:21.781212 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:41:21.781429 | mon1 | Thursday 05 March 2026 16:41:21 +0000 (0:00:01.092) 0:00:03.607 ******** 2026-03-05 16:41:21.848374 | mon1 | ok: [mon1] => { 2026-03-05 16:41:21.848648 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 16:41:21.848904 | mon1 | } 2026-03-05 16:41:21.849167 | mon1 | 2026-03-05 16:41:21.849416 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:41:21.849685 | mon1 | Thursday 05 March 2026 16:41:21 +0000 (0:00:00.067) 0:00:03.675 ******** 2026-03-05 16:41:22.176150 | mon1 | ok: [mon1] 2026-03-05 16:41:22.176361 | mon1 | 2026-03-05 16:41:22.176588 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:41:22.176804 | mon1 | Thursday 05 March 2026 16:41:22 +0000 (0:00:00.327) 0:00:04.003 ******** 2026-03-05 16:41:24.355958 | mon1 | ok: [mon1] 2026-03-05 16:41:24.356026 | mon1 | 2026-03-05 16:41:24.356046 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 16:41:24.356189 | mon1 | Thursday 05 March 2026 16:41:24 +0000 (0:00:02.179) 0:00:06.182 ******** 2026-03-05 16:41:24.383942 | mon1 | skipping: [mon1] 2026-03-05 16:41:24.384309 | mon1 | 2026-03-05 16:41:24.384331 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 16:41:24.384338 | mon1 | Thursday 05 March 2026 16:41:24 +0000 (0:00:00.028) 0:00:06.211 ******** 2026-03-05 16:41:24.402959 | mon1 | skipping: [mon1] 2026-03-05 16:41:24.403045 | mon1 | 2026-03-05 16:41:24.403327 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 16:41:24.403348 | mon1 | Thursday 05 March 2026 16:41:24 +0000 (0:00:00.019) 0:00:06.230 ******** 2026-03-05 16:41:24.431291 | mon1 | skipping: [mon1] 2026-03-05 16:41:24.431381 | mon1 | 2026-03-05 16:41:24.431485 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 16:41:24.431600 | mon1 | Thursday 05 March 2026 16:41:24 +0000 (0:00:00.028) 0:00:06.258 ******** 2026-03-05 16:41:25.412029 | mon1 | ok: [mon1] 2026-03-05 16:41:25.412129 | mon1 | 2026-03-05 16:41:25.412448 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 16:41:25.412677 | mon1 | Thursday 05 March 2026 16:41:25 +0000 (0:00:00.980) 0:00:07.239 ******** 2026-03-05 16:41:25.829172 | mon1 | ok: [mon1] 2026-03-05 16:41:25.829286 | mon1 | 2026-03-05 16:41:25.829298 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 16:41:25.829410 | mon1 | Thursday 05 March 2026 16:41:25 +0000 (0:00:00.417) 0:00:07.656 ******** 2026-03-05 16:41:26.729995 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-05 16:41:26.730069 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 16:41:26.730621 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 16:41:26.730671 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 16:41:26.730678 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 16:41:26.730683 | mon1 | 2026-03-05 16:41:26.730688 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 16:41:26.730693 | mon1 | Thursday 05 March 2026 16:41:26 +0000 (0:00:00.900) 0:00:08.557 ******** 2026-03-05 16:41:27.428303 | mon1 | ok: [mon1] 2026-03-05 16:41:27.428363 | mon1 | 2026-03-05 16:41:27.428376 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 16:41:27.428387 | mon1 | Thursday 05 March 2026 16:41:27 +0000 (0:00:00.689) 0:00:09.247 ******** 2026-03-05 16:41:27.428396 | mon1 | 2026-03-05 16:41:27.428406 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 16:41:27.428416 | mon1 | Thursday 05 March 2026 16:41:27 +0000 (0:00:00.007) 0:00:09.254 ******** 2026-03-05 16:41:28.057253 | mon1 | ok: [mon1] 2026-03-05 16:41:28.058017 | mon1 | 2026-03-05 16:41:28.058087 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:41:28.058101 | mon1 | Thursday 05 March 2026 16:41:28 +0000 (0:00:00.628) 0:00:09.883 ******** 2026-03-05 16:41:28.261937 | mon1 | ok: [mon1] 2026-03-05 16:41:28.262041 | mon1 | 2026-03-05 16:41:28.262054 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:41:28.262210 | mon1 | Thursday 05 March 2026 16:41:28 +0000 (0:00:00.205) 0:00:10.089 ******** 2026-03-05 16:41:28.335087 | mon1 | ok: [mon1] => { 2026-03-05 16:41:28.335172 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 16:41:28.335236 | mon1 | } 2026-03-05 16:41:28.335556 | mon1 | 2026-03-05 16:41:28.335631 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:41:28.335638 | mon1 | Thursday 05 March 2026 16:41:28 +0000 (0:00:00.072) 0:00:10.162 ******** 2026-03-05 16:41:28.693512 | mon1 | ok: [mon1] 2026-03-05 16:41:28.693584 | mon1 | 2026-03-05 16:41:28.693780 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:41:28.693827 | mon1 | Thursday 05 March 2026 16:41:28 +0000 (0:00:00.358) 0:00:10.520 ******** 2026-03-05 16:41:31.797881 | mon1 | ok: [mon1] 2026-03-05 16:41:31.797955 | mon1 | 2026-03-05 16:41:31.798028 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 16:41:31.798143 | mon1 | Thursday 05 March 2026 16:41:31 +0000 (0:00:03.104) 0:00:13.625 ******** 2026-03-05 16:41:32.798514 | mon1 | ok: [mon1] 2026-03-05 16:41:32.798585 | mon1 | 2026-03-05 16:41:32.798777 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 16:41:32.798961 | mon1 | Thursday 05 March 2026 16:41:32 +0000 (0:00:01.000) 0:00:14.625 ******** 2026-03-05 16:41:33.068175 | mon1 | ok: [mon1] 2026-03-05 16:41:33.068243 | mon1 | 2026-03-05 16:41:33.068528 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 16:41:33.068552 | mon1 | Thursday 05 March 2026 16:41:33 +0000 (0:00:00.269) 0:00:14.895 ******** 2026-03-05 16:41:33.479889 | mon1 | ok: [mon1] 2026-03-05 16:41:33.479941 | mon1 | 2026-03-05 16:41:33.480058 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 16:41:33.480187 | mon1 | Thursday 05 March 2026 16:41:33 +0000 (0:00:00.411) 0:00:15.307 ******** 2026-03-05 16:41:34.019307 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-03-05 16:41:34.019950 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 16:41:34.020005 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 16:41:34.020017 | mon1 | 2026-03-05 16:41:34.020294 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 16:41:34.020328 | mon1 | Thursday 05 March 2026 16:41:34 +0000 (0:00:00.539) 0:00:15.846 ******** 2026-03-05 16:41:34.418597 | mon1 | ok: [mon1] 2026-03-05 16:41:34.418703 | mon1 | 2026-03-05 16:41:34.419007 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 16:41:34.419056 | mon1 | Thursday 05 March 2026 16:41:34 +0000 (0:00:00.399) 0:00:16.245 ******** 2026-03-05 16:41:34.842519 | mon1 | ok: [mon1] 2026-03-05 16:41:34.842589 | mon1 | 2026-03-05 16:41:34.842653 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 16:41:34.843037 | mon1 | Thursday 05 March 2026 16:41:34 +0000 (0:00:00.415) 0:00:16.661 ******** 2026-03-05 16:41:34.843072 | mon1 | 2026-03-05 16:41:34.843078 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 16:41:34.843082 | mon1 | Thursday 05 March 2026 16:41:34 +0000 (0:00:00.008) 0:00:16.669 ******** 2026-03-05 16:41:35.212153 | mon1 | ok: [mon1] 2026-03-05 16:41:35.212215 | mon1 | 2026-03-05 16:41:35.212533 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 16:41:35.212576 | mon1 | Thursday 05 March 2026 16:41:35 +0000 (0:00:00.369) 0:00:17.039 ******** 2026-03-05 16:41:35.255560 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 16:41:35.255643 | mon1 | 2026-03-05 16:41:35.255885 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 16:41:35.255933 | mon1 | Thursday 05 March 2026 16:41:35 +0000 (0:00:00.043) 0:00:17.082 ******** 2026-03-05 16:41:36.180899 | mon1 | ok: [mon1] 2026-03-05 16:41:36.181026 | mon1 | 2026-03-05 16:41:36.181284 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 16:41:36.181347 | mon1 | Thursday 05 March 2026 16:41:36 +0000 (0:00:00.925) 0:00:18.008 ******** 2026-03-05 16:41:36.840742 | mon1 | ok: [mon1] => (item=chronyd) 2026-03-05 16:41:36.840811 | mon1 | ok: [mon1] => (item=sshd) 2026-03-05 16:41:36.841096 | mon1 | 2026-03-05 16:41:36.841267 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 16:41:36.841274 | mon1 | Thursday 05 March 2026 16:41:36 +0000 (0:00:00.659) 0:00:18.668 ******** 2026-03-05 16:41:37.172944 | mon1 | ok: [mon1] 2026-03-05 16:41:37.173019 | mon1 | 2026-03-05 16:41:37.173330 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 16:41:37.173391 | mon1 | Thursday 05 March 2026 16:41:37 +0000 (0:00:00.331) 0:00:18.999 ******** 2026-03-05 16:41:37.364452 | mon1 | ok: [mon1] 2026-03-05 16:41:37.364563 | mon1 | 2026-03-05 16:41:37.364900 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 16:41:37.364949 | mon1 | Thursday 05 March 2026 16:41:37 +0000 (0:00:00.191) 0:00:19.191 ******** 2026-03-05 16:41:37.762898 | mon1 | ok: [mon1] 2026-03-05 16:41:37.762974 | mon1 | 2026-03-05 16:41:37.763277 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 16:41:37.763327 | mon1 | Thursday 05 March 2026 16:41:37 +0000 (0:00:00.398) 0:00:19.590 ******** 2026-03-05 16:41:38.068969 | mon1 | ok: [mon1] 2026-03-05 16:41:38.069045 | mon1 | 2026-03-05 16:41:38.069118 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 16:41:38.069249 | mon1 | Thursday 05 March 2026 16:41:38 +0000 (0:00:00.306) 0:00:19.896 ******** 2026-03-05 16:41:38.137840 | mon1 | ok: [mon1] 2026-03-05 16:41:38.137909 | mon1 | 2026-03-05 16:41:38.138097 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 16:41:38.138143 | mon1 | Thursday 05 March 2026 16:41:38 +0000 (0:00:00.068) 0:00:19.965 ******** 2026-03-05 16:41:38.357236 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 16:41:38.357301 | mon1 | 2026-03-05 16:41:38.357393 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 16:41:38.357522 | mon1 | Thursday 05 March 2026 16:41:38 +0000 (0:00:00.219) 0:00:20.184 ******** 2026-03-05 16:41:38.403145 | mon1 | ok: [mon1] 2026-03-05 16:41:38.403224 | mon1 | 2026-03-05 16:41:38.403433 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 16:41:38.403459 | mon1 | Thursday 05 March 2026 16:41:38 +0000 (0:00:00.045) 0:00:20.230 ******** 2026-03-05 16:41:38.438699 | mon1 | skipping: [mon1] 2026-03-05 16:41:38.439324 | mon1 | 2026-03-05 16:41:38.439373 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:41:38.439391 | mon1 | Thursday 05 March 2026 16:41:38 +0000 (0:00:00.035) 0:00:20.265 ******** 2026-03-05 16:41:38.510578 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 16:41:38.510611 | mon1 | 2026-03-05 16:41:38.510622 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:41:38.510632 | mon1 | Thursday 05 March 2026 16:41:38 +0000 (0:00:00.066) 0:00:20.332 ******** 2026-03-05 16:41:53.696558 | mon1 | ok: [mon1] 2026-03-05 16:41:53.696613 | mon1 | 2026-03-05 16:41:53.696696 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:41:53.696802 | mon1 | Thursday 05 March 2026 16:41:53 +0000 (0:00:15.191) 0:00:35.523 ******** 2026-03-05 16:41:53.739189 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 16:41:53.739261 | mon1 | 2026-03-05 16:41:53.739461 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:41:53.739519 | mon1 | Thursday 05 March 2026 16:41:53 +0000 (0:00:00.042) 0:00:35.566 ******** 2026-03-05 16:41:54.114611 | mon1 | ok: [mon1] 2026-03-05 16:41:54.114717 | mon1 | 2026-03-05 16:41:54.115055 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:41:54.115108 | mon1 | Thursday 05 March 2026 16:41:54 +0000 (0:00:00.375) 0:00:35.941 ******** 2026-03-05 16:42:51.448650 | mon1 | ok: [mon1] 2026-03-05 16:42:51.448708 | mon1 | 2026-03-05 16:42:51.448714 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 16:42:51.448719 | mon1 | Thursday 05 March 2026 16:42:51 +0000 (0:00:57.333) 0:01:33.275 ******** 2026-03-05 16:43:41.858624 | mon1 | ok: [mon1] 2026-03-05 16:43:41.858718 | mon1 | 2026-03-05 16:43:41.858733 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 16:43:41.858880 | mon1 | Thursday 05 March 2026 16:43:41 +0000 (0:00:50.410) 0:02:23.685 ******** 2026-03-05 16:44:26.365317 | mon1 | ok: [mon1] 2026-03-05 16:44:26.365403 | mon1 | 2026-03-05 16:44:26.365680 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:44:26.365776 | mon1 | Thursday 05 March 2026 16:44:26 +0000 (0:00:44.506) 0:03:08.192 ******** 2026-03-05 16:44:26.449808 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 16:44:26.449865 | mon1 | 2026-03-05 16:44:26.450090 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:44:26.450149 | mon1 | Thursday 05 March 2026 16:44:26 +0000 (0:00:00.084) 0:03:08.277 ******** 2026-03-05 16:44:26.491498 | mon1 | skipping: [mon1] 2026-03-05 16:44:26.491912 | mon1 | 2026-03-05 16:44:26.491942 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:44:26.491950 | mon1 | Thursday 05 March 2026 16:44:26 +0000 (0:00:00.041) 0:03:08.318 ******** 2026-03-05 16:44:26.526581 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-05 16:44:26.526643 | mon1 | skipping: [mon1] 2026-03-05 16:44:26.526912 | mon1 | 2026-03-05 16:44:26.526944 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:44:26.526950 | mon1 | Thursday 05 March 2026 16:44:26 +0000 (0:00:00.035) 0:03:08.353 ******** 2026-03-05 16:44:26.834618 | mon1 | ok: [mon1] 2026-03-05 16:44:26.834690 | mon1 | 2026-03-05 16:44:26.834941 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:44:26.835136 | mon1 | Thursday 05 March 2026 16:44:26 +0000 (0:00:00.307) 0:03:08.661 ******** 2026-03-05 16:44:33.762542 | mon1 | ok: [mon1] 2026-03-05 16:44:33.762628 | mon1 | 2026-03-05 16:44:33.762685 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 16:44:33.762769 | mon1 | Thursday 05 March 2026 16:44:33 +0000 (0:00:06.928) 0:03:15.589 ******** 2026-03-05 16:44:39.985032 | mon1 | ok: [mon1] 2026-03-05 16:44:39.985127 | mon1 | 2026-03-05 16:44:39.985143 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 16:44:39.985301 | mon1 | Thursday 05 March 2026 16:44:39 +0000 (0:00:06.222) 0:03:21.812 ******** 2026-03-05 16:44:46.201150 | mon1 | ok: [mon1] 2026-03-05 16:44:46.201252 | mon1 | 2026-03-05 16:44:46.201269 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 16:44:46.201393 | mon1 | Thursday 05 March 2026 16:44:46 +0000 (0:00:06.216) 0:03:28.028 ******** 2026-03-05 16:44:53.624898 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-05 16:44:53.624981 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-05 16:44:53.625034 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-03-05 16:44:53.625534 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-05 16:44:53.625552 | mon1 | 2026-03-05 16:44:53.625557 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 16:44:53.625562 | mon1 | 2026-03-05 16:44:53.625566 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:44:53.625570 | mon1 | Thursday 05 March 2026 16:44:53 +0000 (0:00:07.423) 0:03:35.452 ******** 2026-03-05 16:44:54.757875 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 16:44:54.757993 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 16:44:54.758624 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 16:44:54.758660 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 16:44:54.758671 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:44:54.770282 | mon1 | ok: [osd1] 2026-03-05 16:44:54.770403 | mon1 | 2026-03-05 16:44:54.770532 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:44:54.770669 | mon1 | Thursday 05 March 2026 16:44:54 +0000 (0:00:01.145) 0:03:36.597 ******** 2026-03-05 16:44:54.974530 | mon1 | ok: [osd1] 2026-03-05 16:44:54.974601 | mon1 | 2026-03-05 16:44:54.974650 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:44:54.974745 | mon1 | Thursday 05 March 2026 16:44:54 +0000 (0:00:00.204) 0:03:36.801 ******** 2026-03-05 16:44:55.013887 | mon1 | skipping: [osd1] 2026-03-05 16:44:55.013960 | mon1 | 2026-03-05 16:44:55.014010 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 16:44:55.014125 | mon1 | Thursday 05 March 2026 16:44:55 +0000 (0:00:00.039) 0:03:36.841 ******** 2026-03-05 16:44:55.214029 | mon1 | ok: [osd1] 2026-03-05 16:44:55.214084 | mon1 | 2026-03-05 16:44:55.214320 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:44:55.214373 | mon1 | Thursday 05 March 2026 16:44:55 +0000 (0:00:00.199) 0:03:37.041 ******** 2026-03-05 16:44:55.274480 | mon1 | ok: [osd1] => { 2026-03-05 16:44:55.274547 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 16:44:55.274896 | mon1 | } 2026-03-05 16:44:55.274914 | mon1 | 2026-03-05 16:44:55.274920 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:44:55.274925 | mon1 | Thursday 05 March 2026 16:44:55 +0000 (0:00:00.060) 0:03:37.101 ******** 2026-03-05 16:44:55.590649 | mon1 | ok: [osd1] 2026-03-05 16:44:55.590731 | mon1 | 2026-03-05 16:44:55.590741 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:44:55.590886 | mon1 | Thursday 05 March 2026 16:44:55 +0000 (0:00:00.316) 0:03:37.417 ******** 2026-03-05 16:44:55.626666 | mon1 | skipping: [osd1] 2026-03-05 16:44:55.626720 | mon1 | 2026-03-05 16:44:55.626951 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:44:55.626987 | mon1 | Thursday 05 March 2026 16:44:55 +0000 (0:00:00.036) 0:03:37.454 ******** 2026-03-05 16:44:55.670092 | mon1 | skipping: [osd1] 2026-03-05 16:44:55.670165 | mon1 | 2026-03-05 16:44:55.670261 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:44:55.670398 | mon1 | Thursday 05 March 2026 16:44:55 +0000 (0:00:00.043) 0:03:37.497 ******** 2026-03-05 16:44:55.870201 | mon1 | ok: [osd1] 2026-03-05 16:44:55.870294 | mon1 | 2026-03-05 16:44:55.870305 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:44:55.870364 | mon1 | Thursday 05 March 2026 16:44:55 +0000 (0:00:00.200) 0:03:37.697 ******** 2026-03-05 16:44:56.944513 | mon1 | ok: [osd1] 2026-03-05 16:44:56.944601 | mon1 | 2026-03-05 16:44:56.944615 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:44:56.944752 | mon1 | Thursday 05 March 2026 16:44:56 +0000 (0:00:01.074) 0:03:38.771 ******** 2026-03-05 16:44:57.018490 | mon1 | ok: [osd1] => { 2026-03-05 16:44:57.018634 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 16:44:57.018862 | mon1 | } 2026-03-05 16:44:57.019027 | mon1 | 2026-03-05 16:44:57.019213 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:44:57.019405 | mon1 | Thursday 05 March 2026 16:44:57 +0000 (0:00:00.073) 0:03:38.845 ******** 2026-03-05 16:44:57.373204 | mon1 | ok: [osd1] 2026-03-05 16:44:57.373258 | mon1 | 2026-03-05 16:44:57.373263 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:44:57.373268 | mon1 | Thursday 05 March 2026 16:44:57 +0000 (0:00:00.354) 0:03:39.199 ******** 2026-03-05 16:44:59.303873 | mon1 | ok: [osd1] 2026-03-05 16:44:59.303931 | mon1 | 2026-03-05 16:44:59.303939 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 16:44:59.303945 | mon1 | Thursday 05 March 2026 16:44:59 +0000 (0:00:01.930) 0:03:41.130 ******** 2026-03-05 16:44:59.333746 | mon1 | skipping: [osd1] 2026-03-05 16:44:59.333849 | mon1 | 2026-03-05 16:44:59.333966 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 16:44:59.334079 | mon1 | Thursday 05 March 2026 16:44:59 +0000 (0:00:00.030) 0:03:41.161 ******** 2026-03-05 16:44:59.370410 | mon1 | skipping: [osd1] 2026-03-05 16:44:59.370572 | mon1 | 2026-03-05 16:44:59.370740 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 16:44:59.370945 | mon1 | Thursday 05 March 2026 16:44:59 +0000 (0:00:00.036) 0:03:41.197 ******** 2026-03-05 16:44:59.396406 | mon1 | skipping: [osd1] 2026-03-05 16:44:59.396455 | mon1 | 2026-03-05 16:44:59.396679 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 16:44:59.396736 | mon1 | Thursday 05 March 2026 16:44:59 +0000 (0:00:00.025) 0:03:41.223 ******** 2026-03-05 16:45:00.413276 | mon1 | ok: [osd1] 2026-03-05 16:45:00.413362 | mon1 | 2026-03-05 16:45:00.413379 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 16:45:00.413513 | mon1 | Thursday 05 March 2026 16:45:00 +0000 (0:00:01.017) 0:03:42.240 ******** 2026-03-05 16:45:00.839255 | mon1 | ok: [osd1] 2026-03-05 16:45:00.839322 | mon1 | 2026-03-05 16:45:00.839555 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 16:45:00.839604 | mon1 | Thursday 05 March 2026 16:45:00 +0000 (0:00:00.425) 0:03:42.666 ******** 2026-03-05 16:45:01.718241 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-05 16:45:01.718360 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 16:45:01.718430 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 16:45:01.719098 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 16:45:01.719151 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 16:45:01.719159 | mon1 | 2026-03-05 16:45:01.719166 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 16:45:01.719172 | mon1 | Thursday 05 March 2026 16:45:01 +0000 (0:00:00.878) 0:03:43.545 ******** 2026-03-05 16:45:02.224670 | mon1 | ok: [osd1] 2026-03-05 16:45:02.224754 | mon1 | 2026-03-05 16:45:02.225235 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 16:45:02.225285 | mon1 | Thursday 05 March 2026 16:45:02 +0000 (0:00:00.501) 0:03:44.046 ******** 2026-03-05 16:45:02.225290 | mon1 | 2026-03-05 16:45:02.225295 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 16:45:02.225299 | mon1 | Thursday 05 March 2026 16:45:02 +0000 (0:00:00.005) 0:03:44.051 ******** 2026-03-05 16:45:02.591908 | mon1 | ok: [osd1] 2026-03-05 16:45:02.591991 | mon1 | 2026-03-05 16:45:02.592003 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:45:02.592138 | mon1 | Thursday 05 March 2026 16:45:02 +0000 (0:00:00.366) 0:03:44.418 ******** 2026-03-05 16:45:02.791711 | mon1 | ok: [osd1] 2026-03-05 16:45:02.791785 | mon1 | 2026-03-05 16:45:02.791799 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:45:02.791965 | mon1 | Thursday 05 March 2026 16:45:02 +0000 (0:00:00.199) 0:03:44.618 ******** 2026-03-05 16:45:02.855460 | mon1 | ok: [osd1] => { 2026-03-05 16:45:02.855533 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 16:45:02.855990 | mon1 | } 2026-03-05 16:45:02.856051 | mon1 | 2026-03-05 16:45:02.856060 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:45:02.856068 | mon1 | Thursday 05 March 2026 16:45:02 +0000 (0:00:00.063) 0:03:44.682 ******** 2026-03-05 16:45:03.210097 | mon1 | ok: [osd1] 2026-03-05 16:45:03.210161 | mon1 | 2026-03-05 16:45:03.210378 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:45:03.210430 | mon1 | Thursday 05 March 2026 16:45:03 +0000 (0:00:00.354) 0:03:45.037 ******** 2026-03-05 16:45:06.297067 | mon1 | ok: [osd1] 2026-03-05 16:45:06.297147 | mon1 | 2026-03-05 16:45:06.297205 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 16:45:06.297323 | mon1 | Thursday 05 March 2026 16:45:06 +0000 (0:00:03.086) 0:03:48.124 ******** 2026-03-05 16:45:07.463945 | mon1 | ok: [osd1] 2026-03-05 16:45:07.464011 | mon1 | 2026-03-05 16:45:07.464257 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 16:45:07.464278 | mon1 | Thursday 05 March 2026 16:45:07 +0000 (0:00:01.166) 0:03:49.291 ******** 2026-03-05 16:45:07.655697 | mon1 | ok: [osd1] 2026-03-05 16:45:07.655770 | mon1 | 2026-03-05 16:45:07.655869 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 16:45:07.656058 | mon1 | Thursday 05 March 2026 16:45:07 +0000 (0:00:00.191) 0:03:49.482 ******** 2026-03-05 16:45:08.075065 | mon1 | ok: [osd1] 2026-03-05 16:45:08.075141 | mon1 | 2026-03-05 16:45:08.075197 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 16:45:08.075332 | mon1 | Thursday 05 March 2026 16:45:08 +0000 (0:00:00.419) 0:03:49.902 ******** 2026-03-05 16:45:08.634290 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-03-05 16:45:08.635007 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 16:45:08.635057 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 16:45:08.635065 | mon1 | 2026-03-05 16:45:08.635071 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 16:45:08.635089 | mon1 | Thursday 05 March 2026 16:45:08 +0000 (0:00:00.559) 0:03:50.461 ******** 2026-03-05 16:45:09.044007 | mon1 | ok: [osd1] 2026-03-05 16:45:09.044087 | mon1 | 2026-03-05 16:45:09.044250 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 16:45:09.044389 | mon1 | Thursday 05 March 2026 16:45:09 +0000 (0:00:00.409) 0:03:50.871 ******** 2026-03-05 16:45:09.494712 | mon1 | ok: [osd1] 2026-03-05 16:45:09.494783 | mon1 | 2026-03-05 16:45:09.494788 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 16:45:09.494793 | mon1 | Thursday 05 March 2026 16:45:09 +0000 (0:00:00.443) 0:03:51.315 ******** 2026-03-05 16:45:09.494797 | mon1 | 2026-03-05 16:45:09.494801 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 16:45:09.494805 | mon1 | Thursday 05 March 2026 16:45:09 +0000 (0:00:00.006) 0:03:51.321 ******** 2026-03-05 16:45:09.846608 | mon1 | ok: [osd1] 2026-03-05 16:45:09.846657 | mon1 | 2026-03-05 16:45:09.846662 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 16:45:09.846668 | mon1 | Thursday 05 March 2026 16:45:09 +0000 (0:00:00.351) 0:03:51.673 ******** 2026-03-05 16:45:09.891760 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 16:45:09.891844 | mon1 | 2026-03-05 16:45:09.891879 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 16:45:09.892019 | mon1 | Thursday 05 March 2026 16:45:09 +0000 (0:00:00.045) 0:03:51.718 ******** 2026-03-05 16:45:10.922128 | mon1 | ok: [osd1] 2026-03-05 16:45:10.922206 | mon1 | 2026-03-05 16:45:10.922579 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 16:45:10.922605 | mon1 | Thursday 05 March 2026 16:45:10 +0000 (0:00:01.030) 0:03:52.749 ******** 2026-03-05 16:45:11.580055 | mon1 | ok: [osd1] => (item=chronyd) 2026-03-05 16:45:11.580128 | mon1 | ok: [osd1] => (item=sshd) 2026-03-05 16:45:11.580140 | mon1 | 2026-03-05 16:45:11.580310 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 16:45:11.580326 | mon1 | Thursday 05 March 2026 16:45:11 +0000 (0:00:00.658) 0:03:53.407 ******** 2026-03-05 16:45:11.870721 | mon1 | ok: [osd1] 2026-03-05 16:45:11.870787 | mon1 | 2026-03-05 16:45:11.871091 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 16:45:11.871112 | mon1 | Thursday 05 March 2026 16:45:11 +0000 (0:00:00.290) 0:03:53.697 ******** 2026-03-05 16:45:12.072454 | mon1 | ok: [osd1] 2026-03-05 16:45:12.072529 | mon1 | 2026-03-05 16:45:12.072769 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 16:45:12.072790 | mon1 | Thursday 05 March 2026 16:45:12 +0000 (0:00:00.201) 0:03:53.899 ******** 2026-03-05 16:45:12.302244 | mon1 | ok: [osd1] 2026-03-05 16:45:12.302312 | mon1 | 2026-03-05 16:45:12.302379 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 16:45:12.302472 | mon1 | Thursday 05 March 2026 16:45:12 +0000 (0:00:00.230) 0:03:54.129 ******** 2026-03-05 16:45:12.489182 | mon1 | ok: [osd1] 2026-03-05 16:45:12.489270 | mon1 | 2026-03-05 16:45:12.489292 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 16:45:12.489436 | mon1 | Thursday 05 March 2026 16:45:12 +0000 (0:00:00.186) 0:03:54.316 ******** 2026-03-05 16:45:12.699185 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-05 16:45:12.699261 | mon1 | 2026-03-05 16:45:12.699462 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 16:45:12.699517 | mon1 | Thursday 05 March 2026 16:45:12 +0000 (0:00:00.209) 0:03:54.526 ******** 2026-03-05 16:45:12.741910 | mon1 | ok: [osd1] 2026-03-05 16:45:12.741993 | mon1 | 2026-03-05 16:45:12.742273 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:45:12.742330 | mon1 | Thursday 05 March 2026 16:45:12 +0000 (0:00:00.042) 0:03:54.569 ******** 2026-03-05 16:45:12.797870 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-05 16:45:12.797966 | mon1 | 2026-03-05 16:45:12.797980 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:45:12.798131 | mon1 | Thursday 05 March 2026 16:45:12 +0000 (0:00:00.056) 0:03:54.625 ******** 2026-03-05 16:45:19.491451 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:45:19.491545 | mon1 | 2026-03-05 16:45:19.491554 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:45:19.491561 | mon1 | Thursday 05 March 2026 16:45:19 +0000 (0:00:06.692) 0:04:01.317 ******** 2026-03-05 16:45:19.541475 | mon1 | ok: [osd1] => (item=osd1) 2026-03-05 16:45:19.541521 | mon1 | 2026-03-05 16:45:19.541527 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:45:19.541532 | mon1 | Thursday 05 March 2026 16:45:19 +0000 (0:00:00.050) 0:04:01.368 ******** 2026-03-05 16:45:19.807368 | mon1 | ok: [osd1] 2026-03-05 16:45:19.807448 | mon1 | 2026-03-05 16:45:19.807455 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:45:19.807460 | mon1 | Thursday 05 March 2026 16:45:19 +0000 (0:00:00.265) 0:04:01.633 ******** 2026-03-05 16:45:26.829453 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:45:26.829531 | mon1 | 2026-03-05 16:45:26.829604 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 16:45:26.829694 | mon1 | Thursday 05 March 2026 16:45:26 +0000 (0:00:07.022) 0:04:08.656 ******** 2026-03-05 16:45:32.207046 | mon1 | ok: [osd1] 2026-03-05 16:45:32.207145 | mon1 | 2026-03-05 16:45:32.207160 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 16:45:32.207219 | mon1 | Thursday 05 March 2026 16:45:32 +0000 (0:00:05.377) 0:04:14.034 ******** 2026-03-05 16:45:56.191411 | mon1 | ok: [osd1] 2026-03-05 16:45:56.191511 | mon1 | 2026-03-05 16:45:56.191712 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 16:45:56.191766 | mon1 | Thursday 05 March 2026 16:45:56 +0000 (0:00:23.984) 0:04:38.018 ******** 2026-03-05 16:45:56.251113 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-03-05 16:45:56.251205 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-03-05 16:45:56.251212 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-03-05 16:45:56.251391 | mon1 | skipping: [osd1] 2026-03-05 16:45:56.251494 | mon1 | 2026-03-05 16:45:56.251527 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 16:45:56.251659 | mon1 | Thursday 05 March 2026 16:45:56 +0000 (0:00:00.059) 0:04:38.077 ******** 2026-03-05 16:46:04.380107 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:46:04.380185 | mon1 | 2026-03-05 16:46:04.380405 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 16:46:04.380476 | mon1 | Thursday 05 March 2026 16:46:04 +0000 (0:00:08.128) 0:04:46.206 ******** 2026-03-05 16:46:12.009766 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:46:12.009865 | mon1 | 2026-03-05 16:46:12.009879 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 16:46:12.010035 | mon1 | Thursday 05 March 2026 16:46:12 +0000 (0:00:07.630) 0:04:53.837 ******** 2026-03-05 16:46:12.067870 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-05 16:46:12.067969 | mon1 | 2026-03-05 16:46:12.068243 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 16:46:12.068346 | mon1 | Thursday 05 March 2026 16:46:12 +0000 (0:00:00.057) 0:04:53.894 ******** 2026-03-05 16:46:12.105317 | mon1 | ok: [osd1] 2026-03-05 16:46:12.105634 | mon1 | 2026-03-05 16:46:12.105693 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 16:46:12.105698 | mon1 | Thursday 05 March 2026 16:46:12 +0000 (0:00:00.037) 0:04:53.932 ******** 2026-03-05 16:46:18.470036 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:46:18.470121 | mon1 | 2026-03-05 16:46:18.470476 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 16:46:18.470530 | mon1 | Thursday 05 March 2026 16:46:18 +0000 (0:00:06.364) 0:05:00.297 ******** 2026-03-05 16:46:18.513529 | mon1 | ok: [osd1] 2026-03-05 16:46:18.513607 | mon1 | 2026-03-05 16:46:18.513836 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 16:46:18.513894 | mon1 | Thursday 05 March 2026 16:46:18 +0000 (0:00:00.043) 0:05:00.340 ******** 2026-03-05 16:46:18.556500 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 16:46:18.556624 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 16:46:18.557243 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 16:46:18.557271 | mon1 | skipping: [osd1] 2026-03-05 16:46:18.557278 | mon1 | 2026-03-05 16:46:18.557284 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 16:46:18.557291 | mon1 | Thursday 05 March 2026 16:46:18 +0000 (0:00:00.043) 0:05:00.383 ******** 2026-03-05 16:46:18.584043 | mon1 | skipping: [osd1] 2026-03-05 16:46:18.584156 | mon1 | 2026-03-05 16:46:18.586776 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 16:46:18.587020 | mon1 | mon1 : ok=49 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-05 16:46:18.587026 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-05 16:46:18.587031 | mon1 | 2026-03-05 16:46:18.587035 | mon1 | 2026-03-05 16:46:18.587039 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 16:46:18.587043 | mon1 | Thursday 05 March 2026 16:46:18 +0000 (0:00:00.027) 0:05:00.411 ******** 2026-03-05 16:46:18.587054 | mon1 | =============================================================================== 2026-03-05 16:46:18.587058 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 57.33s 2026-03-05 16:46:18.587062 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 50.41s 2026-03-05 16:46:18.587066 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 44.51s 2026-03-05 16:46:18.587070 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 23.98s 2026-03-05 16:46:18.587074 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ----- 15.19s 2026-03-05 16:46:18.587078 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 8.13s 2026-03-05 16:46:18.587082 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 7.63s 2026-03-05 16:46:18.587085 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.42s 2026-03-05 16:46:18.587089 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.02s 2026-03-05 16:46:18.587093 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.93s 2026-03-05 16:46:18.587097 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.69s 2026-03-05 16:46:18.587101 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.36s 2026-03-05 16:46:18.587105 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.22s 2026-03-05 16:46:18.587109 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.22s 2026-03-05 16:46:18.587112 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.38s 2026-03-05 16:46:18.587116 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.10s 2026-03-05 16:46:18.587120 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.09s 2026-03-05 16:46:18.587124 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.18s 2026-03-05 16:46:18.587128 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.93s 2026-03-05 16:46:18.587132 | mon1 | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.17s 2026-03-05 16:46:18.678512 | mon1 | INFO [default > idempotence] Executed: Successful 2026-03-05 16:46:18.688055 | mon1 | INFO [default > side_effect] Executing 2026-03-05 16:46:18.688605 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 16:46:18.694977 | mon1 | INFO [default > verify] Executing 2026-03-05 16:46:19.320888 | mon1 | 2026-03-05 16:46:19.321286 | mon1 | PLAY [Verify] ****************************************************************** 2026-03-05 16:46:19.321557 | mon1 | 2026-03-05 16:46:19.321838 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:46:19.322117 | mon1 | Thursday 05 March 2026 16:46:19 +0000 (0:00:00.007) 0:00:00.007 ******** 2026-03-05 16:46:20.534385 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 16:46:20.534455 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 16:46:20.534467 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 16:46:20.534477 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 16:46:20.534486 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:46:20.547978 | mon1 | ok: [mon1] 2026-03-05 16:46:20.548054 | mon1 | 2026-03-05 16:46:20.548075 | mon1 | TASK [Get cluster health status] *********************************************** 2026-03-05 16:46:20.548219 | mon1 | Thursday 05 March 2026 16:46:20 +0000 (0:00:01.226) 0:00:01.234 ******** 2026-03-05 16:46:30.829695 | mon1 | ok: [mon1] 2026-03-05 16:46:30.829909 | mon1 | 2026-03-05 16:46:30.830152 | mon1 | TASK [Print cluster health status] ********************************************* 2026-03-05 16:46:30.830385 | mon1 | Thursday 05 March 2026 16:46:30 +0000 (0:00:10.281) 0:00:11.516 ******** 2026-03-05 16:46:30.857921 | mon1 | ok: [mon1] => { 2026-03-05 16:46:30.858176 | mon1 | "_ceph_health": { 2026-03-05 16:46:30.858389 | mon1 | "changed": false, 2026-03-05 16:46:30.858601 | mon1 | "cmd": [ 2026-03-05 16:46:30.858812 | mon1 | "cephadm", 2026-03-05 16:46:30.859017 | mon1 | "shell", 2026-03-05 16:46:30.859222 | mon1 | "--", 2026-03-05 16:46:30.859426 | mon1 | "ceph", 2026-03-05 16:46:30.859628 | mon1 | "health" 2026-03-05 16:46:30.859837 | mon1 | ], 2026-03-05 16:46:30.860101 | mon1 | "delta": "0:00:09.997227", 2026-03-05 16:46:30.860355 | mon1 | "end": "2026-03-05 16:46:30.795369", 2026-03-05 16:46:30.860528 | mon1 | "failed": false, 2026-03-05 16:46:30.860645 | mon1 | "msg": "", 2026-03-05 16:46:30.860761 | mon1 | "rc": 0, 2026-03-05 16:46:30.860890 | mon1 | "start": "2026-03-05 16:46:20.798142", 2026-03-05 16:46:30.861026 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-03-05 16:46:30.861141 | mon1 | "stderr_lines": [ 2026-03-05 16:46:30.861263 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-05 16:46:30.861397 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-03-05 16:46:30.861515 | mon1 | ], 2026-03-05 16:46:30.861639 | mon1 | "stdout": "HEALTH_OK", 2026-03-05 16:46:30.861759 | mon1 | "stdout_lines": [ 2026-03-05 16:46:30.861882 | mon1 | "HEALTH_OK" 2026-03-05 16:46:30.861993 | mon1 | ] 2026-03-05 16:46:30.862107 | mon1 | } 2026-03-05 16:46:30.862225 | mon1 | } 2026-03-05 16:46:30.862338 | mon1 | 2026-03-05 16:46:30.862465 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-05 16:46:30.862589 | mon1 | Thursday 05 March 2026 16:46:30 +0000 (0:00:00.028) 0:00:11.544 ******** 2026-03-05 16:46:30.882799 | mon1 | ok: [mon1] => { 2026-03-05 16:46:30.882997 | mon1 | "changed": false, 2026-03-05 16:46:30.883192 | mon1 | "msg": "All assertions passed" 2026-03-05 16:46:30.883378 | mon1 | } 2026-03-05 16:46:30.883558 | mon1 | 2026-03-05 16:46:30.883754 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-03-05 16:46:30.883997 | mon1 | Thursday 05 March 2026 16:46:30 +0000 (0:00:00.025) 0:00:11.569 ******** 2026-03-05 16:46:37.770410 | mon1 | changed: [mon1] 2026-03-05 16:46:37.770541 | mon1 | 2026-03-05 16:46:37.770758 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-03-05 16:46:37.770950 | mon1 | Thursday 05 March 2026 16:46:37 +0000 (0:00:06.887) 0:00:18.457 ******** 2026-03-05 16:46:41.807171 | mon1 | changed: [mon1] 2026-03-05 16:46:41.807283 | mon1 | 2026-03-05 16:46:41.807394 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-05 16:46:41.807499 | mon1 | Thursday 05 March 2026 16:46:41 +0000 (0:00:04.024) 0:00:22.482 ******** 2026-03-05 16:46:43.193454 | mon1 | ok: [mon1] 2026-03-05 16:46:43.193629 | mon1 | 2026-03-05 16:46:43.193842 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-03-05 16:46:43.194050 | mon1 | Thursday 05 March 2026 16:46:43 +0000 (0:00:01.397) 0:00:23.880 ******** 2026-03-05 16:46:43.225661 | mon1 | ok: [mon1] => { 2026-03-05 16:46:43.225858 | mon1 | "changed": false, 2026-03-05 16:46:43.226074 | mon1 | "msg": "All assertions passed" 2026-03-05 16:46:43.226304 | mon1 | } 2026-03-05 16:46:43.226505 | mon1 | 2026-03-05 16:46:43.226715 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 16:46:43.226971 | mon1 | mon1 : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 16:46:43.227169 | mon1 | 2026-03-05 16:46:43.227361 | mon1 | 2026-03-05 16:46:43.227608 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 16:46:43.227846 | mon1 | Thursday 05 March 2026 16:46:43 +0000 (0:00:00.032) 0:00:23.913 ******** 2026-03-05 16:46:43.228077 | mon1 | =============================================================================== 2026-03-05 16:46:43.228287 | mon1 | Get cluster health status ---------------------------------------------- 10.28s 2026-03-05 16:46:43.228662 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.89s 2026-03-05 16:46:43.228871 | mon1 | Create a test Ceph key -------------------------------------------------- 4.03s 2026-03-05 16:46:43.229078 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.40s 2026-03-05 16:46:43.229287 | mon1 | Gathering Facts --------------------------------------------------------- 1.23s 2026-03-05 16:46:43.229499 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.03s 2026-03-05 16:46:43.229706 | mon1 | Print cluster health status --------------------------------------------- 0.03s 2026-03-05 16:46:43.229911 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-03-05 16:46:43.292316 | mon1 | INFO [default > verify] Executed: Successful 2026-03-05 16:46:43.305192 | mon1 | INFO [default > cleanup] Executing 2026-03-05 16:46:43.305546 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 16:46:43.310957 | mon1 | INFO [default > destroy] Executing 2026-03-05 16:46:43.311012 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 16:46:43.311092 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-05 16:46:43.311422 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-05 16:46:43.907431 | mon1 | ok: Runtime: 0:14:29.152390 2026-03-05 16:46:43.921828 | 2026-03-05 16:46:43.921889 | PLAY RECAP 2026-03-05 16:46:43.921935 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 16:46:43.921970 | 2026-03-05 16:46:44.021281 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 16:46:44.027406 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 16:46:44.581705 | 2026-03-05 16:46:44.581821 | PLAY [all] 2026-03-05 16:46:44.593351 | 2026-03-05 16:46:44.593434 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-05 16:46:44.639985 | mon1 | ok 2026-03-05 16:46:44.645000 | osd1 | ok 2026-03-05 16:46:44.650034 | 2026-03-05 16:46:44.650139 | TASK [fetch-output : Set log path for single node] 2026-03-05 16:46:44.673382 | mon1 | skipping: Conditional result was False 2026-03-05 16:46:44.684662 | osd1 | skipping: Conditional result was False 2026-03-05 16:46:44.693059 | 2026-03-05 16:46:44.693170 | LOOP [fetch-output : Ensure local output dirs] 2026-03-05 16:46:45.042628 | mon1 -> localhost | changed: "/var/lib/zuul/builds/1a70a4f17492419fa77adeca1cad362a/work/logs/mon1" 2026-03-05 16:46:45.050832 | osd1 -> localhost | changed: "/var/lib/zuul/builds/1a70a4f17492419fa77adeca1cad362a/work/logs/osd1" 2026-03-05 16:46:45.234688 | mon1 -> localhost | changed: "/var/lib/zuul/builds/1a70a4f17492419fa77adeca1cad362a/work/artifacts" 2026-03-05 16:46:45.245751 | osd1 -> localhost | ok: "/var/lib/zuul/builds/1a70a4f17492419fa77adeca1cad362a/work/artifacts" 2026-03-05 16:46:45.443708 | mon1 -> localhost | changed: "/var/lib/zuul/builds/1a70a4f17492419fa77adeca1cad362a/work/docs" 2026-03-05 16:46:45.461370 | osd1 -> localhost | ok: "/var/lib/zuul/builds/1a70a4f17492419fa77adeca1cad362a/work/docs" 2026-03-05 16:46:45.461488 | osd1 -> localhost | changed: All items complete 2026-03-05 16:46:45.461547 | 2026-03-05 16:46:45.477204 | 2026-03-05 16:46:45.477320 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-05 16:46:46.061861 | mon1 | changed: .d..t...... ./ 2026-03-05 16:46:46.066327 | osd1 | changed: .d..t...... ./ 2026-03-05 16:46:46.519077 | osd1 | changed: .d..t...... ./ 2026-03-05 16:46:46.527758 | mon1 | changed: .d..t...... ./ 2026-03-05 16:46:46.967747 | mon1 | changed: .d..t...... ./ 2026-03-05 16:46:46.980565 | osd1 | changed: .d..t...... ./ 2026-03-05 16:46:47.005123 | 2026-03-05 16:46:47.005363 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-05 16:46:47.459597 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.006472 2026-03-05 16:46:47.459827 | mon1 -> localhost | changed: All items complete 2026-03-05 16:46:47.459858 | 2026-03-05 16:46:47.674290 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.006889 2026-03-05 16:46:47.700197 | 2026-03-05 16:46:47.700330 | PLAY [all] 2026-03-05 16:46:47.707120 | 2026-03-05 16:46:47.707202 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-05 16:46:48.094511 | mon1 | changed 2026-03-05 16:46:48.337969 | osd1 | changed 2026-03-05 16:46:48.350247 | 2026-03-05 16:46:48.350363 | PLAY RECAP 2026-03-05 16:46:48.350415 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 16:46:48.350485 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 16:46:48.350509 | 2026-03-05 16:46:48.469193 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 16:46:48.474317 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-05 16:46:49.010831 | 2026-03-05 16:46:49.010936 | PLAY [localhost] 2026-03-05 16:46:49.020133 | 2026-03-05 16:46:49.020202 | TASK [Generate Zuul manifest] 2026-03-05 16:46:49.039132 | localhost | ok 2026-03-05 16:46:49.054410 | 2026-03-05 16:46:49.054483 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-05 16:46:49.358595 | localhost | changed 2026-03-05 16:46:49.368454 | 2026-03-05 16:46:49.368519 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-05 16:46:49.398612 | localhost | ok 2026-03-05 16:46:49.405338 | 2026-03-05 16:46:49.405398 | TASK [Upload logs] 2026-03-05 16:46:49.428190 | localhost | ok 2026-03-05 16:46:49.483002 | 2026-03-05 16:46:49.483123 | TASK [Set zuul-log-path fact] 2026-03-05 16:46:49.503680 | localhost | ok 2026-03-05 16:46:49.516457 | 2026-03-05 16:46:49.516521 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 16:46:49.547241 | localhost | ok 2026-03-05 16:46:49.554186 | 2026-03-05 16:46:49.554249 | TASK [upload-logs : Create log directories] 2026-03-05 16:46:49.949754 | localhost | changed 2026-03-05 16:46:49.954176 | 2026-03-05 16:46:49.954240 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-05 16:46:50.358615 | localhost -> localhost | ok: Runtime: 0:00:00.006383 2026-03-05 16:46:50.363984 | 2026-03-05 16:46:50.364050 | TASK [upload-logs : Upload logs to log server] 2026-03-05 16:46:50.807166 | localhost | Output suppressed because no_log was given 2026-03-05 16:46:50.812839 | 2026-03-05 16:46:50.812920 | LOOP [upload-logs : Compress console log and json output] 2026-03-05 16:46:50.853500 | localhost | skipping: Conditional result was False 2026-03-05 16:46:50.860898 | localhost | skipping: Conditional result was False 2026-03-05 16:46:50.876406 | 2026-03-05 16:46:50.876618 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-05 16:46:50.914984 | localhost | skipping: Conditional result was False 2026-03-05 16:46:50.915317 | 2026-03-05 16:46:50.919333 | localhost | skipping: Conditional result was False 2026-03-05 16:46:50.932593 | 2026-03-05 16:46:50.932900 | LOOP [upload-logs : Upload console log and json output]