2026-08-18 11:40:20.358787 | Job console starting 2026-08-18 11:40:20.380728 | Updating git repos 2026-08-18 11:40:20.408560 | Cloning repos into workspace 2026-08-18 11:40:20.558242 | Restoring repo states 2026-08-18 11:40:20.564850 | Merging changes 2026-08-18 11:40:20.952530 | Checking out repos 2026-08-18 11:40:21.005090 | Preparing playbooks 2026-08-18 11:40:21.932145 | Running Ansible setup 2026-08-18 11:40:30.502392 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-18 11:40:31.168479 | 2026-08-18 11:40:31.168846 | PLAY [localhost] 2026-08-18 11:40:31.177617 | 2026-08-18 11:40:31.177745 | TASK [Gathering Facts] 2026-08-18 11:40:32.178497 | localhost | ok 2026-08-18 11:40:32.188395 | 2026-08-18 11:40:32.188478 | TASK [Setup log path fact] 2026-08-18 11:40:32.207422 | localhost | ok 2026-08-18 11:40:32.219969 | 2026-08-18 11:40:32.220043 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-18 11:40:32.251517 | localhost | ok 2026-08-18 11:40:32.258714 | 2026-08-18 11:40:32.258783 | TASK [emit-job-header : Print job information] 2026-08-18 11:40:32.301342 | # Job Information 2026-08-18 11:40:32.301546 | Ansible Version: 2.16.18 2026-08-18 11:40:32.301618 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble 2026-08-18 11:40:32.301655 | Pipeline: check 2026-08-18 11:40:32.301685 | Executor: 2d72f0692154 2026-08-18 11:40:32.301712 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/123 2026-08-18 11:40:32.301744 | Event ID: 10edcc30-9af9-11f1-8cfe-0e8dec461e98 2026-08-18 11:40:32.305520 | 2026-08-18 11:40:32.305643 | LOOP [emit-job-header : Print node information] 2026-08-18 11:40:32.428117 | localhost | ok: 2026-08-18 11:40:32.428454 | localhost | # Node Information 2026-08-18 11:40:32.428521 | localhost | Inventory Hostname: mon1 2026-08-18 11:40:32.428571 | localhost | Hostname: np0000189972 2026-08-18 11:40:32.428616 | localhost | Username: zuul 2026-08-18 11:40:32.428667 | localhost | Distro: Ubuntu 24.04 2026-08-18 11:40:32.428712 | localhost | Provider: yul1 2026-08-18 11:40:32.428755 | localhost | Region: ca-ymq-1 2026-08-18 11:40:32.428797 | localhost | Label: ubuntu-noble 2026-08-18 11:40:32.428839 | localhost | Product Name: OpenStack Nova 2026-08-18 11:40:32.428881 | localhost | Interface IP: 199.19.213.137 2026-08-18 11:40:32.495033 | localhost | ok: 2026-08-18 11:40:32.495136 | localhost | # Node Information 2026-08-18 11:40:32.495173 | localhost | Inventory Hostname: mon2 2026-08-18 11:40:32.495203 | localhost | Hostname: np0000189973 2026-08-18 11:40:32.495231 | localhost | Username: zuul 2026-08-18 11:40:32.495257 | localhost | Distro: Ubuntu 24.04 2026-08-18 11:40:32.495283 | localhost | Provider: yul1 2026-08-18 11:40:32.495308 | localhost | Region: ca-ymq-1 2026-08-18 11:40:32.495334 | localhost | Label: ubuntu-noble 2026-08-18 11:40:32.495358 | localhost | Product Name: OpenStack Nova 2026-08-18 11:40:32.495384 | localhost | Interface IP: 199.19.213.229 2026-08-18 11:40:32.595861 | localhost | ok: 2026-08-18 11:40:32.596067 | localhost | # Node Information 2026-08-18 11:40:32.596158 | localhost | Inventory Hostname: mon3 2026-08-18 11:40:32.596213 | localhost | Hostname: np0000189974 2026-08-18 11:40:32.596261 | localhost | Username: zuul 2026-08-18 11:40:32.596307 | localhost | Distro: Ubuntu 24.04 2026-08-18 11:40:32.596351 | localhost | Provider: yul1 2026-08-18 11:40:32.596401 | localhost | Region: ca-ymq-1 2026-08-18 11:40:32.596461 | localhost | Label: ubuntu-noble 2026-08-18 11:40:32.596507 | localhost | Product Name: OpenStack Nova 2026-08-18 11:40:32.596551 | localhost | Interface IP: 199.19.213.76 2026-08-18 11:40:32.646934 | localhost | ok: 2026-08-18 11:40:32.647054 | localhost | # Node Information 2026-08-18 11:40:32.647124 | localhost | Inventory Hostname: osd1 2026-08-18 11:40:32.647173 | localhost | Hostname: np0000189975 2026-08-18 11:40:32.647217 | localhost | Username: zuul 2026-08-18 11:40:32.647260 | localhost | Distro: Ubuntu 24.04 2026-08-18 11:40:32.647303 | localhost | Provider: yul1 2026-08-18 11:40:32.647345 | localhost | Region: ca-ymq-1 2026-08-18 11:40:32.647412 | localhost | Label: ubuntu-noble 2026-08-18 11:40:32.647457 | localhost | Product Name: OpenStack Nova 2026-08-18 11:40:32.647504 | localhost | Interface IP: 199.19.213.180 2026-08-18 11:40:32.662377 | 2026-08-18 11:40:32.662548 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-08-18 11:40:33.117779 | localhost -> localhost | changed 2026-08-18 11:40:33.127553 | 2026-08-18 11:40:33.127646 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-08-18 11:40:34.456724 | localhost -> localhost | changed 2026-08-18 11:40:34.466174 | 2026-08-18 11:40:34.466246 | PLAY [all] 2026-08-18 11:40:34.476799 | 2026-08-18 11:40:34.476867 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-08-18 11:40:34.703453 | mon1 -> localhost | ok 2026-08-18 11:40:34.714708 | 2026-08-18 11:40:34.714786 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-08-18 11:40:34.748163 | mon1 | ok 2026-08-18 11:40:34.765826 | mon2 | ok 2026-08-18 11:40:34.771388 | mon3 | ok 2026-08-18 11:40:34.789749 | osd1 | ok 2026-08-18 11:40:34.818744 | mon1 | included: /var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 11:40:34.818829 | mon2 | included: /var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 11:40:34.818854 | mon3 | included: /var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 11:40:34.818873 | osd1 | included: /var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 11:40:34.825951 | 2026-08-18 11:40:34.826015 | TASK [add-build-sshkey : Create Temp SSH key] 2026-08-18 11:40:35.786005 | mon1 -> localhost | Generating public/private rsa key pair. 2026-08-18 11:40:35.786189 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/work/7ff0072a72df4252a41fe8fd3fc44262_id_rsa 2026-08-18 11:40:35.786220 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/work/7ff0072a72df4252a41fe8fd3fc44262_id_rsa.pub 2026-08-18 11:40:35.786243 | mon1 -> localhost | The key fingerprint is: 2026-08-18 11:40:35.786265 | mon1 -> localhost | SHA256:rFuRo4X4dFy2II2CBvtsVXnA627c+LF/UBeTbuU4f3g zuul-build-sshkey 2026-08-18 11:40:35.786286 | mon1 -> localhost | The key's randomart image is: 2026-08-18 11:40:35.786306 | mon1 -> localhost | +---[RSA 3072]----+ 2026-08-18 11:40:35.786325 | mon1 -> localhost | |. .oo . | 2026-08-18 11:40:35.786346 | mon1 -> localhost | | o . .oo. + .| 2026-08-18 11:40:35.786366 | mon1 -> localhost | |. o o ooo o . * | 2026-08-18 11:40:35.786386 | mon1 -> localhost | | + . o.= = .. * .| 2026-08-18 11:40:35.786405 | mon1 -> localhost | | + ..o S .. o + | 2026-08-18 11:40:35.786424 | mon1 -> localhost | | . o.= o. . E| 2026-08-18 11:40:35.786446 | mon1 -> localhost | | o+oo . ..| 2026-08-18 11:40:35.786474 | mon1 -> localhost | | =o.o . | 2026-08-18 11:40:35.786500 | mon1 -> localhost | | ...o... | 2026-08-18 11:40:35.786527 | mon1 -> localhost | +----[SHA256]-----+ 2026-08-18 11:40:35.786579 | mon1 -> localhost | ok: Runtime: 0:00:00.547924 2026-08-18 11:40:35.792480 | 2026-08-18 11:40:35.792557 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-08-18 11:40:35.846816 | mon1 | ok 2026-08-18 11:40:35.863813 | mon2 | ok 2026-08-18 11:40:35.870322 | mon3 | ok 2026-08-18 11:40:35.874700 | osd1 | ok 2026-08-18 11:40:35.952026 | mon1 | included: /var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 11:40:35.952162 | mon2 | included: /var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 11:40:35.952188 | mon3 | included: /var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 11:40:35.952208 | osd1 | included: /var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 11:40:35.967792 | 2026-08-18 11:40:35.967854 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-08-18 11:40:36.002815 | mon1 | skipping: Conditional result was False 2026-08-18 11:40:36.018413 | mon2 | skipping: Conditional result was False 2026-08-18 11:40:36.021356 | mon3 | skipping: Conditional result was False 2026-08-18 11:40:36.041932 | osd1 | skipping: Conditional result was False 2026-08-18 11:40:36.053683 | 2026-08-18 11:40:36.053750 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-08-18 11:40:36.550711 | mon2 | changed 2026-08-18 11:40:36.559843 | mon1 | changed 2026-08-18 11:40:36.575720 | mon3 | changed 2026-08-18 11:40:36.582615 | osd1 | changed 2026-08-18 11:40:36.589263 | 2026-08-18 11:40:36.589326 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-08-18 11:40:36.819129 | mon1 | ok 2026-08-18 11:40:36.860424 | mon3 | ok 2026-08-18 11:40:36.868372 | mon2 | ok 2026-08-18 11:40:36.873333 | osd1 | ok 2026-08-18 11:40:36.878716 | 2026-08-18 11:40:36.878780 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-08-18 11:40:37.464808 | mon1 | changed 2026-08-18 11:40:37.471540 | mon2 | changed 2026-08-18 11:40:37.476720 | mon3 | changed 2026-08-18 11:40:37.526074 | osd1 | changed 2026-08-18 11:40:37.533073 | 2026-08-18 11:40:37.533148 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-08-18 11:40:38.117691 | mon1 | changed 2026-08-18 11:40:38.124697 | mon2 | changed 2026-08-18 11:40:38.131446 | mon3 | changed 2026-08-18 11:40:38.136503 | osd1 | changed 2026-08-18 11:40:38.142315 | 2026-08-18 11:40:38.142384 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-08-18 11:40:38.180816 | mon1 | skipping: Conditional result was False 2026-08-18 11:40:38.197042 | mon2 | skipping: Conditional result was False 2026-08-18 11:40:38.208858 | mon3 | skipping: Conditional result was False 2026-08-18 11:40:38.219628 | osd1 | skipping: Conditional result was False 2026-08-18 11:40:38.232313 | 2026-08-18 11:40:38.232406 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-08-18 11:40:38.634609 | mon1 -> localhost | changed 2026-08-18 11:40:38.666688 | 2026-08-18 11:40:38.666791 | TASK [add-build-sshkey : Add back temp key] 2026-08-18 11:40:38.957358 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/work/7ff0072a72df4252a41fe8fd3fc44262_id_rsa (zuul-build-sshkey) 2026-08-18 11:40:38.957640 | mon1 -> localhost | ok: Runtime: 0:00:00.014924 2026-08-18 11:40:38.963579 | 2026-08-18 11:40:38.963646 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-08-18 11:40:39.324901 | mon3 | ok 2026-08-18 11:40:39.333008 | mon1 | ok 2026-08-18 11:40:39.338257 | osd1 | ok 2026-08-18 11:40:39.343368 | mon2 | ok 2026-08-18 11:40:39.349168 | 2026-08-18 11:40:39.349243 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-08-18 11:40:39.391555 | mon1 | skipping: Conditional result was False 2026-08-18 11:40:39.472684 | mon2 | skipping: Conditional result was False 2026-08-18 11:40:39.474010 | mon3 | skipping: Conditional result was False 2026-08-18 11:40:39.494635 | osd1 | skipping: Conditional result was False 2026-08-18 11:40:39.527439 | 2026-08-18 11:40:39.527548 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-08-18 11:40:39.853072 | mon1 | ok 2026-08-18 11:40:39.860585 | osd1 | ok 2026-08-18 11:40:39.866210 | mon2 | ok 2026-08-18 11:40:39.897358 | mon3 | ok 2026-08-18 11:40:39.905164 | 2026-08-18 11:40:39.905235 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-08-18 11:40:40.645777 | osd1 | Output suppressed because no_log was given 2026-08-18 11:40:40.652355 | mon1 | Output suppressed because no_log was given 2026-08-18 11:40:40.658190 | mon2 | Output suppressed because no_log was given 2026-08-18 11:40:40.663173 | mon3 | Output suppressed because no_log was given 2026-08-18 11:40:40.686481 | 2026-08-18 11:40:40.686550 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-08-18 11:40:40.909736 | mon1 | ok: "logs" 2026-08-18 11:40:40.910073 | mon1 | ok: All items complete 2026-08-18 11:40:40.910116 | 2026-08-18 11:40:40.947440 | mon3 | ok: "logs" 2026-08-18 11:40:40.954011 | osd1 | ok: "logs" 2026-08-18 11:40:40.959956 | mon2 | ok: "logs" 2026-08-18 11:40:41.114801 | mon1 | ok: "artifacts" 2026-08-18 11:40:41.151755 | mon2 | ok: "artifacts" 2026-08-18 11:40:41.156915 | mon3 | ok: "artifacts" 2026-08-18 11:40:41.161472 | osd1 | ok: "artifacts" 2026-08-18 11:40:41.326140 | mon1 | ok: "docs" 2026-08-18 11:40:41.348598 | osd1 | ok: "docs" 2026-08-18 11:40:41.358150 | mon2 | ok: "docs" 2026-08-18 11:40:41.364058 | mon3 | ok: "docs" 2026-08-18 11:40:41.377856 | 2026-08-18 11:40:41.378008 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-08-18 11:40:41.611078 | mon1 | changed: "logs" 2026-08-18 11:40:41.611357 | mon1 | ok: All items complete 2026-08-18 11:40:41.611385 | 2026-08-18 11:40:41.623001 | mon2 | changed: "logs" 2026-08-18 11:40:41.638889 | mon3 | changed: "logs" 2026-08-18 11:40:41.654910 | osd1 | changed: "logs" 2026-08-18 11:40:41.799458 | mon1 | changed: "artifacts" 2026-08-18 11:40:41.850016 | mon2 | changed: "artifacts" 2026-08-18 11:40:41.855724 | osd1 | changed: "artifacts" 2026-08-18 11:40:41.866243 | mon3 | changed: "artifacts" 2026-08-18 11:40:41.999084 | mon1 | changed: "docs" 2026-08-18 11:40:42.037895 | osd1 | changed: "docs" 2026-08-18 11:40:42.051374 | mon3 | changed: "docs" 2026-08-18 11:40:42.051454 | mon3 | changed: All items complete 2026-08-18 11:40:42.051489 | 2026-08-18 11:40:42.061344 | mon2 | changed: "docs" 2026-08-18 11:40:42.131551 | 2026-08-18 11:40:42.131671 | PLAY RECAP 2026-08-18 11:40:42.131720 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 11:40:42.131751 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 11:40:42.131778 | mon2 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 11:40:42.131802 | mon3 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 11:40:42.131825 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 11:40:42.131843 | 2026-08-18 11:40:42.286427 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-18 11:40:42.293674 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-18 11:40:42.877822 | 2026-08-18 11:40:42.877948 | PLAY [all] 2026-08-18 11:40:42.890373 | 2026-08-18 11:40:42.890450 | TASK [setup-uv : Extract archive] 2026-08-18 11:40:45.265364 | mon1 | changed 2026-08-18 11:40:45.286067 | mon3 | changed 2026-08-18 11:40:45.293219 | mon2 | changed 2026-08-18 11:40:45.322389 | osd1 | changed 2026-08-18 11:40:45.329991 | 2026-08-18 11:40:45.330055 | TASK [setup-uv : Print version] 2026-08-18 11:40:45.793995 | mon1 | uv 0.8.13 2026-08-18 11:40:45.784583 | mon3 | uv 0.8.13 2026-08-18 11:40:45.776608 | mon2 | uv 0.8.13 2026-08-18 11:40:45.772533 | osd1 | uv 0.8.13 2026-08-18 11:40:45.939890 | osd1 | ok: Runtime: 0:00:00.016989 2026-08-18 11:40:45.950026 | mon2 | ok: Runtime: 0:00:00.013717 2026-08-18 11:40:45.959402 | mon3 | ok: Runtime: 0:00:00.015690 2026-08-18 11:40:45.968194 | mon1 | ok: Runtime: 0:00:00.015711 2026-08-18 11:40:45.991479 | 2026-08-18 11:40:45.991556 | TASK [Install Ansible collection siblings] 2026-08-18 11:40:46.404336 | mon1 | ok: 2026-08-18 11:40:46.404509 | mon1 | Skipping community.crypto: no checked-out sibling 2026-08-18 11:40:46.404538 | mon1 | Skipping community.docker: no checked-out sibling 2026-08-18 11:40:46.404559 | mon1 | Skipping community.general: no checked-out sibling 2026-08-18 11:40:46.404580 | mon1 | Skipping ansible.utils: no checked-out sibling 2026-08-18 11:40:46.404599 | mon1 | Skipping vexxhost.containers: no checked-out sibling 2026-08-18 11:40:46.406514 | 2026-08-18 11:40:46.406560 | PLAY RECAP 2026-08-18 11:40:46.406608 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 11:40:46.406636 | mon2 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 11:40:46.406660 | mon3 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 11:40:46.406683 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 11:40:46.406701 | 2026-08-18 11:40:46.550602 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-18 11:40:46.556729 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-18 11:40:47.165877 | 2026-08-18 11:40:47.165999 | PLAY [all] 2026-08-18 11:40:47.178831 | 2026-08-18 11:40:47.178907 | LOOP [Check inventory directories] 2026-08-18 11:40:47.563295 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-18 11:40:47.756733 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory" 2026-08-18 11:40:47.952563 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory" 2026-08-18 11:40:47.970468 | 2026-08-18 11:40:47.970659 | LOOP [Copy inventory file for Zuul] 2026-08-18 11:40:48.855621 | mon1 | changed: 2026-08-18 11:40:48.855855 | mon1 | { 2026-08-18 11:40:48.855895 | mon1 | "ansible_loop_var": "item", 2026-08-18 11:40:48.855931 | mon1 | "changed": false, 2026-08-18 11:40:48.855970 | mon1 | "failed": false, 2026-08-18 11:40:48.856018 | mon1 | "invocation": { 2026-08-18 11:40:48.856058 | mon1 | "module_args": { 2026-08-18 11:40:48.856097 | mon1 | "checksum_algorithm": "sha1", 2026-08-18 11:40:48.856135 | mon1 | "follow": true, 2026-08-18 11:40:48.856167 | mon1 | "get_attributes": true, 2026-08-18 11:40:48.856200 | mon1 | "get_checksum": true, 2026-08-18 11:40:48.856238 | mon1 | "get_mime": true, 2026-08-18 11:40:48.856275 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-18 11:40:48.856305 | mon1 | } 2026-08-18 11:40:48.856332 | mon1 | }, 2026-08-18 11:40:48.856358 | mon1 | "item": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-18 11:40:48.856385 | mon1 | "stat": { 2026-08-18 11:40:48.856412 | mon1 | "atime": 1787053240.5456667, 2026-08-18 11:40:48.856439 | mon1 | "attr_flags": "e", 2026-08-18 11:40:48.856466 | mon1 | "attributes": [ 2026-08-18 11:40:48.856492 | mon1 | "extents" 2026-08-18 11:40:48.856519 | mon1 | ], 2026-08-18 11:40:48.856546 | mon1 | "block_size": 4096, 2026-08-18 11:40:48.856572 | mon1 | "blocks": 8, 2026-08-18 11:40:48.856599 | mon1 | "charset": "unknown", 2026-08-18 11:40:48.856627 | mon1 | "ctime": 1787053240.5586667, 2026-08-18 11:40:48.856654 | mon1 | "dev": 64769, 2026-08-18 11:40:48.856681 | mon1 | "device_type": 0, 2026-08-18 11:40:48.856708 | mon1 | "executable": true, 2026-08-18 11:40:48.856766 | mon1 | "exists": true, 2026-08-18 11:40:48.856795 | mon1 | "gid": 1000, 2026-08-18 11:40:48.856823 | mon1 | "gr_name": "zuul", 2026-08-18 11:40:48.856849 | mon1 | "inode": 1034272, 2026-08-18 11:40:48.856875 | mon1 | "isblk": false, 2026-08-18 11:40:48.856902 | mon1 | "ischr": false, 2026-08-18 11:40:48.856928 | mon1 | "isdir": true, 2026-08-18 11:40:48.856971 | mon1 | "isfifo": false, 2026-08-18 11:40:48.857001 | mon1 | "isgid": false, 2026-08-18 11:40:48.857039 | mon1 | "islnk": false, 2026-08-18 11:40:48.857067 | mon1 | "isreg": false, 2026-08-18 11:40:48.857092 | mon1 | "issock": false, 2026-08-18 11:40:48.857118 | mon1 | "isuid": false, 2026-08-18 11:40:48.857143 | mon1 | "mimetype": "unknown", 2026-08-18 11:40:48.857169 | mon1 | "mode": "0755", 2026-08-18 11:40:48.857195 | mon1 | "mtime": 1787053220.9010248, 2026-08-18 11:40:48.857221 | mon1 | "nlink": 10, 2026-08-18 11:40:48.857247 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-18 11:40:48.857273 | mon1 | "pw_name": "zuul", 2026-08-18 11:40:48.857303 | mon1 | "readable": true, 2026-08-18 11:40:48.857329 | mon1 | "rgrp": true, 2026-08-18 11:40:48.857355 | mon1 | "roth": true, 2026-08-18 11:40:48.857381 | mon1 | "rusr": true, 2026-08-18 11:40:48.857407 | mon1 | "size": 4096, 2026-08-18 11:40:48.857432 | mon1 | "uid": 1000, 2026-08-18 11:40:48.857457 | mon1 | "version": "1019293765", 2026-08-18 11:40:48.857484 | mon1 | "wgrp": false, 2026-08-18 11:40:48.857512 | mon1 | "woth": false, 2026-08-18 11:40:48.857538 | mon1 | "writeable": true, 2026-08-18 11:40:48.857564 | mon1 | "wusr": true, 2026-08-18 11:40:48.857590 | mon1 | "xgrp": true, 2026-08-18 11:40:48.857615 | mon1 | "xoth": true, 2026-08-18 11:40:48.857641 | mon1 | "xusr": true 2026-08-18 11:40:48.857666 | mon1 | } 2026-08-18 11:40:48.857693 | mon1 | } 2026-08-18 11:40:48.857743 | mon1 | ok: All items complete 2026-08-18 11:40:48.857776 | 2026-08-18 11:40:48.859039 | mon1 | skipping: Conditional result was False 2026-08-18 11:40:48.859617 | mon1 | skipping: Conditional result was False 2026-08-18 11:40:48.868710 | 2026-08-18 11:40:48.868856 | LOOP [Switch "ansible_host" to private IP] 2026-08-18 11:40:49.233881 | mon1 | changed: 4 replacements made 2026-08-18 11:40:49.235098 | mon1 | skipping: Conditional result was False 2026-08-18 11:40:49.235672 | mon1 | skipping: Conditional result was False 2026-08-18 11:40:49.255597 | 2026-08-18 11:40:49.255734 | TASK [Run Molecule scenario] 2026-08-18 11:40:49.781667 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3 2026-08-18 11:40:49.781842 | mon1 | Creating virtual environment at: .venv 2026-08-18 11:40:49.836045 | mon1 | Downloading pygments (1.2MiB) 2026-08-18 11:40:49.836120 | mon1 | Downloading ansible-core (2.1MiB) 2026-08-18 11:40:49.836134 | mon1 | Downloading cryptography (4.3MiB) 2026-08-18 11:40:49.836201 | mon1 | Downloading netaddr (2.2MiB) 2026-08-18 11:40:50.056969 | mon1 | Downloading netaddr 2026-08-18 11:40:50.069001 | mon1 | Downloading cryptography 2026-08-18 11:40:50.115146 | mon1 | Downloading pygments 2026-08-18 11:40:50.237249 | mon1 | Downloading ansible-core 2026-08-18 11:40:50.280665 | mon1 | Installed 43 packages in 42ms 2026-08-18 11:40:51.045927 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-08-18 11:40:51.045976 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-08-18 11:40:51.681960 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-08-18 11:40:51.682071 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-08-18 11:41:17.253784 | mon1 | INFO [default > dependency] Executing 2026-08-18 11:41:17.254236 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-08-18 11:41:17.254759 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-08-18 11:41:17.255064 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-08-18 11:41:17.263683 | mon1 | INFO [default > cleanup] Executing 2026-08-18 11:41:17.264019 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 11:41:17.269839 | mon1 | INFO [default > destroy] Executing 2026-08-18 11:41:17.269914 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-08-18 11:41:17.269990 | mon1 | INFO [default > destroy] Executed: Successful 2026-08-18 11:41:17.275704 | mon1 | INFO [default > syntax] Executing 2026-08-18 11:41:18.605986 | mon1 | 2026-08-18 11:41:18.606110 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-08-18 11:41:18.671235 | mon1 | INFO [default > syntax] Executed: Successful 2026-08-18 11:41:18.682132 | mon1 | INFO [default > create] Executing 2026-08-18 11:41:18.683687 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 11:41:18.689479 | mon1 | INFO [default > prepare] Executing 2026-08-18 11:41:19.518838 | mon1 | 2026-08-18 11:41:19.519135 | mon1 | PLAY [Prepare] ***************************************************************** 2026-08-18 11:41:19.519398 | mon1 | 2026-08-18 11:41:19.519649 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:41:19.519931 | mon1 | Tuesday 18 August 2026 11:41:19 +0000 (0:00:00.032) 0:00:00.032 ******** 2026-08-18 11:41:20.795762 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-18 11:41:20.795862 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 11:41:20.795929 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:41:20.796101 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:41:20.796296 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:41:20.799683 | mon1 | [WARNING]: Platform linux on host mon3 is using the discovered Python 2026-08-18 11:41:20.799831 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 11:41:20.800022 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:41:20.800193 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:41:20.803102 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:41:20.853961 | mon1 | [WARNING]: Platform linux on host mon2 is using the discovered Python 2026-08-18 11:41:20.854030 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 11:41:20.854040 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:41:20.854155 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:41:20.854407 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:41:21.818640 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-08-18 11:41:21.818838 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 11:41:21.819110 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:41:21.819348 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:41:21.819633 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:41:21.827151 | mon1 | ok: [mon1] 2026-08-18 11:41:21.827403 | mon1 | ok: [mon3] 2026-08-18 11:41:21.827706 | mon1 | ok: [mon2] 2026-08-18 11:41:21.828040 | mon1 | ok: [osd1] 2026-08-18 11:41:21.828268 | mon1 | 2026-08-18 11:41:21.828514 | mon1 | TASK [Configure short hostname] ************************************************ 2026-08-18 11:41:21.828758 | mon1 | Tuesday 18 August 2026 11:41:21 +0000 (0:00:02.308) 0:00:02.341 ******** 2026-08-18 11:41:22.626951 | mon1 | changed: [mon3] 2026-08-18 11:41:22.627164 | mon1 | changed: [mon1] 2026-08-18 11:41:22.627417 | mon1 | changed: [osd1] 2026-08-18 11:41:22.627699 | mon1 | changed: [mon2] 2026-08-18 11:41:22.627979 | mon1 | 2026-08-18 11:41:22.628207 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-08-18 11:41:22.628458 | mon1 | Tuesday 18 August 2026 11:41:22 +0000 (0:00:00.799) 0:00:03.140 ******** 2026-08-18 11:41:22.956520 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-08-18 11:41:22.956618 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-08-18 11:41:22.956780 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-08-18 11:41:22.991915 | mon1 | changed: [mon1] 2026-08-18 11:41:22.993047 | mon1 | changed: [osd1] 2026-08-18 11:41:22.993134 | mon1 | changed: [mon2] 2026-08-18 11:41:22.993144 | mon1 | changed: [mon3] 2026-08-18 11:41:22.993161 | mon1 | 2026-08-18 11:41:22.993316 | mon1 | TASK [Update apt cache] ******************************************************** 2026-08-18 11:41:22.993622 | mon1 | Tuesday 18 August 2026 11:41:22 +0000 (0:00:00.364) 0:00:03.505 ******** 2026-08-18 11:41:32.464916 | mon1 | changed: [mon3] 2026-08-18 11:41:32.465134 | mon1 | changed: [mon2] 2026-08-18 11:41:32.465396 | mon1 | changed: [mon1] 2026-08-18 11:41:32.465656 | mon1 | changed: [osd1] 2026-08-18 11:41:32.465918 | mon1 | 2026-08-18 11:41:32.466182 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-08-18 11:41:32.466448 | mon1 | 2026-08-18 11:41:32.466736 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:41:32.467083 | mon1 | Tuesday 18 August 2026 11:41:32 +0000 (0:00:09.473) 0:00:12.979 ******** 2026-08-18 11:41:33.347833 | mon1 | ok: [mon3] 2026-08-18 11:41:33.348088 | mon1 | ok: [mon2] 2026-08-18 11:41:33.348343 | mon1 | ok: [mon1] 2026-08-18 11:41:33.348588 | mon1 | ok: [osd1] 2026-08-18 11:41:33.348817 | mon1 | 2026-08-18 11:41:33.349157 | mon1 | TASK [Install depedencies] ***************************************************** 2026-08-18 11:41:33.349409 | mon1 | Tuesday 18 August 2026 11:41:33 +0000 (0:00:00.881) 0:00:13.860 ******** 2026-08-18 11:41:55.982196 | mon1 | changed: [mon3] 2026-08-18 11:41:55.982317 | mon1 | changed: [mon1] 2026-08-18 11:41:55.982548 | mon1 | changed: [osd1] 2026-08-18 11:41:55.982837 | mon1 | changed: [mon2] 2026-08-18 11:41:55.983117 | mon1 | 2026-08-18 11:41:55.983364 | mon1 | TASK [Start up service] ******************************************************** 2026-08-18 11:41:55.983605 | mon1 | Tuesday 18 August 2026 11:41:55 +0000 (0:00:22.634) 0:00:36.494 ******** 2026-08-18 11:41:56.664724 | mon1 | ok: [osd1] 2026-08-18 11:41:56.664992 | mon1 | ok: [mon1] 2026-08-18 11:41:56.665222 | mon1 | ok: [mon3] 2026-08-18 11:41:56.665461 | mon1 | ok: [mon2] 2026-08-18 11:41:56.665685 | mon1 | 2026-08-18 11:41:56.665980 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-08-18 11:41:56.666211 | mon1 | Tuesday 18 August 2026 11:41:56 +0000 (0:00:00.684) 0:00:37.178 ******** 2026-08-18 11:41:57.035156 | mon1 | ok: [osd1] 2026-08-18 11:41:57.035373 | mon1 | ok: [mon1] 2026-08-18 11:41:57.035608 | mon1 | ok: [mon3] 2026-08-18 11:41:57.035855 | mon1 | ok: [mon2] 2026-08-18 11:41:57.036147 | mon1 | 2026-08-18 11:41:57.036395 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-08-18 11:41:57.036636 | mon1 | Tuesday 18 August 2026 11:41:57 +0000 (0:00:00.370) 0:00:37.549 ******** 2026-08-18 11:41:57.841180 | mon1 | changed: [mon3] 2026-08-18 11:41:57.841411 | mon1 | changed: [mon1] 2026-08-18 11:41:57.841676 | mon1 | changed: [osd1] 2026-08-18 11:41:57.842048 | mon1 | changed: [mon2] 2026-08-18 11:41:57.842687 | mon1 | 2026-08-18 11:41:57.842713 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-08-18 11:41:57.842996 | mon1 | Tuesday 18 August 2026 11:41:57 +0000 (0:00:00.806) 0:00:38.355 ******** 2026-08-18 11:41:58.132374 | mon1 | ok: [mon1] 2026-08-18 11:41:58.132457 | mon1 | ok: [mon3] 2026-08-18 11:41:58.132563 | mon1 | ok: [mon2] 2026-08-18 11:41:58.132762 | mon1 | ok: [osd1] 2026-08-18 11:41:58.133026 | mon1 | 2026-08-18 11:41:58.133334 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-08-18 11:41:58.133586 | mon1 | Tuesday 18 August 2026 11:41:58 +0000 (0:00:00.290) 0:00:38.646 ******** 2026-08-18 11:41:58.170704 | mon1 | skipping: [mon1] 2026-08-18 11:41:58.197153 | mon1 | skipping: [mon2] 2026-08-18 11:41:58.197338 | mon1 | skipping: [mon3] 2026-08-18 11:41:58.197570 | mon1 | skipping: [osd1] 2026-08-18 11:41:58.197836 | mon1 | 2026-08-18 11:41:58.198123 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-08-18 11:41:58.198377 | mon1 | Tuesday 18 August 2026 11:41:58 +0000 (0:00:00.065) 0:00:38.711 ******** 2026-08-18 11:41:58.949627 | mon1 | changed: [mon1] => (item=osd0) 2026-08-18 11:41:58.949809 | mon1 | changed: [mon2] => (item=osd0) 2026-08-18 11:41:58.950101 | mon1 | changed: [mon3] => (item=osd0) 2026-08-18 11:41:58.950335 | mon1 | changed: [osd1] => (item=osd0) 2026-08-18 11:41:58.950578 | mon1 | changed: [mon3] => (item=osd1) 2026-08-18 11:41:58.950817 | mon1 | changed: [mon2] => (item=osd1) 2026-08-18 11:41:58.951114 | mon1 | changed: [mon1] => (item=osd1) 2026-08-18 11:41:58.951353 | mon1 | changed: [osd1] => (item=osd1) 2026-08-18 11:41:58.951606 | mon1 | changed: [mon3] => (item=osd2) 2026-08-18 11:41:58.951864 | mon1 | changed: [mon2] => (item=osd2) 2026-08-18 11:41:58.952173 | mon1 | changed: [osd1] => (item=osd2) 2026-08-18 11:41:58.952455 | mon1 | changed: [mon1] => (item=osd2) 2026-08-18 11:41:58.952715 | mon1 | 2026-08-18 11:41:58.953045 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-08-18 11:41:58.953307 | mon1 | Tuesday 18 August 2026 11:41:58 +0000 (0:00:00.752) 0:00:39.463 ******** 2026-08-18 11:41:59.762011 | mon1 | changed: [osd1] => (item=osd0) 2026-08-18 11:41:59.762061 | mon1 | changed: [mon1] => (item=osd0) 2026-08-18 11:41:59.762071 | mon1 | changed: [mon3] => (item=osd0) 2026-08-18 11:41:59.762079 | mon1 | changed: [mon2] => (item=osd0) 2026-08-18 11:41:59.762087 | mon1 | changed: [osd1] => (item=osd1) 2026-08-18 11:41:59.762095 | mon1 | changed: [mon3] => (item=osd1) 2026-08-18 11:41:59.762109 | mon1 | changed: [mon2] => (item=osd1) 2026-08-18 11:41:59.762966 | mon1 | changed: [mon1] => (item=osd1) 2026-08-18 11:41:59.763011 | mon1 | changed: [osd1] => (item=osd2) 2026-08-18 11:41:59.763015 | mon1 | changed: [mon3] => (item=osd2) 2026-08-18 11:41:59.763057 | mon1 | changed: [mon2] => (item=osd2) 2026-08-18 11:41:59.763061 | mon1 | changed: [mon1] => (item=osd2) 2026-08-18 11:41:59.763065 | mon1 | 2026-08-18 11:41:59.763069 | mon1 | TASK [Start loop devices] ****************************************************** 2026-08-18 11:41:59.763074 | mon1 | Tuesday 18 August 2026 11:41:59 +0000 (0:00:00.812) 0:00:40.275 ******** 2026-08-18 11:42:00.622075 | mon1 | changed: [osd1] => (item=osd0) 2026-08-18 11:42:00.622130 | mon1 | changed: [mon3] => (item=osd0) 2026-08-18 11:42:00.622140 | mon1 | changed: [mon1] => (item=osd0) 2026-08-18 11:42:00.622154 | mon1 | changed: [mon2] => (item=osd0) 2026-08-18 11:42:00.622347 | mon1 | changed: [osd1] => (item=osd1) 2026-08-18 11:42:00.622581 | mon1 | changed: [mon3] => (item=osd1) 2026-08-18 11:42:00.622815 | mon1 | changed: [mon1] => (item=osd1) 2026-08-18 11:42:00.623090 | mon1 | changed: [mon2] => (item=osd1) 2026-08-18 11:42:00.623316 | mon1 | changed: [osd1] => (item=osd2) 2026-08-18 11:42:00.623549 | mon1 | changed: [mon3] => (item=osd2) 2026-08-18 11:42:00.623776 | mon1 | changed: [mon1] => (item=osd2) 2026-08-18 11:42:00.624049 | mon1 | changed: [mon2] => (item=osd2) 2026-08-18 11:42:00.624252 | mon1 | 2026-08-18 11:42:00.624503 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-08-18 11:42:00.624792 | mon1 | Tuesday 18 August 2026 11:42:00 +0000 (0:00:00.859) 0:00:41.135 ******** 2026-08-18 11:42:02.100192 | mon1 | changed: [osd1] => (item=osd0) 2026-08-18 11:42:02.100458 | mon1 | changed: [mon2] => (item=osd0) 2026-08-18 11:42:02.100725 | mon1 | changed: [mon3] => (item=osd0) 2026-08-18 11:42:02.101030 | mon1 | changed: [mon1] => (item=osd0) 2026-08-18 11:42:02.101281 | mon1 | changed: [mon2] => (item=osd1) 2026-08-18 11:42:02.101522 | mon1 | changed: [osd1] => (item=osd1) 2026-08-18 11:42:02.101762 | mon1 | changed: [mon3] => (item=osd1) 2026-08-18 11:42:02.102053 | mon1 | changed: [mon1] => (item=osd1) 2026-08-18 11:42:02.102300 | mon1 | changed: [osd1] => (item=osd2) 2026-08-18 11:42:02.102540 | mon1 | changed: [mon2] => (item=osd2) 2026-08-18 11:42:02.102789 | mon1 | changed: [mon3] => (item=osd2) 2026-08-18 11:42:02.103098 | mon1 | changed: [mon1] => (item=osd2) 2026-08-18 11:42:02.103324 | mon1 | 2026-08-18 11:42:02.103575 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-08-18 11:42:02.103821 | mon1 | Tuesday 18 August 2026 11:42:02 +0000 (0:00:01.478) 0:00:42.614 ******** 2026-08-18 11:42:03.537032 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-08-18 11:42:03.537120 | mon1 | changed: [mon3] => (item=ceph-mon3-osd0) 2026-08-18 11:42:03.537197 | mon1 | changed: [mon2] => (item=ceph-mon2-osd0) 2026-08-18 11:42:03.537448 | mon1 | changed: [mon1] => (item=ceph-mon1-osd0) 2026-08-18 11:42:03.537700 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-08-18 11:42:03.538013 | mon1 | changed: [mon3] => (item=ceph-mon3-osd1) 2026-08-18 11:42:03.538236 | mon1 | changed: [mon1] => (item=ceph-mon1-osd1) 2026-08-18 11:42:03.538484 | mon1 | changed: [mon2] => (item=ceph-mon2-osd1) 2026-08-18 11:42:03.538730 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-08-18 11:42:03.539023 | mon1 | changed: [mon3] => (item=ceph-mon3-osd2) 2026-08-18 11:42:03.539281 | mon1 | changed: [mon1] => (item=ceph-mon1-osd2) 2026-08-18 11:42:03.539680 | mon1 | changed: [mon2] => (item=ceph-mon2-osd2) 2026-08-18 11:42:03.539866 | mon1 | 2026-08-18 11:42:03.540054 | mon1 | PLAY RECAP ********************************************************************* 2026-08-18 11:42:03.540221 | mon1 | mon1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 11:42:03.540384 | mon1 | mon2 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 11:42:03.540542 | mon1 | mon3 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 11:42:03.540704 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 11:42:03.540848 | mon1 | 2026-08-18 11:42:03.541009 | mon1 | 2026-08-18 11:42:03.541182 | mon1 | TASKS RECAP ******************************************************************** 2026-08-18 11:42:03.541312 | mon1 | Tuesday 18 August 2026 11:42:03 +0000 (0:00:01.433) 0:00:44.048 ******** 2026-08-18 11:42:03.541458 | mon1 | =============================================================================== 2026-08-18 11:42:03.541607 | mon1 | Install depedencies ---------------------------------------------------- 22.63s 2026-08-18 11:42:03.541769 | mon1 | Update apt cache -------------------------------------------------------- 9.47s 2026-08-18 11:42:03.541926 | mon1 | Gathering Facts --------------------------------------------------------- 2.31s 2026-08-18 11:42:03.542087 | mon1 | Create a volume group for each loop device ------------------------------ 1.48s 2026-08-18 11:42:03.542237 | mon1 | Create a logical volume for each loop device ---------------------------- 1.43s 2026-08-18 11:42:03.542387 | mon1 | Gathering Facts --------------------------------------------------------- 0.88s 2026-08-18 11:42:03.542535 | mon1 | Start loop devices ------------------------------------------------------ 0.86s 2026-08-18 11:42:03.542686 | mon1 | Set permissions on loopback devices ------------------------------------- 0.81s 2026-08-18 11:42:03.542852 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.81s 2026-08-18 11:42:03.543005 | mon1 | Configure short hostname ------------------------------------------------ 0.80s 2026-08-18 11:42:03.543157 | mon1 | Create devices for Ceph ------------------------------------------------- 0.75s 2026-08-18 11:42:03.543306 | mon1 | Start up service -------------------------------------------------------- 0.68s 2026-08-18 11:42:03.543497 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.37s 2026-08-18 11:42:03.543647 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.36s 2026-08-18 11:42:03.543808 | mon1 | Get list of all loopback devices ---------------------------------------- 0.29s 2026-08-18 11:42:03.543983 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.07s 2026-08-18 11:42:03.625495 | mon1 | INFO [default > prepare] Executed: Successful 2026-08-18 11:42:03.634233 | mon1 | INFO [default > converge] Executing 2026-08-18 11:42:04.875687 | mon1 | 2026-08-18 11:42:04.875852 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-18 11:42:04.876112 | mon1 | 2026-08-18 11:42:04.876344 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:42:04.876585 | mon1 | Tuesday 18 August 2026 11:42:04 +0000 (0:00:00.060) 0:00:00.060 ******** 2026-08-18 11:42:06.191063 | mon1 | [WARNING]: Platform linux on host mon2 is using the discovered Python 2026-08-18 11:42:06.191110 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 11:42:06.191117 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:42:06.191124 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:42:06.191130 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:42:06.202376 | mon1 | [WARNING]: Platform linux on host mon3 is using the discovered Python 2026-08-18 11:42:06.202453 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 11:42:06.202464 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:42:06.202473 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:42:06.202482 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:42:06.255953 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-18 11:42:06.256026 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 11:42:06.256037 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:42:06.256046 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:42:06.256055 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:42:06.321979 | mon1 | ok: [mon2] 2026-08-18 11:42:06.323804 | mon1 | ok: [mon3] 2026-08-18 11:42:06.323831 | mon1 | ok: [mon1] 2026-08-18 11:42:06.323841 | mon1 | 2026-08-18 11:42:06.323851 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:42:06.323860 | mon1 | Tuesday 18 August 2026 11:42:06 +0000 (0:00:01.444) 0:00:01.505 ******** 2026-08-18 11:42:06.696979 | mon1 | ok: [mon1] 2026-08-18 11:42:06.697041 | mon1 | ok: [mon3] 2026-08-18 11:42:06.697051 | mon1 | ok: [mon2] 2026-08-18 11:42:06.697060 | mon1 | 2026-08-18 11:42:06.697070 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:42:06.697080 | mon1 | Tuesday 18 August 2026 11:42:06 +0000 (0:00:00.374) 0:00:01.879 ******** 2026-08-18 11:42:06.801726 | mon1 | skipping: [mon1] 2026-08-18 11:42:06.801759 | mon1 | skipping: [mon2] 2026-08-18 11:42:06.801768 | mon1 | skipping: [mon3] 2026-08-18 11:42:06.801777 | mon1 | 2026-08-18 11:42:06.801786 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 11:42:06.801795 | mon1 | Tuesday 18 August 2026 11:42:06 +0000 (0:00:00.105) 0:00:01.984 ******** 2026-08-18 11:42:07.286340 | mon1 | changed: [mon2] 2026-08-18 11:42:07.286408 | mon1 | changed: [mon3] 2026-08-18 11:42:07.286418 | mon1 | changed: [mon1] 2026-08-18 11:42:07.286427 | mon1 | 2026-08-18 11:42:07.286436 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:42:07.286446 | mon1 | Tuesday 18 August 2026 11:42:07 +0000 (0:00:00.483) 0:00:02.468 ******** 2026-08-18 11:42:07.406965 | mon1 | ok: [mon1] => { 2026-08-18 11:42:07.407033 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:42:07.407044 | mon1 | } 2026-08-18 11:42:07.407052 | mon1 | ok: [mon2] => { 2026-08-18 11:42:07.407061 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:42:07.407069 | mon1 | } 2026-08-18 11:42:07.407078 | mon1 | ok: [mon3] => { 2026-08-18 11:42:07.407087 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:42:07.407095 | mon1 | } 2026-08-18 11:42:07.407323 | mon1 | 2026-08-18 11:42:07.407634 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:42:07.407971 | mon1 | Tuesday 18 August 2026 11:42:07 +0000 (0:00:00.120) 0:00:02.589 ******** 2026-08-18 11:42:08.189013 | mon1 | changed: [mon3] 2026-08-18 11:42:08.189448 | mon1 | changed: [mon2] 2026-08-18 11:42:08.189767 | mon1 | changed: [mon1] 2026-08-18 11:42:08.190094 | mon1 | 2026-08-18 11:42:08.190414 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:42:08.190733 | mon1 | Tuesday 18 August 2026 11:42:08 +0000 (0:00:00.783) 0:00:03.372 ******** 2026-08-18 11:42:08.307342 | mon1 | skipping: [mon1] 2026-08-18 11:42:08.307723 | mon1 | skipping: [mon2] 2026-08-18 11:42:08.308060 | mon1 | skipping: [mon3] 2026-08-18 11:42:08.308353 | mon1 | 2026-08-18 11:42:08.308662 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:42:08.308998 | mon1 | Tuesday 18 August 2026 11:42:08 +0000 (0:00:00.118) 0:00:03.491 ******** 2026-08-18 11:42:08.432155 | mon1 | skipping: [mon1] 2026-08-18 11:42:08.432385 | mon1 | skipping: [mon2] 2026-08-18 11:42:08.432556 | mon1 | skipping: [mon3] 2026-08-18 11:42:08.432702 | mon1 | 2026-08-18 11:42:08.432912 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:42:08.433088 | mon1 | Tuesday 18 August 2026 11:42:08 +0000 (0:00:00.123) 0:00:03.615 ******** 2026-08-18 11:42:08.738374 | mon1 | ok: [mon1] 2026-08-18 11:42:08.738765 | mon1 | ok: [mon2] 2026-08-18 11:42:08.739116 | mon1 | ok: [mon3] 2026-08-18 11:42:08.739422 | mon1 | 2026-08-18 11:42:08.739747 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:42:08.740096 | mon1 | Tuesday 18 August 2026 11:42:08 +0000 (0:00:00.307) 0:00:03.922 ******** 2026-08-18 11:42:09.979657 | mon1 | ok: [mon1] 2026-08-18 11:42:09.980115 | mon1 | ok: [mon3] 2026-08-18 11:42:09.981091 | mon1 | ok: [mon2] 2026-08-18 11:42:09.981502 | mon1 | 2026-08-18 11:42:09.981832 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:42:09.982235 | mon1 | Tuesday 18 August 2026 11:42:09 +0000 (0:00:01.241) 0:00:05.164 ******** 2026-08-18 11:42:10.225056 | mon1 | ok: [mon2] => { 2026-08-18 11:42:10.225133 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:42:10.225363 | mon1 | } 2026-08-18 11:42:10.225605 | mon1 | ok: [mon3] => { 2026-08-18 11:42:10.225862 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:42:10.226131 | mon1 | } 2026-08-18 11:42:10.226371 | mon1 | ok: [mon1] => { 2026-08-18 11:42:10.226627 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:42:10.226857 | mon1 | } 2026-08-18 11:42:10.227123 | mon1 | 2026-08-18 11:42:10.227370 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:42:10.227614 | mon1 | Tuesday 18 August 2026 11:42:10 +0000 (0:00:00.245) 0:00:05.409 ******** 2026-08-18 11:42:11.252051 | mon1 | changed: [mon3] 2026-08-18 11:42:11.252408 | mon1 | changed: [mon1] 2026-08-18 11:42:11.252710 | mon1 | changed: [mon2] 2026-08-18 11:42:11.252975 | mon1 | 2026-08-18 11:42:11.253229 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:42:11.253477 | mon1 | Tuesday 18 August 2026 11:42:11 +0000 (0:00:01.027) 0:00:06.436 ******** 2026-08-18 11:42:14.540317 | mon1 | changed: [mon1] 2026-08-18 11:42:14.540401 | mon1 | changed: [mon3] 2026-08-18 11:42:14.540453 | mon1 | changed: [mon2] 2026-08-18 11:42:14.540794 | mon1 | 2026-08-18 11:42:14.540820 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 11:42:14.540825 | mon1 | Tuesday 18 August 2026 11:42:14 +0000 (0:00:03.288) 0:00:09.725 ******** 2026-08-18 11:42:14.592303 | mon1 | skipping: [mon1] 2026-08-18 11:42:14.627164 | mon1 | skipping: [mon2] 2026-08-18 11:42:14.627230 | mon1 | skipping: [mon3] 2026-08-18 11:42:14.627347 | mon1 | 2026-08-18 11:42:14.627466 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 11:42:14.627596 | mon1 | Tuesday 18 August 2026 11:42:14 +0000 (0:00:00.086) 0:00:09.812 ******** 2026-08-18 11:42:14.662437 | mon1 | skipping: [mon1] 2026-08-18 11:42:14.700152 | mon1 | skipping: [mon2] 2026-08-18 11:42:14.700235 | mon1 | skipping: [mon3] 2026-08-18 11:42:14.700337 | mon1 | 2026-08-18 11:42:14.700452 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 11:42:14.700567 | mon1 | Tuesday 18 August 2026 11:42:14 +0000 (0:00:00.073) 0:00:09.885 ******** 2026-08-18 11:42:14.783922 | mon1 | skipping: [mon1] 2026-08-18 11:42:14.783983 | mon1 | skipping: [mon2] 2026-08-18 11:42:14.784092 | mon1 | skipping: [mon3] 2026-08-18 11:42:14.784193 | mon1 | 2026-08-18 11:42:14.784309 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 11:42:14.784423 | mon1 | Tuesday 18 August 2026 11:42:14 +0000 (0:00:00.083) 0:00:09.968 ******** 2026-08-18 11:42:22.753956 | mon1 | changed: [mon1] 2026-08-18 11:42:22.754028 | mon1 | changed: [mon3] 2026-08-18 11:42:22.754041 | mon1 | changed: [mon2] 2026-08-18 11:42:22.754053 | mon1 | 2026-08-18 11:42:22.754065 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 11:42:22.754077 | mon1 | Tuesday 18 August 2026 11:42:22 +0000 (0:00:07.967) 0:00:17.936 ******** 2026-08-18 11:42:23.460050 | mon1 | changed: [mon1] 2026-08-18 11:42:23.460106 | mon1 | changed: [mon2] 2026-08-18 11:42:23.460120 | mon1 | changed: [mon3] 2026-08-18 11:42:23.460134 | mon1 | 2026-08-18 11:42:23.460146 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 11:42:23.460158 | mon1 | Tuesday 18 August 2026 11:42:23 +0000 (0:00:00.706) 0:00:18.643 ******** 2026-08-18 11:42:24.640965 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:42:24.641048 | mon1 | changed: [mon2] => (item={'path': '/etc/containerd'}) 2026-08-18 11:42:24.641063 | mon1 | changed: [mon3] => (item={'path': '/etc/containerd'}) 2026-08-18 11:42:24.641076 | mon1 | changed: [mon2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:42:24.641089 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:42:24.641100 | mon1 | changed: [mon3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:42:24.641112 | mon1 | changed: [mon2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:42:24.641141 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:42:24.641153 | mon1 | changed: [mon3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:42:24.641512 | mon1 | changed: [mon2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:42:24.641854 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:42:24.642221 | mon1 | changed: [mon3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:42:24.642550 | mon1 | changed: [mon2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:42:24.642913 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:42:24.643287 | mon1 | changed: [mon3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:42:24.643573 | mon1 | 2026-08-18 11:42:24.643915 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 11:42:24.644238 | mon1 | Tuesday 18 August 2026 11:42:24 +0000 (0:00:01.180) 0:00:19.823 ******** 2026-08-18 11:42:25.505777 | mon1 | changed: [mon1] 2026-08-18 11:42:25.506178 | mon1 | changed: [mon3] 2026-08-18 11:42:25.506441 | mon1 | changed: [mon2] 2026-08-18 11:42:25.506651 | mon1 | 2026-08-18 11:42:25.506946 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:42:25.507224 | mon1 | Tuesday 18 August 2026 11:42:25 +0000 (0:00:00.832) 0:00:20.655 ******** 2026-08-18 11:42:25.507423 | mon1 | 2026-08-18 11:42:25.507629 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:42:25.507834 | mon1 | Tuesday 18 August 2026 11:42:25 +0000 (0:00:00.011) 0:00:20.666 ******** 2026-08-18 11:42:25.508043 | mon1 | 2026-08-18 11:42:25.508466 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:42:25.508721 | mon1 | Tuesday 18 August 2026 11:42:25 +0000 (0:00:00.010) 0:00:20.677 ******** 2026-08-18 11:42:25.508991 | mon1 | 2026-08-18 11:42:25.509285 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 11:42:25.509499 | mon1 | Tuesday 18 August 2026 11:42:25 +0000 (0:00:00.011) 0:00:20.689 ******** 2026-08-18 11:42:26.696217 | mon1 | ok: [mon1] 2026-08-18 11:42:26.696715 | mon1 | ok: [mon3] 2026-08-18 11:42:26.697102 | mon1 | ok: [mon2] 2026-08-18 11:42:26.697432 | mon1 | 2026-08-18 11:42:26.697774 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-08-18 11:42:26.698122 | mon1 | Tuesday 18 August 2026 11:42:26 +0000 (0:00:01.191) 0:00:21.880 ******** 2026-08-18 11:42:27.322749 | mon1 | changed: [mon2] 2026-08-18 11:42:27.323181 | mon1 | changed: [mon1] 2026-08-18 11:42:27.323493 | mon1 | changed: [mon3] 2026-08-18 11:42:27.323776 | mon1 | 2026-08-18 11:42:27.324155 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 11:42:27.324474 | mon1 | Tuesday 18 August 2026 11:42:27 +0000 (0:00:00.626) 0:00:22.507 ******** 2026-08-18 11:42:28.141692 | mon1 | changed: [mon1] 2026-08-18 11:42:28.143088 | mon1 | changed: [mon2] 2026-08-18 11:42:28.143156 | mon1 | changed: [mon3] 2026-08-18 11:42:28.143167 | mon1 | 2026-08-18 11:42:28.143176 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:42:28.143194 | mon1 | Tuesday 18 August 2026 11:42:28 +0000 (0:00:00.819) 0:00:23.326 ******** 2026-08-18 11:42:28.473867 | mon1 | ok: [mon1] 2026-08-18 11:42:28.473951 | mon1 | ok: [mon2] 2026-08-18 11:42:28.473960 | mon1 | ok: [mon3] 2026-08-18 11:42:28.473970 | mon1 | 2026-08-18 11:42:28.473979 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:42:28.473988 | mon1 | Tuesday 18 August 2026 11:42:28 +0000 (0:00:00.330) 0:00:23.656 ******** 2026-08-18 11:42:28.614953 | mon1 | ok: [mon1] => { 2026-08-18 11:42:28.615008 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:42:28.615015 | mon1 | } 2026-08-18 11:42:28.615022 | mon1 | ok: [mon2] => { 2026-08-18 11:42:28.615029 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:42:28.615035 | mon1 | } 2026-08-18 11:42:28.615040 | mon1 | ok: [mon3] => { 2026-08-18 11:42:28.615045 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:42:28.615051 | mon1 | } 2026-08-18 11:42:28.615058 | mon1 | 2026-08-18 11:42:28.615101 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:42:28.615350 | mon1 | Tuesday 18 August 2026 11:42:28 +0000 (0:00:00.139) 0:00:23.796 ******** 2026-08-18 11:42:29.685655 | mon1 | changed: [mon3] 2026-08-18 11:42:29.686066 | mon1 | changed: [mon2] 2026-08-18 11:42:29.686377 | mon1 | changed: [mon1] 2026-08-18 11:42:29.686755 | mon1 | 2026-08-18 11:42:29.687158 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:42:29.687540 | mon1 | Tuesday 18 August 2026 11:42:29 +0000 (0:00:01.072) 0:00:24.869 ******** 2026-08-18 11:42:34.386561 | mon1 | changed: [mon1] 2026-08-18 11:42:34.386994 | mon1 | changed: [mon2] 2026-08-18 11:42:34.387321 | mon1 | changed: [mon3] 2026-08-18 11:42:34.387622 | mon1 | 2026-08-18 11:42:34.387978 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 11:42:34.388303 | mon1 | Tuesday 18 August 2026 11:42:34 +0000 (0:00:04.701) 0:00:29.570 ******** 2026-08-18 11:42:35.398647 | mon1 | ok: [mon2] 2026-08-18 11:42:35.399040 | mon1 | ok: [mon1] 2026-08-18 11:42:35.403041 | mon1 | ok: [mon3] 2026-08-18 11:42:35.403144 | mon1 | 2026-08-18 11:42:35.403159 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 11:42:35.403173 | mon1 | Tuesday 18 August 2026 11:42:35 +0000 (0:00:01.012) 0:00:30.583 ******** 2026-08-18 11:42:35.825756 | mon1 | changed: [mon1] 2026-08-18 11:42:35.825980 | mon1 | changed: [mon3] 2026-08-18 11:42:35.826239 | mon1 | changed: [mon2] 2026-08-18 11:42:35.826476 | mon1 | 2026-08-18 11:42:35.826747 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 11:42:35.827037 | mon1 | Tuesday 18 August 2026 11:42:35 +0000 (0:00:00.426) 0:00:31.009 ******** 2026-08-18 11:42:36.463983 | mon1 | changed: [mon1] 2026-08-18 11:42:36.465200 | mon1 | changed: [mon3] 2026-08-18 11:42:36.465265 | mon1 | changed: [mon2] 2026-08-18 11:42:36.465279 | mon1 | 2026-08-18 11:42:36.465293 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 11:42:36.465306 | mon1 | Tuesday 18 August 2026 11:42:36 +0000 (0:00:00.638) 0:00:31.647 ******** 2026-08-18 11:42:37.225944 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 11:42:37.226003 | mon1 | changed: [mon2] => (item={'path': '/etc/docker'}) 2026-08-18 11:42:37.226016 | mon1 | changed: [mon3] => (item={'path': '/etc/docker'}) 2026-08-18 11:42:37.226029 | mon1 | changed: [mon2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:42:37.226044 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:42:37.226059 | mon1 | changed: [mon3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:42:37.226074 | mon1 | changed: [mon2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:42:37.226088 | mon1 | changed: [mon3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:42:37.226102 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:42:37.226312 | mon1 | 2026-08-18 11:42:37.226650 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 11:42:37.227003 | mon1 | Tuesday 18 August 2026 11:42:37 +0000 (0:00:00.759) 0:00:32.407 ******** 2026-08-18 11:42:37.849596 | mon1 | changed: [mon1] 2026-08-18 11:42:37.850006 | mon1 | changed: [mon2] 2026-08-18 11:42:37.850332 | mon1 | changed: [mon3] 2026-08-18 11:42:37.850638 | mon1 | 2026-08-18 11:42:37.851032 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 11:42:37.851361 | mon1 | Tuesday 18 August 2026 11:42:37 +0000 (0:00:00.626) 0:00:33.033 ******** 2026-08-18 11:42:38.511669 | mon1 | changed: [mon1] 2026-08-18 11:42:38.512085 | mon1 | changed: [mon2] 2026-08-18 11:42:38.512409 | mon1 | changed: [mon3] 2026-08-18 11:42:38.512710 | mon1 | 2026-08-18 11:42:38.513069 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:42:38.513395 | mon1 | Tuesday 18 August 2026 11:42:38 +0000 (0:00:00.605) 0:00:33.639 ******** 2026-08-18 11:42:38.513689 | mon1 | 2026-08-18 11:42:38.514038 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:42:38.514358 | mon1 | Tuesday 18 August 2026 11:42:38 +0000 (0:00:00.010) 0:00:33.650 ******** 2026-08-18 11:42:38.514716 | mon1 | 2026-08-18 11:42:38.515102 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:42:38.515421 | mon1 | Tuesday 18 August 2026 11:42:38 +0000 (0:00:00.037) 0:00:33.687 ******** 2026-08-18 11:42:38.515708 | mon1 | 2026-08-18 11:42:38.516058 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 11:42:38.516405 | mon1 | Tuesday 18 August 2026 11:42:38 +0000 (0:00:00.007) 0:00:33.695 ******** 2026-08-18 11:42:39.485675 | mon1 | ok: [mon1] 2026-08-18 11:42:39.486165 | mon1 | ok: [mon2] 2026-08-18 11:42:39.486550 | mon1 | ok: [mon3] 2026-08-18 11:42:39.486912 | mon1 | 2026-08-18 11:42:39.487307 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-08-18 11:42:39.487667 | mon1 | Tuesday 18 August 2026 11:42:39 +0000 (0:00:00.974) 0:00:34.669 ******** 2026-08-18 11:42:40.726567 | mon1 | changed: [mon1] 2026-08-18 11:42:40.726978 | mon1 | changed: [mon3] 2026-08-18 11:42:40.727297 | mon1 | changed: [mon2] 2026-08-18 11:42:40.727589 | mon1 | 2026-08-18 11:42:40.728110 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 11:42:40.728464 | mon1 | Tuesday 18 August 2026 11:42:40 +0000 (0:00:01.240) 0:00:35.910 ******** 2026-08-18 11:42:41.522040 | mon1 | changed: [mon1] 2026-08-18 11:42:41.522093 | mon1 | changed: [mon2] 2026-08-18 11:42:41.522106 | mon1 | changed: [mon3] 2026-08-18 11:42:41.522119 | mon1 | 2026-08-18 11:42:41.522131 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:42:41.522149 | mon1 | Tuesday 18 August 2026 11:42:41 +0000 (0:00:00.794) 0:00:36.705 ******** 2026-08-18 11:42:41.594940 | mon1 | ok: [mon1] => { 2026-08-18 11:42:41.594988 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:42:41.595002 | mon1 | } 2026-08-18 11:42:41.595014 | mon1 | ok: [mon2] => { 2026-08-18 11:42:41.595025 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:42:41.595036 | mon1 | } 2026-08-18 11:42:41.595047 | mon1 | ok: [mon3] => { 2026-08-18 11:42:41.595058 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:42:41.595070 | mon1 | } 2026-08-18 11:42:41.595081 | mon1 | 2026-08-18 11:42:41.595291 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:42:41.595604 | mon1 | Tuesday 18 August 2026 11:42:41 +0000 (0:00:00.072) 0:00:36.777 ******** 2026-08-18 11:42:44.125345 | mon1 | changed: [mon3] 2026-08-18 11:42:44.125413 | mon1 | changed: [mon1] 2026-08-18 11:42:44.125516 | mon1 | changed: [mon2] 2026-08-18 11:42:44.125616 | mon1 | 2026-08-18 11:42:44.125731 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:42:44.125845 | mon1 | Tuesday 18 August 2026 11:42:44 +0000 (0:00:02.532) 0:00:39.309 ******** 2026-08-18 11:42:44.221930 | mon1 | skipping: [mon1] 2026-08-18 11:42:44.222022 | mon1 | skipping: [mon2] 2026-08-18 11:42:44.222035 | mon1 | skipping: [mon3] 2026-08-18 11:42:44.222048 | mon1 | 2026-08-18 11:42:44.222066 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 11:42:44.222079 | mon1 | Tuesday 18 August 2026 11:42:44 +0000 (0:00:00.095) 0:00:39.405 ******** 2026-08-18 11:42:44.322080 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:42:44.322153 | mon1 | ok: [mon2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:42:44.323634 | mon1 | ok: [mon3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:42:44.323753 | mon1 | 2026-08-18 11:42:44.323773 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 11:42:44.323790 | mon1 | Tuesday 18 August 2026 11:42:44 +0000 (0:00:00.100) 0:00:39.505 ******** 2026-08-18 11:42:45.343396 | mon1 | ok: [mon1] 2026-08-18 11:42:45.343439 | mon1 | ok: [mon2] 2026-08-18 11:42:45.343448 | mon1 | ok: [mon3] 2026-08-18 11:42:45.343456 | mon1 | 2026-08-18 11:42:45.343464 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 11:42:45.343476 | mon1 | Tuesday 18 August 2026 11:42:45 +0000 (0:00:01.020) 0:00:40.526 ******** 2026-08-18 11:42:46.218218 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-08-18 11:42:46.218479 | mon1 | ok: [mon3] => (item=systemd-timesyncd) 2026-08-18 11:42:46.218684 | mon1 | ok: [mon2] => (item=systemd-timesyncd) 2026-08-18 11:42:46.219353 | mon1 | ok: [mon3] => (item=ssh) 2026-08-18 11:42:46.219732 | mon1 | ok: [mon2] => (item=ssh) 2026-08-18 11:42:46.220102 | mon1 | ok: [mon1] => (item=ssh) 2026-08-18 11:42:46.220419 | mon1 | 2026-08-18 11:42:46.221033 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 11:42:46.222079 | mon1 | Tuesday 18 August 2026 11:42:46 +0000 (0:00:00.873) 0:00:41.399 ******** 2026-08-18 11:42:46.524305 | mon1 | ok: [mon1] 2026-08-18 11:42:46.524411 | mon1 | ok: [mon2] 2026-08-18 11:42:46.524469 | mon1 | ok: [mon3] 2026-08-18 11:42:46.524570 | mon1 | 2026-08-18 11:42:46.524685 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 11:42:46.524798 | mon1 | Tuesday 18 August 2026 11:42:46 +0000 (0:00:00.308) 0:00:41.708 ******** 2026-08-18 11:42:47.136048 | mon1 | changed: [mon1] 2026-08-18 11:42:47.136141 | mon1 | changed: [mon3] 2026-08-18 11:42:47.136152 | mon1 | changed: [mon2] 2026-08-18 11:42:47.136161 | mon1 | 2026-08-18 11:42:47.136172 | mon1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 11:42:47.136192 | mon1 | Tuesday 18 August 2026 11:42:47 +0000 (0:00:00.612) 0:00:42.320 ******** 2026-08-18 11:42:47.779862 | mon1 | changed: [mon1] 2026-08-18 11:42:47.779943 | mon1 | changed: [mon3] 2026-08-18 11:42:47.779953 | mon1 | changed: [mon2] 2026-08-18 11:42:47.779962 | mon1 | 2026-08-18 11:42:47.779972 | mon1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 11:42:47.779981 | mon1 | Tuesday 18 August 2026 11:42:47 +0000 (0:00:00.642) 0:00:42.963 ******** 2026-08-18 11:42:47.862261 | mon1 | skipping: [mon1] 2026-08-18 11:42:47.862311 | mon1 | skipping: [mon2] 2026-08-18 11:42:47.862321 | mon1 | skipping: [mon3] 2026-08-18 11:42:47.862330 | mon1 | 2026-08-18 11:42:47.862340 | mon1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 11:42:47.862351 | mon1 | Tuesday 18 August 2026 11:42:47 +0000 (0:00:00.082) 0:00:43.045 ******** 2026-08-18 11:43:29.570421 | mon1 | changed: [mon1] 2026-08-18 11:43:29.570799 | mon1 | changed: [mon3] 2026-08-18 11:43:29.571145 | mon1 | changed: [mon2] 2026-08-18 11:43:29.571442 | mon1 | 2026-08-18 11:43:29.571776 | mon1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 11:43:29.572152 | mon1 | Tuesday 18 August 2026 11:43:29 +0000 (0:00:41.709) 0:01:24.754 ******** 2026-08-18 11:43:30.227052 | mon1 | changed: [mon1] 2026-08-18 11:43:30.227108 | mon1 | changed: [mon2] 2026-08-18 11:43:30.227120 | mon1 | changed: [mon3] 2026-08-18 11:43:30.227139 | mon1 | 2026-08-18 11:43:30.227415 | mon1 | TASK [vexxhost.ceph.mon : Find this monitor's addresses on the public network] *** 2026-08-18 11:43:30.227659 | mon1 | Tuesday 18 August 2026 11:43:30 +0000 (0:00:00.656) 0:01:25.410 ******** 2026-08-18 11:43:30.364032 | mon1 | ok: [mon2] 2026-08-18 11:43:30.364086 | mon1 | ok: [mon3] 2026-08-18 11:43:30.364189 | mon1 | ok: [mon1] 2026-08-18 11:43:30.364454 | mon1 | 2026-08-18 11:43:30.364706 | mon1 | TASK [vexxhost.ceph.mon : Assert exactly one address matches the public network] *** 2026-08-18 11:43:30.364982 | mon1 | Tuesday 18 August 2026 11:43:30 +0000 (0:00:00.137) 0:01:25.548 ******** 2026-08-18 11:43:30.462294 | mon1 | ok: [mon1] => { 2026-08-18 11:43:30.462475 | mon1 | "changed": false, 2026-08-18 11:43:30.462707 | mon1 | "msg": "All assertions passed" 2026-08-18 11:43:30.462963 | mon1 | } 2026-08-18 11:43:30.463195 | mon1 | ok: [mon2] => { 2026-08-18 11:43:30.463422 | mon1 | "changed": false, 2026-08-18 11:43:30.463654 | mon1 | "msg": "All assertions passed" 2026-08-18 11:43:30.463873 | mon1 | } 2026-08-18 11:43:30.464128 | mon1 | ok: [mon3] => { 2026-08-18 11:43:30.464356 | mon1 | "changed": false, 2026-08-18 11:43:30.464586 | mon1 | "msg": "All assertions passed" 2026-08-18 11:43:30.464805 | mon1 | } 2026-08-18 11:43:30.465063 | mon1 | 2026-08-18 11:43:30.465299 | mon1 | TASK [vexxhost.ceph.mon : Set this monitor's Ceph public IP] ******************* 2026-08-18 11:43:30.465558 | mon1 | Tuesday 18 August 2026 11:43:30 +0000 (0:00:00.098) 0:01:25.646 ******** 2026-08-18 11:43:30.540181 | mon1 | ok: [mon1] 2026-08-18 11:43:30.540386 | mon1 | ok: [mon2] 2026-08-18 11:43:30.540612 | mon1 | ok: [mon3] 2026-08-18 11:43:30.540823 | mon1 | 2026-08-18 11:43:30.541126 | mon1 | TASK [vexxhost.ceph.mon : Check whether any monitor is already bootstrapped] *** 2026-08-18 11:43:30.541351 | mon1 | Tuesday 18 August 2026 11:43:30 +0000 (0:00:00.078) 0:01:25.724 ******** 2026-08-18 11:43:31.260356 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:43:31.260427 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:43:31.260469 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:43:31.260572 | mon1 | 2026-08-18 11:43:31.260688 | mon1 | TASK [vexxhost.ceph.mon : Select the bootstrap node (existing one, else the first monitor)] *** 2026-08-18 11:43:31.260826 | mon1 | Tuesday 18 August 2026 11:43:31 +0000 (0:00:00.720) 0:01:26.445 ******** 2026-08-18 11:43:31.346042 | mon1 | ok: [mon1] 2026-08-18 11:43:31.346086 | mon1 | ok: [mon2] 2026-08-18 11:43:31.346096 | mon1 | ok: [mon3] 2026-08-18 11:43:31.346280 | mon1 | 2026-08-18 11:43:31.346527 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] ******************************* 2026-08-18 11:43:31.346767 | mon1 | Tuesday 18 August 2026 11:43:31 +0000 (0:00:00.084) 0:01:26.529 ******** 2026-08-18 11:43:31.479285 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap.yml for mon1, mon2, mon3 2026-08-18 11:43:31.479470 | mon1 | 2026-08-18 11:43:31.479721 | mon1 | TASK [vexxhost.ceph.mon : Ensure /etc/ceph exists] ***************************** 2026-08-18 11:43:31.480002 | mon1 | Tuesday 18 August 2026 11:43:31 +0000 (0:00:00.134) 0:01:26.664 ******** 2026-08-18 11:43:31.725518 | mon1 | skipping: [mon2] 2026-08-18 11:43:31.725742 | mon1 | skipping: [mon3] 2026-08-18 11:43:31.726063 | mon1 | changed: [mon1] 2026-08-18 11:43:31.726275 | mon1 | 2026-08-18 11:43:31.726588 | mon1 | TASK [vexxhost.ceph.mon : Write the caller-provided SSH private key] *********** 2026-08-18 11:43:31.726900 | mon1 | Tuesday 18 August 2026 11:43:31 +0000 (0:00:00.246) 0:01:26.910 ******** 2026-08-18 11:43:31.765645 | mon1 | skipping: [mon1] 2026-08-18 11:43:31.798187 | mon1 | skipping: [mon2] 2026-08-18 11:43:31.798401 | mon1 | skipping: [mon3] 2026-08-18 11:43:31.798608 | mon1 | 2026-08-18 11:43:31.798860 | mon1 | TASK [vexxhost.ceph.mon : Write the caller-provided SSH public key] ************ 2026-08-18 11:43:31.799142 | mon1 | Tuesday 18 August 2026 11:43:31 +0000 (0:00:00.072) 0:01:26.983 ******** 2026-08-18 11:43:31.867254 | mon1 | skipping: [mon1] 2026-08-18 11:43:31.867403 | mon1 | skipping: [mon2] 2026-08-18 11:43:31.867554 | mon1 | skipping: [mon3] 2026-08-18 11:43:31.867712 | mon1 | 2026-08-18 11:43:31.867953 | mon1 | TASK [vexxhost.ceph.mon : Generate a cephadm SSH keypair when none was provided] *** 2026-08-18 11:43:31.868077 | mon1 | Tuesday 18 August 2026 11:43:31 +0000 (0:00:00.068) 0:01:27.052 ******** 2026-08-18 11:43:33.477590 | mon1 | skipping: [mon2] 2026-08-18 11:43:33.477644 | mon1 | skipping: [mon3] 2026-08-18 11:43:33.477656 | mon1 | changed: [mon1] 2026-08-18 11:43:33.477665 | mon1 | 2026-08-18 11:43:33.477674 | mon1 | TASK [vexxhost.ceph.mon : Create a temporary ceph.conf for bootstrap overrides] *** 2026-08-18 11:43:33.477683 | mon1 | Tuesday 18 August 2026 11:43:33 +0000 (0:00:01.608) 0:01:28.660 ******** 2026-08-18 11:43:33.805015 | mon1 | skipping: [mon2] 2026-08-18 11:43:33.805063 | mon1 | skipping: [mon3] 2026-08-18 11:43:33.805224 | mon1 | changed: [mon1] 2026-08-18 11:43:33.805425 | mon1 | 2026-08-18 11:43:33.805673 | mon1 | TASK [vexxhost.ceph.mon : Populate bootstrap ceph.conf overrides] ************** 2026-08-18 11:43:33.805967 | mon1 | Tuesday 18 August 2026 11:43:33 +0000 (0:00:00.327) 0:01:28.988 ******** 2026-08-18 11:43:33.859100 | mon1 | skipping: [mon1] 2026-08-18 11:43:33.898915 | mon1 | skipping: [mon2] 2026-08-18 11:43:33.899127 | mon1 | skipping: [mon3] 2026-08-18 11:43:33.899340 | mon1 | 2026-08-18 11:43:33.899583 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] ******************************* 2026-08-18 11:43:33.899822 | mon1 | Tuesday 18 August 2026 11:43:33 +0000 (0:00:00.094) 0:01:29.083 ******** 2026-08-18 11:44:15.817031 | mon1 | skipping: [mon2] 2026-08-18 11:44:15.817110 | mon1 | skipping: [mon3] 2026-08-18 11:44:15.817124 | mon1 | changed: [mon1] 2026-08-18 11:44:15.817138 | mon1 | 2026-08-18 11:44:15.817157 | mon1 | TASK [vexxhost.ceph.mon : Remove the temporary ceph.conf] ********************** 2026-08-18 11:44:15.817391 | mon1 | Tuesday 18 August 2026 11:44:15 +0000 (0:00:41.917) 0:02:11.000 ******** 2026-08-18 11:44:16.070802 | mon1 | skipping: [mon2] 2026-08-18 11:44:16.070920 | mon1 | skipping: [mon3] 2026-08-18 11:44:16.071006 | mon1 | changed: [mon1] 2026-08-18 11:44:16.071123 | mon1 | 2026-08-18 11:44:16.071256 | mon1 | TASK [Register this monitor host] ********************************************** 2026-08-18 11:44:16.071386 | mon1 | Tuesday 18 August 2026 11:44:16 +0000 (0:00:00.254) 0:02:11.255 ******** 2026-08-18 11:44:16.257440 | mon1 | included: vexxhost.ceph.cephadm_host for mon1, mon2, mon3 2026-08-18 11:44:16.257668 | mon1 | 2026-08-18 11:44:16.258069 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 11:44:16.258202 | mon1 | Tuesday 18 August 2026 11:44:16 +0000 (0:00:00.186) 0:02:11.442 ******** 2026-08-18 11:44:18.023909 | mon1 | ok: [mon1] 2026-08-18 11:44:18.023946 | mon1 | 2026-08-18 11:44:18.023952 | mon1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 11:44:18.024007 | mon1 | Tuesday 18 August 2026 11:44:18 +0000 (0:00:01.765) 0:02:13.207 ******** 2026-08-18 11:44:18.104064 | mon1 | ok: [mon1] 2026-08-18 11:44:18.104293 | mon1 | ok: [mon2] 2026-08-18 11:44:18.104636 | mon1 | ok: [mon3] 2026-08-18 11:44:18.104866 | mon1 | 2026-08-18 11:44:18.105151 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 11:44:18.105390 | mon1 | Tuesday 18 August 2026 11:44:18 +0000 (0:00:00.081) 0:02:13.288 ******** 2026-08-18 11:44:18.193150 | mon1 | ok: [mon1] => { 2026-08-18 11:44:18.193374 | mon1 | "changed": false, 2026-08-18 11:44:18.193604 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:18.193969 | mon1 | } 2026-08-18 11:44:18.194208 | mon1 | ok: [mon2] => { 2026-08-18 11:44:18.194444 | mon1 | "changed": false, 2026-08-18 11:44:18.194674 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:18.194976 | mon1 | } 2026-08-18 11:44:18.195213 | mon1 | ok: [mon3] => { 2026-08-18 11:44:18.195436 | mon1 | "changed": false, 2026-08-18 11:44:18.195697 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:18.195985 | mon1 | } 2026-08-18 11:44:18.196233 | mon1 | 2026-08-18 11:44:18.196615 | mon1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 11:44:18.196943 | mon1 | Tuesday 18 August 2026 11:44:18 +0000 (0:00:00.088) 0:02:13.377 ******** 2026-08-18 11:44:18.663780 | mon1 | ok: [mon1] 2026-08-18 11:44:18.664002 | mon1 | changed: [mon3] 2026-08-18 11:44:18.664265 | mon1 | changed: [mon2] 2026-08-18 11:44:18.664501 | mon1 | 2026-08-18 11:44:18.664793 | mon1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 11:44:18.665145 | mon1 | Tuesday 18 August 2026 11:44:18 +0000 (0:00:00.470) 0:02:13.848 ******** 2026-08-18 11:44:18.746180 | mon1 | ok: [mon1] 2026-08-18 11:44:18.746359 | mon1 | ok: [mon2] 2026-08-18 11:44:18.746589 | mon1 | ok: [mon3] 2026-08-18 11:44:18.746807 | mon1 | 2026-08-18 11:44:18.747164 | mon1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 11:44:18.747353 | mon1 | Tuesday 18 August 2026 11:44:18 +0000 (0:00:00.082) 0:02:13.930 ******** 2026-08-18 11:44:18.862256 | mon1 | ok: [mon1] 2026-08-18 11:44:18.862455 | mon1 | ok: [mon2] 2026-08-18 11:44:18.862703 | mon1 | ok: [mon3] 2026-08-18 11:44:18.862977 | mon1 | 2026-08-18 11:44:18.863256 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 11:44:18.863517 | mon1 | Tuesday 18 August 2026 11:44:18 +0000 (0:00:00.115) 0:02:14.046 ******** 2026-08-18 11:44:18.968846 | mon1 | ok: [mon1] => { 2026-08-18 11:44:18.969023 | mon1 | "changed": false, 2026-08-18 11:44:18.969174 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:18.969381 | mon1 | } 2026-08-18 11:44:18.969461 | mon1 | ok: [mon2] => { 2026-08-18 11:44:18.969607 | mon1 | "changed": false, 2026-08-18 11:44:18.969912 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:18.970061 | mon1 | } 2026-08-18 11:44:18.970209 | mon1 | ok: [mon3] => { 2026-08-18 11:44:18.970357 | mon1 | "changed": false, 2026-08-18 11:44:18.970505 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:18.970646 | mon1 | } 2026-08-18 11:44:18.970776 | mon1 | 2026-08-18 11:44:18.970957 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 11:44:18.971103 | mon1 | Tuesday 18 August 2026 11:44:18 +0000 (0:00:00.106) 0:02:14.153 ******** 2026-08-18 11:44:40.141296 | mon1 | changed: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:44:40.141389 | mon1 | changed: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:44:40.141482 | mon1 | changed: [mon1] 2026-08-18 11:44:40.141587 | mon1 | 2026-08-18 11:44:40.144008 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 11:44:40.144060 | mon1 | Tuesday 18 August 2026 11:44:40 +0000 (0:00:21.172) 0:02:35.326 ******** 2026-08-18 11:44:40.259639 | mon1 | skipping: [mon1] 2026-08-18 11:44:40.259859 | mon1 | skipping: [mon2] 2026-08-18 11:44:40.260162 | mon1 | skipping: [mon3] 2026-08-18 11:44:40.260392 | mon1 | 2026-08-18 11:44:40.260627 | mon1 | TASK [vexxhost.ceph.mon : Apply the monitor service spec] ********************** 2026-08-18 11:44:40.260929 | mon1 | Tuesday 18 August 2026 11:44:40 +0000 (0:00:00.118) 0:02:35.444 ******** 2026-08-18 11:44:43.673954 | mon1 | changed: [mon1] 2026-08-18 11:44:43.674014 | mon1 | 2026-08-18 11:44:43.674028 | mon1 | TASK [vexxhost.ceph.mon : Wait for this monitor's daemon to be present] ******** 2026-08-18 11:44:43.674041 | mon1 | Tuesday 18 August 2026 11:44:43 +0000 (0:00:03.413) 0:02:38.857 ******** 2026-08-18 11:44:50.110246 | mon1 | ok: [mon1] 2026-08-18 11:44:50.110304 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:44:50.110318 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:44:50.110330 | mon1 | 2026-08-18 11:44:50.110342 | mon1 | TASK [vexxhost.ceph.mgr : Locate the cluster admin host] *********************** 2026-08-18 11:44:50.110354 | mon1 | Tuesday 18 August 2026 11:44:50 +0000 (0:00:06.434) 0:02:45.292 ******** 2026-08-18 11:44:50.852052 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:44:50.852105 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:44:50.852124 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:44:50.852375 | mon1 | 2026-08-18 11:44:50.852748 | mon1 | TASK [vexxhost.ceph.mgr : Select the admin host] ******************************* 2026-08-18 11:44:50.853146 | mon1 | Tuesday 18 August 2026 11:44:50 +0000 (0:00:00.743) 0:02:46.035 ******** 2026-08-18 11:44:50.942555 | mon1 | ok: [mon1] 2026-08-18 11:44:50.942846 | mon1 | ok: [mon2] 2026-08-18 11:44:50.943174 | mon1 | ok: [mon3] 2026-08-18 11:44:50.943439 | mon1 | 2026-08-18 11:44:50.943731 | mon1 | TASK [Register this manager host] ********************************************** 2026-08-18 11:44:50.944107 | mon1 | Tuesday 18 August 2026 11:44:50 +0000 (0:00:00.091) 0:02:46.127 ******** 2026-08-18 11:44:51.096335 | mon1 | included: vexxhost.ceph.cephadm_host for mon1, mon2, mon3 2026-08-18 11:44:51.096413 | mon1 | 2026-08-18 11:44:51.096472 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 11:44:51.096600 | mon1 | Tuesday 18 August 2026 11:44:51 +0000 (0:00:00.153) 0:02:46.280 ******** 2026-08-18 11:44:52.888625 | mon1 | ok: [mon1] 2026-08-18 11:44:52.888848 | mon1 | 2026-08-18 11:44:52.889174 | mon1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 11:44:52.889436 | mon1 | Tuesday 18 August 2026 11:44:52 +0000 (0:00:01.792) 0:02:48.072 ******** 2026-08-18 11:44:52.984690 | mon1 | ok: [mon1] 2026-08-18 11:44:52.984929 | mon1 | ok: [mon2] 2026-08-18 11:44:52.985161 | mon1 | ok: [mon3] 2026-08-18 11:44:52.985367 | mon1 | 2026-08-18 11:44:52.985618 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 11:44:52.985900 | mon1 | Tuesday 18 August 2026 11:44:52 +0000 (0:00:00.096) 0:02:48.169 ******** 2026-08-18 11:44:53.077277 | mon1 | ok: [mon1] => { 2026-08-18 11:44:53.077501 | mon1 | "changed": false, 2026-08-18 11:44:53.077741 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:53.078006 | mon1 | } 2026-08-18 11:44:53.078242 | mon1 | ok: [mon2] => { 2026-08-18 11:44:53.078474 | mon1 | "changed": false, 2026-08-18 11:44:53.078709 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:53.079034 | mon1 | } 2026-08-18 11:44:53.079276 | mon1 | ok: [mon3] => { 2026-08-18 11:44:53.079509 | mon1 | "changed": false, 2026-08-18 11:44:53.079747 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:53.080006 | mon1 | } 2026-08-18 11:44:53.080220 | mon1 | 2026-08-18 11:44:53.080474 | mon1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 11:44:53.080717 | mon1 | Tuesday 18 August 2026 11:44:53 +0000 (0:00:00.092) 0:02:48.262 ******** 2026-08-18 11:44:53.461597 | mon1 | ok: [mon2] 2026-08-18 11:44:53.461822 | mon1 | ok: [mon1] 2026-08-18 11:44:53.462097 | mon1 | ok: [mon3] 2026-08-18 11:44:53.462314 | mon1 | 2026-08-18 11:44:53.462580 | mon1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 11:44:53.462829 | mon1 | Tuesday 18 August 2026 11:44:53 +0000 (0:00:00.384) 0:02:48.646 ******** 2026-08-18 11:44:53.569421 | mon1 | ok: [mon1] 2026-08-18 11:44:53.569601 | mon1 | ok: [mon2] 2026-08-18 11:44:53.569847 | mon1 | ok: [mon3] 2026-08-18 11:44:53.570116 | mon1 | 2026-08-18 11:44:53.570381 | mon1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 11:44:53.570620 | mon1 | Tuesday 18 August 2026 11:44:53 +0000 (0:00:00.107) 0:02:48.753 ******** 2026-08-18 11:44:53.700362 | mon1 | ok: [mon1] 2026-08-18 11:44:53.700540 | mon1 | ok: [mon2] 2026-08-18 11:44:53.700766 | mon1 | ok: [mon3] 2026-08-18 11:44:53.701023 | mon1 | 2026-08-18 11:44:53.701276 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 11:44:53.701540 | mon1 | Tuesday 18 August 2026 11:44:53 +0000 (0:00:00.131) 0:02:48.884 ******** 2026-08-18 11:44:53.795443 | mon1 | ok: [mon1] => { 2026-08-18 11:44:53.795624 | mon1 | "changed": false, 2026-08-18 11:44:53.795862 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:53.796153 | mon1 | } 2026-08-18 11:44:53.796395 | mon1 | ok: [mon2] => { 2026-08-18 11:44:53.796655 | mon1 | "changed": false, 2026-08-18 11:44:53.796921 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:53.797179 | mon1 | } 2026-08-18 11:44:53.797422 | mon1 | ok: [mon3] => { 2026-08-18 11:44:53.797654 | mon1 | "changed": false, 2026-08-18 11:44:53.797914 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:53.798154 | mon1 | } 2026-08-18 11:44:53.798375 | mon1 | 2026-08-18 11:44:53.798627 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 11:44:53.798891 | mon1 | Tuesday 18 August 2026 11:44:53 +0000 (0:00:00.094) 0:02:48.979 ******** 2026-08-18 11:44:55.632169 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:44:55.632394 | mon1 | ok: [mon1] 2026-08-18 11:44:55.632639 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:44:55.632856 | mon1 | 2026-08-18 11:44:55.633138 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 11:44:55.633375 | mon1 | Tuesday 18 August 2026 11:44:55 +0000 (0:00:01.836) 0:02:50.816 ******** 2026-08-18 11:44:55.753060 | mon1 | skipping: [mon1] 2026-08-18 11:44:55.753122 | mon1 | skipping: [mon2] 2026-08-18 11:44:55.753214 | mon1 | skipping: [mon3] 2026-08-18 11:44:55.753314 | mon1 | 2026-08-18 11:44:55.753430 | mon1 | TASK [vexxhost.ceph.mgr : Apply the manager service spec] ********************** 2026-08-18 11:44:55.753566 | mon1 | Tuesday 18 August 2026 11:44:55 +0000 (0:00:00.120) 0:02:50.937 ******** 2026-08-18 11:44:59.221304 | mon1 | changed: [mon1] 2026-08-18 11:44:59.221367 | mon1 | 2026-08-18 11:44:59.221468 | mon1 | TASK [vexxhost.ceph.mgr : Wait for this manager's daemon to be present] ******** 2026-08-18 11:44:59.221575 | mon1 | Tuesday 18 August 2026 11:44:59 +0000 (0:00:03.467) 0:02:54.405 ******** 2026-08-18 11:45:05.506034 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:45:05.506145 | mon1 | ok: [mon1] 2026-08-18 11:45:05.506167 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:45:05.506876 | mon1 | 2026-08-18 11:45:05.506965 | mon1 | TASK [vexxhost.ceph.mgr : Configure ceph-mgr modules] ************************** 2026-08-18 11:45:05.506980 | mon1 | Tuesday 18 August 2026 11:45:05 +0000 (0:00:06.284) 0:03:00.690 ******** 2026-08-18 11:45:13.471347 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-08-18 11:45:13.471418 | mon1 | changed: [mon1] => (item={'name': 'dashboard'}) 2026-08-18 11:45:13.471527 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-08-18 11:45:13.471735 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-08-18 11:45:13.471769 | mon1 | 2026-08-18 11:45:13.471949 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-08-18 11:45:13.472030 | mon1 | 2026-08-18 11:45:13.472148 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:45:13.472247 | mon1 | Tuesday 18 August 2026 11:45:13 +0000 (0:00:07.963) 0:03:08.654 ******** 2026-08-18 11:45:14.682314 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-08-18 11:45:14.682425 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 11:45:14.682475 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:45:14.682591 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:45:14.682711 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:45:14.750972 | mon1 | ok: [mon1] 2026-08-18 11:45:14.751054 | mon1 | ok: [mon2] 2026-08-18 11:45:14.751139 | mon1 | ok: [mon3] 2026-08-18 11:45:14.751245 | mon1 | ok: [osd1] 2026-08-18 11:45:14.751486 | mon1 | 2026-08-18 11:45:14.751513 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:45:14.751569 | mon1 | Tuesday 18 August 2026 11:45:14 +0000 (0:00:01.279) 0:03:09.933 ******** 2026-08-18 11:45:15.083163 | mon1 | ok: [mon2] 2026-08-18 11:45:15.083219 | mon1 | ok: [mon1] 2026-08-18 11:45:15.083229 | mon1 | ok: [mon3] 2026-08-18 11:45:15.083238 | mon1 | ok: [osd1] 2026-08-18 11:45:15.083247 | mon1 | 2026-08-18 11:45:15.083256 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:45:15.083265 | mon1 | Tuesday 18 August 2026 11:45:15 +0000 (0:00:00.332) 0:03:10.266 ******** 2026-08-18 11:45:15.120377 | mon1 | skipping: [mon1] 2026-08-18 11:45:15.188736 | mon1 | skipping: [mon2] 2026-08-18 11:45:15.249357 | mon1 | skipping: [mon3] 2026-08-18 11:45:15.249424 | mon1 | skipping: [osd1] 2026-08-18 11:45:15.249431 | mon1 | 2026-08-18 11:45:15.249437 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 11:45:15.249444 | mon1 | Tuesday 18 August 2026 11:45:15 +0000 (0:00:00.166) 0:03:10.432 ******** 2026-08-18 11:45:15.578238 | mon1 | ok: [mon1] 2026-08-18 11:45:15.578293 | mon1 | ok: [mon2] 2026-08-18 11:45:15.578303 | mon1 | ok: [mon3] 2026-08-18 11:45:15.578312 | mon1 | changed: [osd1] 2026-08-18 11:45:15.578321 | mon1 | 2026-08-18 11:45:15.578330 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:45:15.578339 | mon1 | Tuesday 18 August 2026 11:45:15 +0000 (0:00:00.328) 0:03:10.761 ******** 2026-08-18 11:45:15.684016 | mon1 | ok: [mon1] => { 2026-08-18 11:45:15.684055 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:45:15.684065 | mon1 | } 2026-08-18 11:45:15.684074 | mon1 | ok: [mon2] => { 2026-08-18 11:45:15.684185 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:45:15.684418 | mon1 | } 2026-08-18 11:45:15.684661 | mon1 | ok: [mon3] => { 2026-08-18 11:45:15.684954 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:45:15.685189 | mon1 | } 2026-08-18 11:45:15.685424 | mon1 | ok: [osd1] => { 2026-08-18 11:45:15.685712 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:45:15.685974 | mon1 | } 2026-08-18 11:45:15.686186 | mon1 | 2026-08-18 11:45:15.686434 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:45:15.686677 | mon1 | Tuesday 18 August 2026 11:45:15 +0000 (0:00:00.106) 0:03:10.867 ******** 2026-08-18 11:45:16.483530 | mon1 | ok: [mon1] 2026-08-18 11:45:16.483755 | mon1 | ok: [mon2] 2026-08-18 11:45:16.484156 | mon1 | ok: [mon3] 2026-08-18 11:45:16.484391 | mon1 | changed: [osd1] 2026-08-18 11:45:16.484628 | mon1 | 2026-08-18 11:45:16.484913 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:45:16.485218 | mon1 | Tuesday 18 August 2026 11:45:16 +0000 (0:00:00.800) 0:03:11.668 ******** 2026-08-18 11:45:16.537223 | mon1 | skipping: [mon1] 2026-08-18 11:45:16.617268 | mon1 | skipping: [mon2] 2026-08-18 11:45:16.617450 | mon1 | skipping: [mon3] 2026-08-18 11:45:16.617687 | mon1 | skipping: [osd1] 2026-08-18 11:45:16.617938 | mon1 | 2026-08-18 11:45:16.618195 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:45:16.618488 | mon1 | Tuesday 18 August 2026 11:45:16 +0000 (0:00:00.133) 0:03:11.801 ******** 2026-08-18 11:45:16.672514 | mon1 | skipping: [mon1] 2026-08-18 11:45:16.755137 | mon1 | skipping: [mon2] 2026-08-18 11:45:16.755353 | mon1 | skipping: [mon3] 2026-08-18 11:45:16.755589 | mon1 | skipping: [osd1] 2026-08-18 11:45:16.755813 | mon1 | 2026-08-18 11:45:16.756164 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:45:16.756351 | mon1 | Tuesday 18 August 2026 11:45:16 +0000 (0:00:00.137) 0:03:11.939 ******** 2026-08-18 11:45:17.074187 | mon1 | ok: [mon1] 2026-08-18 11:45:17.074404 | mon1 | ok: [mon2] 2026-08-18 11:45:17.074730 | mon1 | ok: [mon3] 2026-08-18 11:45:17.075038 | mon1 | ok: [osd1] 2026-08-18 11:45:17.075264 | mon1 | 2026-08-18 11:45:17.075542 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:45:17.075908 | mon1 | Tuesday 18 August 2026 11:45:17 +0000 (0:00:00.319) 0:03:12.258 ******** 2026-08-18 11:45:18.305736 | mon1 | ok: [mon1] 2026-08-18 11:45:18.306148 | mon1 | ok: [mon2] 2026-08-18 11:45:18.306444 | mon1 | ok: [osd1] 2026-08-18 11:45:18.306709 | mon1 | ok: [mon3] 2026-08-18 11:45:18.306972 | mon1 | 2026-08-18 11:45:18.307367 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:45:18.307619 | mon1 | Tuesday 18 August 2026 11:45:18 +0000 (0:00:01.231) 0:03:13.490 ******** 2026-08-18 11:45:18.423521 | mon1 | ok: [mon1] => { 2026-08-18 11:45:18.423776 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:45:18.424060 | mon1 | } 2026-08-18 11:45:18.424302 | mon1 | ok: [mon2] => { 2026-08-18 11:45:18.424559 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:45:18.424804 | mon1 | } 2026-08-18 11:45:18.425077 | mon1 | ok: [mon3] => { 2026-08-18 11:45:18.425331 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:45:18.425562 | mon1 | } 2026-08-18 11:45:18.425807 | mon1 | ok: [osd1] => { 2026-08-18 11:45:18.426086 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:45:18.426311 | mon1 | } 2026-08-18 11:45:18.426619 | mon1 | 2026-08-18 11:45:18.426901 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:45:18.427230 | mon1 | Tuesday 18 August 2026 11:45:18 +0000 (0:00:00.117) 0:03:13.608 ******** 2026-08-18 11:45:19.383246 | mon1 | ok: [mon1] 2026-08-18 11:45:19.383465 | mon1 | ok: [mon2] 2026-08-18 11:45:19.383741 | mon1 | ok: [mon3] 2026-08-18 11:45:19.384121 | mon1 | changed: [osd1] 2026-08-18 11:45:19.384325 | mon1 | 2026-08-18 11:45:19.384604 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:45:19.384913 | mon1 | Tuesday 18 August 2026 11:45:19 +0000 (0:00:00.959) 0:03:14.567 ******** 2026-08-18 11:45:22.411042 | mon1 | ok: [mon1] 2026-08-18 11:45:22.411103 | mon1 | ok: [mon3] 2026-08-18 11:45:22.411113 | mon1 | ok: [mon2] 2026-08-18 11:45:22.412061 | mon1 | changed: [osd1] 2026-08-18 11:45:22.412123 | mon1 | 2026-08-18 11:45:22.412133 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 11:45:22.412143 | mon1 | Tuesday 18 August 2026 11:45:22 +0000 (0:00:03.027) 0:03:17.595 ******** 2026-08-18 11:45:22.458515 | mon1 | skipping: [mon1] 2026-08-18 11:45:22.488032 | mon1 | skipping: [mon2] 2026-08-18 11:45:22.488083 | mon1 | skipping: [mon3] 2026-08-18 11:45:22.488093 | mon1 | skipping: [osd1] 2026-08-18 11:45:22.488102 | mon1 | 2026-08-18 11:45:22.488111 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 11:45:22.488120 | mon1 | Tuesday 18 August 2026 11:45:22 +0000 (0:00:00.075) 0:03:17.670 ******** 2026-08-18 11:45:22.541469 | mon1 | skipping: [mon1] 2026-08-18 11:45:22.576002 | mon1 | skipping: [mon2] 2026-08-18 11:45:22.576040 | mon1 | skipping: [mon3] 2026-08-18 11:45:22.576050 | mon1 | skipping: [osd1] 2026-08-18 11:45:22.576060 | mon1 | 2026-08-18 11:45:22.576069 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 11:45:22.576078 | mon1 | Tuesday 18 August 2026 11:45:22 +0000 (0:00:00.087) 0:03:17.758 ******** 2026-08-18 11:45:22.621709 | mon1 | skipping: [mon1] 2026-08-18 11:45:22.661195 | mon1 | skipping: [mon2] 2026-08-18 11:45:22.661262 | mon1 | skipping: [mon3] 2026-08-18 11:45:22.661372 | mon1 | skipping: [osd1] 2026-08-18 11:45:22.661464 | mon1 | 2026-08-18 11:45:22.661576 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 11:45:22.661680 | mon1 | Tuesday 18 August 2026 11:45:22 +0000 (0:00:00.086) 0:03:17.845 ******** 2026-08-18 11:45:35.464392 | mon1 | ok: [mon1] 2026-08-18 11:45:35.464484 | mon1 | ok: [mon2] 2026-08-18 11:45:35.464642 | mon1 | ok: [mon3] 2026-08-18 11:45:35.464798 | mon1 | changed: [osd1] 2026-08-18 11:45:35.464999 | mon1 | 2026-08-18 11:45:35.465160 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 11:45:35.465304 | mon1 | Tuesday 18 August 2026 11:45:35 +0000 (0:00:12.802) 0:03:30.648 ******** 2026-08-18 11:45:36.132280 | mon1 | ok: [mon1] 2026-08-18 11:45:36.132367 | mon1 | ok: [mon2] 2026-08-18 11:45:36.132474 | mon1 | ok: [mon3] 2026-08-18 11:45:36.132586 | mon1 | changed: [osd1] 2026-08-18 11:45:36.132688 | mon1 | 2026-08-18 11:45:36.132815 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 11:45:36.132951 | mon1 | Tuesday 18 August 2026 11:45:36 +0000 (0:00:00.666) 0:03:31.315 ******** 2026-08-18 11:45:37.354934 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:45:37.354979 | mon1 | ok: [mon2] => (item={'path': '/etc/containerd'}) 2026-08-18 11:45:37.354986 | mon1 | ok: [mon3] => (item={'path': '/etc/containerd'}) 2026-08-18 11:45:37.354992 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:45:37.354999 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:45:37.355006 | mon1 | ok: [mon2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:45:37.355012 | mon1 | ok: [mon3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:45:37.355018 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:45:37.355024 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:45:37.355030 | mon1 | ok: [mon2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:45:37.355036 | mon1 | ok: [mon3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:45:37.355042 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:45:37.355048 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:45:37.355054 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:45:37.355060 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:45:37.355065 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:45:37.355072 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:45:37.355077 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:45:37.355083 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:45:37.355240 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:45:37.355396 | mon1 | 2026-08-18 11:45:37.355565 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 11:45:37.355744 | mon1 | Tuesday 18 August 2026 11:45:37 +0000 (0:00:01.221) 0:03:32.536 ******** 2026-08-18 11:45:38.177197 | mon1 | ok: [mon1] 2026-08-18 11:45:38.177322 | mon1 | ok: [mon3] 2026-08-18 11:45:38.177337 | mon1 | ok: [mon2] 2026-08-18 11:45:38.177482 | mon1 | changed: [osd1] 2026-08-18 11:45:38.177549 | mon1 | 2026-08-18 11:45:38.177675 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:45:38.177789 | mon1 | Tuesday 18 August 2026 11:45:38 +0000 (0:00:00.798) 0:03:33.335 ******** 2026-08-18 11:45:38.177899 | mon1 | 2026-08-18 11:45:38.178005 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:45:38.179044 | mon1 | Tuesday 18 August 2026 11:45:38 +0000 (0:00:00.006) 0:03:33.341 ******** 2026-08-18 11:45:38.179096 | mon1 | 2026-08-18 11:45:38.179107 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:45:38.179115 | mon1 | Tuesday 18 August 2026 11:45:38 +0000 (0:00:00.005) 0:03:33.347 ******** 2026-08-18 11:45:38.179123 | mon1 | 2026-08-18 11:45:38.179151 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:45:38.179159 | mon1 | Tuesday 18 August 2026 11:45:38 +0000 (0:00:00.005) 0:03:33.352 ******** 2026-08-18 11:45:38.179167 | mon1 | 2026-08-18 11:45:38.179175 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 11:45:38.179189 | mon1 | Tuesday 18 August 2026 11:45:38 +0000 (0:00:00.006) 0:03:33.359 ******** 2026-08-18 11:45:39.098105 | mon1 | ok: [osd1] 2026-08-18 11:45:39.098193 | mon1 | 2026-08-18 11:45:39.098308 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-08-18 11:45:39.098477 | mon1 | Tuesday 18 August 2026 11:45:39 +0000 (0:00:00.923) 0:03:34.282 ******** 2026-08-18 11:45:39.670748 | mon1 | changed: [osd1] 2026-08-18 11:45:39.670952 | mon1 | 2026-08-18 11:45:39.671237 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 11:45:39.671495 | mon1 | Tuesday 18 August 2026 11:45:39 +0000 (0:00:00.572) 0:03:34.854 ******** 2026-08-18 11:45:40.481563 | mon1 | ok: [mon1] 2026-08-18 11:45:40.481652 | mon1 | ok: [mon2] 2026-08-18 11:45:40.481665 | mon1 | ok: [mon3] 2026-08-18 11:45:40.481780 | mon1 | changed: [osd1] 2026-08-18 11:45:40.481899 | mon1 | 2026-08-18 11:45:40.482024 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:45:40.482135 | mon1 | Tuesday 18 August 2026 11:45:40 +0000 (0:00:00.811) 0:03:35.665 ******** 2026-08-18 11:45:40.896953 | mon1 | ok: [mon1] 2026-08-18 11:45:40.897355 | mon1 | ok: [mon2] 2026-08-18 11:45:40.897638 | mon1 | ok: [mon3] 2026-08-18 11:45:40.897911 | mon1 | ok: [osd1] 2026-08-18 11:45:40.898155 | mon1 | 2026-08-18 11:45:40.898522 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:45:40.898797 | mon1 | Tuesday 18 August 2026 11:45:40 +0000 (0:00:00.415) 0:03:36.081 ******** 2026-08-18 11:45:41.034657 | mon1 | ok: [mon1] => { 2026-08-18 11:45:41.035052 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:45:41.035354 | mon1 | } 2026-08-18 11:45:41.035644 | mon1 | ok: [mon2] => { 2026-08-18 11:45:41.036002 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:45:41.036282 | mon1 | } 2026-08-18 11:45:41.036602 | mon1 | ok: [mon3] => { 2026-08-18 11:45:41.036932 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:45:41.037214 | mon1 | } 2026-08-18 11:45:41.037493 | mon1 | ok: [osd1] => { 2026-08-18 11:45:41.038006 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:45:41.038284 | mon1 | } 2026-08-18 11:45:41.038546 | mon1 | 2026-08-18 11:45:41.038902 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:45:41.039189 | mon1 | Tuesday 18 August 2026 11:45:41 +0000 (0:00:00.137) 0:03:36.218 ******** 2026-08-18 11:45:42.191748 | mon1 | ok: [mon1] 2026-08-18 11:45:42.191994 | mon1 | ok: [mon2] 2026-08-18 11:45:42.192283 | mon1 | ok: [mon3] 2026-08-18 11:45:42.192559 | mon1 | changed: [osd1] 2026-08-18 11:45:42.192799 | mon1 | 2026-08-18 11:45:42.193140 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:45:42.193421 | mon1 | Tuesday 18 August 2026 11:45:42 +0000 (0:00:01.156) 0:03:37.375 ******** 2026-08-18 11:45:46.902016 | mon1 | ok: [mon1] 2026-08-18 11:45:46.902078 | mon1 | ok: [mon3] 2026-08-18 11:45:46.902089 | mon1 | ok: [mon2] 2026-08-18 11:45:46.902097 | mon1 | changed: [osd1] 2026-08-18 11:45:46.902106 | mon1 | 2026-08-18 11:45:46.902476 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 11:45:46.902518 | mon1 | Tuesday 18 August 2026 11:45:46 +0000 (0:00:04.709) 0:03:42.085 ******** 2026-08-18 11:45:48.180107 | mon1 | ok: [mon2] 2026-08-18 11:45:48.180149 | mon1 | ok: [mon1] 2026-08-18 11:45:48.180159 | mon1 | ok: [osd1] 2026-08-18 11:45:48.180167 | mon1 | ok: [mon3] 2026-08-18 11:45:48.180176 | mon1 | 2026-08-18 11:45:48.180185 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 11:45:48.180194 | mon1 | Tuesday 18 August 2026 11:45:48 +0000 (0:00:01.276) 0:03:43.362 ******** 2026-08-18 11:45:48.553417 | mon1 | ok: [mon1] 2026-08-18 11:45:48.553461 | mon1 | ok: [mon2] 2026-08-18 11:45:48.553467 | mon1 | ok: [mon3] 2026-08-18 11:45:48.553472 | mon1 | changed: [osd1] 2026-08-18 11:45:48.553478 | mon1 | 2026-08-18 11:45:48.553484 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 11:45:48.553490 | mon1 | Tuesday 18 August 2026 11:45:48 +0000 (0:00:00.374) 0:03:43.736 ******** 2026-08-18 11:45:49.203227 | mon1 | ok: [mon1] 2026-08-18 11:45:49.203289 | mon1 | ok: [mon2] 2026-08-18 11:45:49.203298 | mon1 | ok: [mon3] 2026-08-18 11:45:49.203307 | mon1 | changed: [osd1] 2026-08-18 11:45:49.203315 | mon1 | 2026-08-18 11:45:49.203324 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 11:45:49.203333 | mon1 | Tuesday 18 August 2026 11:45:49 +0000 (0:00:00.649) 0:03:44.385 ******** 2026-08-18 11:45:49.981931 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 11:45:49.981989 | mon1 | ok: [mon2] => (item={'path': '/etc/docker'}) 2026-08-18 11:45:49.981999 | mon1 | ok: [mon3] => (item={'path': '/etc/docker'}) 2026-08-18 11:45:49.982008 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-08-18 11:45:49.982016 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:45:49.982025 | mon1 | ok: [mon2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:45:49.982033 | mon1 | ok: [mon3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:45:49.982041 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:45:49.982050 | mon1 | ok: [mon2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:45:49.982123 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:45:49.982434 | mon1 | ok: [mon3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:45:49.982745 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:45:49.983064 | mon1 | 2026-08-18 11:45:49.983386 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 11:45:49.983693 | mon1 | Tuesday 18 August 2026 11:45:49 +0000 (0:00:00.778) 0:03:45.163 ******** 2026-08-18 11:45:50.638704 | mon1 | ok: [mon1] 2026-08-18 11:45:50.639198 | mon1 | ok: [mon2] 2026-08-18 11:45:50.639595 | mon1 | ok: [mon3] 2026-08-18 11:45:50.640037 | mon1 | changed: [osd1] 2026-08-18 11:45:50.640428 | mon1 | 2026-08-18 11:45:50.640772 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 11:45:50.641208 | mon1 | Tuesday 18 August 2026 11:45:50 +0000 (0:00:00.658) 0:03:45.822 ******** 2026-08-18 11:45:51.304605 | mon1 | ok: [mon1] 2026-08-18 11:45:51.305030 | mon1 | ok: [mon2] 2026-08-18 11:45:51.305344 | mon1 | ok: [mon3] 2026-08-18 11:45:51.305645 | mon1 | changed: [osd1] 2026-08-18 11:45:51.305967 | mon1 | 2026-08-18 11:45:51.306291 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:45:51.307012 | mon1 | Tuesday 18 August 2026 11:45:51 +0000 (0:00:00.640) 0:03:46.463 ******** 2026-08-18 11:45:51.307339 | mon1 | 2026-08-18 11:45:51.307778 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:45:51.308119 | mon1 | Tuesday 18 August 2026 11:45:51 +0000 (0:00:00.006) 0:03:46.469 ******** 2026-08-18 11:45:51.309133 | mon1 | 2026-08-18 11:45:51.309155 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:45:51.309164 | mon1 | Tuesday 18 August 2026 11:45:51 +0000 (0:00:00.006) 0:03:46.475 ******** 2026-08-18 11:45:51.309252 | mon1 | 2026-08-18 11:45:51.309555 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:45:51.309859 | mon1 | Tuesday 18 August 2026 11:45:51 +0000 (0:00:00.006) 0:03:46.482 ******** 2026-08-18 11:45:51.310196 | mon1 | 2026-08-18 11:45:51.310505 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 11:45:51.310806 | mon1 | Tuesday 18 August 2026 11:45:51 +0000 (0:00:00.006) 0:03:46.488 ******** 2026-08-18 11:45:52.236277 | mon1 | ok: [osd1] 2026-08-18 11:45:52.236647 | mon1 | 2026-08-18 11:45:52.237068 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-08-18 11:45:52.237487 | mon1 | Tuesday 18 August 2026 11:45:52 +0000 (0:00:00.932) 0:03:47.420 ******** 2026-08-18 11:45:53.274432 | mon1 | changed: [osd1] 2026-08-18 11:45:53.274643 | mon1 | 2026-08-18 11:45:53.274840 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 11:45:53.275203 | mon1 | Tuesday 18 August 2026 11:45:53 +0000 (0:00:01.038) 0:03:48.459 ******** 2026-08-18 11:45:54.773928 | mon1 | ok: [mon1] 2026-08-18 11:45:54.774179 | mon1 | ok: [mon2] 2026-08-18 11:45:54.774382 | mon1 | changed: [osd1] 2026-08-18 11:45:54.774575 | mon1 | ok: [mon3] 2026-08-18 11:45:54.774759 | mon1 | 2026-08-18 11:45:54.775165 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:45:54.775182 | mon1 | Tuesday 18 August 2026 11:45:54 +0000 (0:00:01.499) 0:03:49.958 ******** 2026-08-18 11:45:54.841365 | mon1 | ok: [mon1] => { 2026-08-18 11:45:54.841420 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:45:54.841430 | mon1 | } 2026-08-18 11:45:54.878040 | mon1 | ok: [mon2] => { 2026-08-18 11:45:54.878120 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:45:54.878140 | mon1 | } 2026-08-18 11:45:54.878969 | mon1 | ok: [mon3] => { 2026-08-18 11:45:54.879018 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:45:54.879028 | mon1 | } 2026-08-18 11:45:54.879925 | mon1 | ok: [osd1] => { 2026-08-18 11:45:54.879982 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:45:54.879993 | mon1 | } 2026-08-18 11:45:54.880003 | mon1 | 2026-08-18 11:45:54.880340 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:45:54.880667 | mon1 | Tuesday 18 August 2026 11:45:54 +0000 (0:00:00.103) 0:03:50.061 ******** 2026-08-18 11:45:56.009452 | mon1 | ok: [mon1] 2026-08-18 11:45:56.009723 | mon1 | ok: [mon2] 2026-08-18 11:45:56.010018 | mon1 | ok: [mon3] 2026-08-18 11:45:56.010273 | mon1 | changed: [osd1] 2026-08-18 11:45:56.010498 | mon1 | 2026-08-18 11:45:56.010765 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:45:56.011051 | mon1 | Tuesday 18 August 2026 11:45:56 +0000 (0:00:01.132) 0:03:51.194 ******** 2026-08-18 11:45:56.061558 | mon1 | skipping: [mon1] 2026-08-18 11:45:56.129649 | mon1 | skipping: [mon2] 2026-08-18 11:45:56.129927 | mon1 | skipping: [mon3] 2026-08-18 11:45:56.130154 | mon1 | skipping: [osd1] 2026-08-18 11:45:56.130359 | mon1 | 2026-08-18 11:45:56.130767 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 11:45:56.130779 | mon1 | Tuesday 18 August 2026 11:45:56 +0000 (0:00:00.120) 0:03:51.314 ******** 2026-08-18 11:45:56.186106 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:45:56.186144 | mon1 | ok: [mon2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:45:56.246230 | mon1 | ok: [mon3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:45:56.246336 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:45:56.246386 | mon1 | 2026-08-18 11:45:56.246396 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 11:45:56.246420 | mon1 | Tuesday 18 August 2026 11:45:56 +0000 (0:00:00.114) 0:03:51.428 ******** 2026-08-18 11:45:57.483065 | mon1 | ok: [mon1] 2026-08-18 11:45:57.483114 | mon1 | ok: [mon2] 2026-08-18 11:45:57.483124 | mon1 | ok: [osd1] 2026-08-18 11:45:57.483132 | mon1 | ok: [mon3] 2026-08-18 11:45:57.483141 | mon1 | 2026-08-18 11:45:57.483150 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 11:45:57.483159 | mon1 | Tuesday 18 August 2026 11:45:57 +0000 (0:00:01.237) 0:03:52.666 ******** 2026-08-18 11:45:58.369245 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-08-18 11:45:58.369291 | mon1 | ok: [mon2] => (item=systemd-timesyncd) 2026-08-18 11:45:58.369297 | mon1 | ok: [mon3] => (item=systemd-timesyncd) 2026-08-18 11:45:58.369302 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-08-18 11:45:58.369307 | mon1 | ok: [mon1] => (item=ssh) 2026-08-18 11:45:58.369313 | mon1 | ok: [mon2] => (item=ssh) 2026-08-18 11:45:58.369318 | mon1 | ok: [mon3] => (item=ssh) 2026-08-18 11:45:58.369323 | mon1 | ok: [osd1] => (item=ssh) 2026-08-18 11:45:58.369328 | mon1 | 2026-08-18 11:45:58.369334 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 11:45:58.369339 | mon1 | Tuesday 18 August 2026 11:45:58 +0000 (0:00:00.884) 0:03:53.550 ******** 2026-08-18 11:45:58.683184 | mon1 | ok: [mon1] 2026-08-18 11:45:58.683230 | mon1 | ok: [mon2] 2026-08-18 11:45:58.683240 | mon1 | ok: [mon3] 2026-08-18 11:45:58.683249 | mon1 | ok: [osd1] 2026-08-18 11:45:58.683258 | mon1 | 2026-08-18 11:45:58.683267 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 11:45:58.683276 | mon1 | Tuesday 18 August 2026 11:45:58 +0000 (0:00:00.314) 0:03:53.865 ******** 2026-08-18 11:45:59.114291 | mon1 | ok: [mon3] 2026-08-18 11:45:59.114354 | mon1 | ok: [mon2] 2026-08-18 11:45:59.114367 | mon1 | ok: [mon1] 2026-08-18 11:45:59.114378 | mon1 | changed: [osd1] 2026-08-18 11:45:59.114390 | mon1 | 2026-08-18 11:45:59.114402 | mon1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 11:45:59.114412 | mon1 | Tuesday 18 August 2026 11:45:59 +0000 (0:00:00.430) 0:03:54.296 ******** 2026-08-18 11:45:59.760964 | mon1 | ok: [mon1] 2026-08-18 11:45:59.761030 | mon1 | ok: [mon2] 2026-08-18 11:45:59.762415 | mon1 | ok: [mon3] 2026-08-18 11:45:59.762471 | mon1 | changed: [osd1] 2026-08-18 11:45:59.762481 | mon1 | 2026-08-18 11:45:59.762491 | mon1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 11:45:59.762501 | mon1 | Tuesday 18 August 2026 11:45:59 +0000 (0:00:00.646) 0:03:54.942 ******** 2026-08-18 11:45:59.810731 | mon1 | skipping: [mon1] 2026-08-18 11:45:59.847843 | mon1 | skipping: [mon2] 2026-08-18 11:45:59.847930 | mon1 | skipping: [mon3] 2026-08-18 11:45:59.847945 | mon1 | skipping: [osd1] 2026-08-18 11:45:59.847954 | mon1 | 2026-08-18 11:45:59.847963 | mon1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 11:45:59.847972 | mon1 | Tuesday 18 August 2026 11:45:59 +0000 (0:00:00.087) 0:03:55.030 ******** 2026-08-18 11:46:41.161920 | mon1 | ok: [mon1] 2026-08-18 11:46:41.161999 | mon1 | ok: [mon2] 2026-08-18 11:46:41.162016 | mon1 | ok: [mon3] 2026-08-18 11:46:41.162032 | mon1 | changed: [osd1] 2026-08-18 11:46:41.162048 | mon1 | 2026-08-18 11:46:41.162064 | mon1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 11:46:41.162080 | mon1 | Tuesday 18 August 2026 11:46:41 +0000 (0:00:41.313) 0:04:36.344 ******** 2026-08-18 11:46:41.837054 | mon1 | ok: [mon1] 2026-08-18 11:46:41.837102 | mon1 | ok: [mon2] 2026-08-18 11:46:41.837114 | mon1 | ok: [mon3] 2026-08-18 11:46:41.837125 | mon1 | changed: [osd1] 2026-08-18 11:46:41.837137 | mon1 | 2026-08-18 11:46:41.837150 | mon1 | TASK [vexxhost.ceph.osd : Locate the cluster admin host] *********************** 2026-08-18 11:46:41.837162 | mon1 | Tuesday 18 August 2026 11:46:41 +0000 (0:00:00.675) 0:04:37.019 ******** 2026-08-18 11:46:42.605069 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:46:42.605137 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:46:42.605182 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:46:42.605192 | mon1 | 2026-08-18 11:46:42.605201 | mon1 | TASK [vexxhost.ceph.osd : Select the admin host and its mon config path] ******* 2026-08-18 11:46:42.605210 | mon1 | Tuesday 18 August 2026 11:46:42 +0000 (0:00:00.768) 0:04:37.787 ******** 2026-08-18 11:46:42.706998 | mon1 | ok: [mon1] 2026-08-18 11:46:42.707057 | mon1 | ok: [mon2] 2026-08-18 11:46:42.707067 | mon1 | ok: [mon3] 2026-08-18 11:46:42.707075 | mon1 | ok: [osd1] 2026-08-18 11:46:42.707084 | mon1 | 2026-08-18 11:46:42.707099 | mon1 | TASK [vexxhost.ceph.osd : Set the admin mon config path] *********************** 2026-08-18 11:46:42.707357 | mon1 | Tuesday 18 August 2026 11:46:42 +0000 (0:00:00.103) 0:04:37.891 ******** 2026-08-18 11:46:42.820098 | mon1 | ok: [mon1] 2026-08-18 11:46:42.872067 | mon1 | ok: [mon2] 2026-08-18 11:46:42.872263 | mon1 | ok: [mon3] 2026-08-18 11:46:42.872490 | mon1 | ok: [osd1] 2026-08-18 11:46:42.872742 | mon1 | 2026-08-18 11:46:42.873039 | mon1 | TASK [Register this OSD host] ************************************************** 2026-08-18 11:46:42.873267 | mon1 | Tuesday 18 August 2026 11:46:42 +0000 (0:00:00.165) 0:04:38.056 ******** 2026-08-18 11:46:43.020721 | mon1 | included: vexxhost.ceph.cephadm_host for mon1, mon2, mon3, osd1 2026-08-18 11:46:43.020922 | mon1 | 2026-08-18 11:46:43.021195 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 11:46:43.021454 | mon1 | Tuesday 18 August 2026 11:46:43 +0000 (0:00:00.148) 0:04:38.205 ******** 2026-08-18 11:46:44.731972 | mon1 | ok: [mon1] 2026-08-18 11:46:44.732202 | mon1 | 2026-08-18 11:46:44.732479 | mon1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 11:46:44.732738 | mon1 | Tuesday 18 August 2026 11:46:44 +0000 (0:00:01.710) 0:04:39.915 ******** 2026-08-18 11:46:44.783292 | mon1 | ok: [mon1] 2026-08-18 11:46:44.822334 | mon1 | ok: [mon2] 2026-08-18 11:46:44.822611 | mon1 | ok: [mon3] 2026-08-18 11:46:44.822859 | mon1 | ok: [osd1] 2026-08-18 11:46:44.823161 | mon1 | 2026-08-18 11:46:44.823556 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 11:46:44.823859 | mon1 | Tuesday 18 August 2026 11:46:44 +0000 (0:00:00.091) 0:04:40.007 ******** 2026-08-18 11:46:44.869542 | mon1 | ok: [mon1] => { 2026-08-18 11:46:44.869782 | mon1 | "changed": false, 2026-08-18 11:46:44.870075 | mon1 | "msg": "All assertions passed" 2026-08-18 11:46:44.870303 | mon1 | } 2026-08-18 11:46:44.915984 | mon1 | ok: [mon2] => { 2026-08-18 11:46:44.916179 | mon1 | "changed": false, 2026-08-18 11:46:44.916327 | mon1 | "msg": "All assertions passed" 2026-08-18 11:46:44.916475 | mon1 | } 2026-08-18 11:46:44.916626 | mon1 | ok: [mon3] => { 2026-08-18 11:46:44.916775 | mon1 | "changed": false, 2026-08-18 11:46:44.916951 | mon1 | "msg": "All assertions passed" 2026-08-18 11:46:44.917084 | mon1 | } 2026-08-18 11:46:44.917230 | mon1 | ok: [osd1] => { 2026-08-18 11:46:44.917378 | mon1 | "changed": false, 2026-08-18 11:46:44.917526 | mon1 | "msg": "All assertions passed" 2026-08-18 11:46:44.917671 | mon1 | } 2026-08-18 11:46:44.917809 | mon1 | 2026-08-18 11:46:44.918016 | mon1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 11:46:44.918173 | mon1 | Tuesday 18 August 2026 11:46:44 +0000 (0:00:00.093) 0:04:40.100 ******** 2026-08-18 11:46:45.299667 | mon1 | ok: [mon1] 2026-08-18 11:46:45.299903 | mon1 | ok: [mon2] 2026-08-18 11:46:45.300230 | mon1 | ok: [mon3] 2026-08-18 11:46:45.300440 | mon1 | changed: [osd1] 2026-08-18 11:46:45.300662 | mon1 | 2026-08-18 11:46:45.300952 | mon1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 11:46:45.301208 | mon1 | Tuesday 18 August 2026 11:46:45 +0000 (0:00:00.383) 0:04:40.483 ******** 2026-08-18 11:46:45.350360 | mon1 | ok: [mon1] 2026-08-18 11:46:45.400042 | mon1 | ok: [mon2] 2026-08-18 11:46:45.400246 | mon1 | ok: [mon3] 2026-08-18 11:46:45.400469 | mon1 | ok: [osd1] 2026-08-18 11:46:45.400680 | mon1 | 2026-08-18 11:46:45.400972 | mon1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 11:46:45.401243 | mon1 | Tuesday 18 August 2026 11:46:45 +0000 (0:00:00.100) 0:04:40.584 ******** 2026-08-18 11:46:45.543452 | mon1 | ok: [mon1] 2026-08-18 11:46:45.543640 | mon1 | ok: [mon2] 2026-08-18 11:46:45.543898 | mon1 | ok: [mon3] 2026-08-18 11:46:45.544149 | mon1 | ok: [osd1] 2026-08-18 11:46:45.544369 | mon1 | 2026-08-18 11:46:45.544616 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 11:46:45.544863 | mon1 | Tuesday 18 August 2026 11:46:45 +0000 (0:00:00.143) 0:04:40.728 ******** 2026-08-18 11:46:45.645353 | mon1 | ok: [mon1] => { 2026-08-18 11:46:45.645550 | mon1 | "changed": false, 2026-08-18 11:46:45.645782 | mon1 | "msg": "All assertions passed" 2026-08-18 11:46:45.646081 | mon1 | } 2026-08-18 11:46:45.646325 | mon1 | ok: [mon2] => { 2026-08-18 11:46:45.646621 | mon1 | "changed": false, 2026-08-18 11:46:45.646959 | mon1 | "msg": "All assertions passed" 2026-08-18 11:46:45.647207 | mon1 | } 2026-08-18 11:46:45.647462 | mon1 | ok: [mon3] => { 2026-08-18 11:46:45.647691 | mon1 | "changed": false, 2026-08-18 11:46:45.647975 | mon1 | "msg": "All assertions passed" 2026-08-18 11:46:45.648182 | mon1 | } 2026-08-18 11:46:45.648445 | mon1 | ok: [osd1] => { 2026-08-18 11:46:45.648675 | mon1 | "changed": false, 2026-08-18 11:46:45.648978 | mon1 | "msg": "All assertions passed" 2026-08-18 11:46:45.649202 | mon1 | } 2026-08-18 11:46:45.649416 | mon1 | 2026-08-18 11:46:45.649678 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 11:46:45.650006 | mon1 | Tuesday 18 August 2026 11:46:45 +0000 (0:00:00.101) 0:04:40.830 ******** 2026-08-18 11:46:56.380769 | mon1 | ok: [mon1] 2026-08-18 11:46:56.381962 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:46:56.382047 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:46:56.382062 | mon1 | changed: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:46:56.382076 | mon1 | 2026-08-18 11:46:56.382133 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 11:46:56.382390 | mon1 | Tuesday 18 August 2026 11:46:56 +0000 (0:00:10.735) 0:04:51.565 ******** 2026-08-18 11:46:56.518013 | mon1 | skipping: [mon1] 2026-08-18 11:46:56.518107 | mon1 | skipping: [mon2] 2026-08-18 11:46:56.518120 | mon1 | skipping: [mon3] 2026-08-18 11:46:56.518131 | mon1 | skipping: [osd1] 2026-08-18 11:46:56.518142 | mon1 | 2026-08-18 11:46:56.518336 | mon1 | TASK [vexxhost.ceph.osd : Apply OSD service specs (drive groups)] ************** 2026-08-18 11:46:56.518588 | mon1 | Tuesday 18 August 2026 11:46:56 +0000 (0:00:00.136) 0:04:51.701 ******** 2026-08-18 11:46:56.555986 | mon1 | skipping: [mon1] 2026-08-18 11:46:56.556203 | mon1 | 2026-08-18 11:46:56.556453 | mon1 | TASK [vexxhost.ceph.osd : List existing ceph-volume OSDs on this host] ********* 2026-08-18 11:46:56.556699 | mon1 | Tuesday 18 August 2026 11:46:56 +0000 (0:00:00.038) 0:04:51.740 ******** 2026-08-18 11:46:59.127342 | mon1 | ok: [mon1] 2026-08-18 11:46:59.127573 | mon1 | ok: [mon3] 2026-08-18 11:46:59.127841 | mon1 | ok: [mon2] 2026-08-18 11:46:59.128111 | mon1 | ok: [osd1] 2026-08-18 11:46:59.128323 | mon1 | 2026-08-18 11:46:59.128580 | mon1 | TASK [vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices] ******** 2026-08-18 11:46:59.128858 | mon1 | Tuesday 18 August 2026 11:46:59 +0000 (0:00:02.571) 0:04:54.311 ******** 2026-08-18 11:55:32.635361 | mon1 | changed: [mon1] => (item=/dev/ceph-mon1-osd0/data) 2026-08-18 11:55:32.635428 | mon1 | changed: [mon3 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-mon3-osd0/data) 2026-08-18 11:55:32.635546 | mon1 | changed: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-08-18 11:55:32.635694 | mon1 | changed: [mon2 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-mon2-osd0/data) 2026-08-18 11:55:32.635780 | mon1 | changed: [mon1] => (item=/dev/ceph-mon1-osd1/data) 2026-08-18 11:55:32.635916 | mon1 | changed: [mon3 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-mon3-osd1/data) 2026-08-18 11:55:32.637017 | mon1 | changed: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-08-18 11:55:32.637053 | mon1 | changed: [mon2 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-mon2-osd1/data) 2026-08-18 11:55:32.637066 | mon1 | changed: [mon1] => (item=/dev/ceph-mon1-osd2/data) 2026-08-18 11:55:32.637077 | mon1 | changed: [mon3 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-mon3-osd2/data) 2026-08-18 11:55:32.637109 | mon1 | changed: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-08-18 11:55:32.637119 | mon1 | changed: [mon2 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-mon2-osd2/data) 2026-08-18 11:55:32.637127 | mon1 | 2026-08-18 11:55:32.637137 | mon1 | TASK [vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host] *** 2026-08-18 11:55:32.637145 | mon1 | Tuesday 18 August 2026 11:55:32 +0000 (0:08:33.508) 0:13:27.820 ******** 2026-08-18 11:55:47.904373 | mon1 | ok: [mon1] 2026-08-18 11:55:47.904476 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:55:47.904642 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:55:47.904826 | mon1 | FAILED - RETRYING: [mon2 -> mon1]: Wait for explicitly requested OSD daemons to be running on this host (120 retries left). 2026-08-18 11:55:47.905671 | mon1 | FAILED - RETRYING: [mon2 -> mon1]: Wait for explicitly requested OSD daemons to be running on this host (119 retries left). 2026-08-18 11:55:47.905706 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:55:47.905715 | mon1 | 2026-08-18 11:55:47.905723 | mon1 | TASK [vexxhost.ceph.osd : Wait for OSD drive-group services to deploy at least one daemon] *** 2026-08-18 11:55:47.905730 | mon1 | Tuesday 18 August 2026 11:55:47 +0000 (0:00:15.268) 0:13:43.088 ******** 2026-08-18 11:55:47.993301 | mon1 | skipping: [mon1] 2026-08-18 11:55:47.993368 | mon1 | 2026-08-18 11:55:47.993485 | mon1 | PLAY [Apply Ceph configuration] ************************************************ 2026-08-18 11:55:47.993585 | mon1 | 2026-08-18 11:55:47.993697 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:55:47.993812 | mon1 | Tuesday 18 August 2026 11:55:47 +0000 (0:00:00.088) 0:13:43.177 ******** 2026-08-18 11:55:50.182267 | mon1 | ok: [mon1] 2026-08-18 11:55:50.182342 | mon1 | ok: [mon2] 2026-08-18 11:55:50.182449 | mon1 | ok: [mon3] 2026-08-18 11:55:50.182550 | mon1 | 2026-08-18 11:55:50.182667 | mon1 | TASK [vexxhost.ceph.configure : Locate the cluster admin host] ***************** 2026-08-18 11:55:50.182778 | mon1 | Tuesday 18 August 2026 11:55:50 +0000 (0:00:02.188) 0:13:45.366 ******** 2026-08-18 11:55:50.948931 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:55:50.948967 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:55:50.948974 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:55:50.948983 | mon1 | 2026-08-18 11:55:50.949525 | mon1 | TASK [vexxhost.ceph.configure : Select the admin host] ************************* 2026-08-18 11:55:50.949574 | mon1 | Tuesday 18 August 2026 11:55:50 +0000 (0:00:00.766) 0:13:46.132 ******** 2026-08-18 11:55:51.028458 | mon1 | ok: [mon1] 2026-08-18 11:55:51.028718 | mon1 | ok: [mon2] 2026-08-18 11:55:51.029018 | mon1 | ok: [mon3] 2026-08-18 11:55:51.029232 | mon1 | 2026-08-18 11:55:51.029513 | mon1 | TASK [vexxhost.ceph.configure : Set the admin mon config path] ***************** 2026-08-18 11:55:51.029789 | mon1 | Tuesday 18 August 2026 11:55:51 +0000 (0:00:00.080) 0:13:46.213 ******** 2026-08-18 11:55:51.095920 | mon1 | ok: [mon1] 2026-08-18 11:55:51.095975 | mon1 | ok: [mon2] 2026-08-18 11:55:51.096186 | mon1 | ok: [mon3] 2026-08-18 11:55:51.096402 | mon1 | 2026-08-18 11:55:51.096642 | mon1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] ************** 2026-08-18 11:55:51.096916 | mon1 | Tuesday 18 August 2026 11:55:51 +0000 (0:00:00.067) 0:13:46.280 ******** 2026-08-18 11:55:51.155999 | mon1 | skipping: [mon1] 2026-08-18 11:55:51.156274 | mon1 | skipping: [mon2] 2026-08-18 11:55:51.156682 | mon1 | skipping: [mon3] 2026-08-18 11:55:51.156977 | mon1 | 2026-08-18 11:55:51.157343 | mon1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] *************** 2026-08-18 11:55:51.157682 | mon1 | Tuesday 18 August 2026 11:55:51 +0000 (0:00:00.060) 0:13:46.340 ******** 2026-08-18 11:55:51.226678 | mon1 | skipping: [mon1] 2026-08-18 11:55:51.227009 | mon1 | skipping: [mon2] 2026-08-18 11:55:51.227303 | mon1 | skipping: [mon3] 2026-08-18 11:55:51.227570 | mon1 | 2026-08-18 11:55:51.227908 | mon1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] ************************* 2026-08-18 11:55:51.228214 | mon1 | Tuesday 18 August 2026 11:55:51 +0000 (0:00:00.070) 0:13:46.411 ******** 2026-08-18 11:55:51.286486 | mon1 | skipping: [mon1] 2026-08-18 11:55:51.286769 | mon1 | skipping: [mon2] 2026-08-18 11:55:51.287141 | mon1 | skipping: [mon3] 2026-08-18 11:55:51.287423 | mon1 | 2026-08-18 11:55:51.287748 | mon1 | TASK [vexxhost.ceph.configure : Configure pools] ******************************* 2026-08-18 11:55:51.288131 | mon1 | Tuesday 18 August 2026 11:55:51 +0000 (0:00:00.059) 0:13:46.470 ******** 2026-08-18 11:55:51.339947 | mon1 | skipping: [mon1] 2026-08-18 11:55:51.340403 | mon1 | skipping: [mon2] 2026-08-18 11:55:51.340748 | mon1 | skipping: [mon3] 2026-08-18 11:55:51.341097 | mon1 | 2026-08-18 11:55:51.341474 | mon1 | TASK [vexxhost.ceph.configure : Configure CephX keys] ************************** 2026-08-18 11:55:51.341789 | mon1 | Tuesday 18 August 2026 11:55:51 +0000 (0:00:00.053) 0:13:46.524 ******** 2026-08-18 11:55:51.396663 | mon1 | skipping: [mon1] 2026-08-18 11:55:51.397006 | mon1 | skipping: [mon2] 2026-08-18 11:55:51.397369 | mon1 | skipping: [mon3] 2026-08-18 11:55:51.397626 | mon1 | 2026-08-18 11:55:51.398084 | mon1 | TASK [vexxhost.ceph.configure : Enroll the dashboard TLS certificate] ********** 2026-08-18 11:55:51.398291 | mon1 | Tuesday 18 August 2026 11:55:51 +0000 (0:00:00.056) 0:13:46.581 ******** 2026-08-18 11:55:51.475773 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard.yml for mon1, mon2, mon3 2026-08-18 11:55:51.475828 | mon1 | 2026-08-18 11:55:51.476045 | mon1 | TASK [vexxhost.ceph.configure : Check whether the dashboard mgr module is enabled] *** 2026-08-18 11:55:51.476189 | mon1 | Tuesday 18 August 2026 11:55:51 +0000 (0:00:00.078) 0:13:46.660 ******** 2026-08-18 11:55:53.226730 | mon1 | ok: [mon1] 2026-08-18 11:55:53.226786 | mon1 | 2026-08-18 11:55:53.226800 | mon1 | TASK [vexxhost.ceph.configure : Get the current dashboard certificate] ********* 2026-08-18 11:55:53.226813 | mon1 | Tuesday 18 August 2026 11:55:53 +0000 (0:00:01.749) 0:13:48.410 ******** 2026-08-18 11:55:55.123379 | mon1 | ok: [mon1] 2026-08-18 11:55:55.123441 | mon1 | 2026-08-18 11:55:55.123455 | mon1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate] ***************** 2026-08-18 11:55:55.123469 | mon1 | Tuesday 18 August 2026 11:55:55 +0000 (0:00:01.896) 0:13:50.307 ******** 2026-08-18 11:55:55.172245 | mon1 | skipping: [mon1] 2026-08-18 11:55:55.172350 | mon1 | 2026-08-18 11:55:55.172505 | mon1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate key] ************* 2026-08-18 11:55:55.172656 | mon1 | Tuesday 18 August 2026 11:55:55 +0000 (0:00:00.047) 0:13:50.354 ******** 2026-08-18 11:55:55.215409 | mon1 | skipping: [mon1] 2026-08-18 11:55:55.215514 | mon1 | 2026-08-18 11:55:55.215670 | mon1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 11:55:55.215821 | mon1 | Tuesday 18 August 2026 11:55:55 +0000 (0:00:00.046) 0:13:50.400 ******** 2026-08-18 11:55:55.260860 | mon1 | skipping: [mon1] 2026-08-18 11:55:55.261010 | mon1 | 2026-08-18 11:55:55.261153 | mon1 | TASK [vexxhost.ceph.configure : Create a self-signed certificate] ************** 2026-08-18 11:55:55.261304 | mon1 | Tuesday 18 August 2026 11:55:55 +0000 (0:00:00.045) 0:13:50.445 ******** 2026-08-18 11:55:57.423479 | mon1 | changed: [mon1] 2026-08-18 11:55:57.423552 | mon1 | 2026-08-18 11:55:57.423598 | mon1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 11:55:57.423714 | mon1 | Tuesday 18 August 2026 11:55:57 +0000 (0:00:02.161) 0:13:52.607 ******** 2026-08-18 11:55:57.492992 | mon1 | ok: [mon1] 2026-08-18 11:55:57.493063 | mon1 | 2026-08-18 11:55:57.493586 | mon1 | TASK [vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate] *** 2026-08-18 11:55:57.493655 | mon1 | Tuesday 18 August 2026 11:55:57 +0000 (0:00:00.068) 0:13:52.676 ******** 2026-08-18 11:56:05.240489 | mon1 | changed: [mon1] => (item=ceph mgr module disable dashboard) 2026-08-18 11:56:05.240600 | mon1 | changed: [mon1] => (item=ceph mgr module enable dashboard) 2026-08-18 11:56:05.240669 | mon1 | changed: [mon1] => (item=ceph orch reconfig mgr) 2026-08-18 11:56:05.240775 | mon1 | 2026-08-18 11:56:05.240921 | mon1 | TASK [vexxhost.ceph.configure : Configure dashboard users] ********************* 2026-08-18 11:56:05.241033 | mon1 | Tuesday 18 August 2026 11:56:05 +0000 (0:00:07.745) 0:14:00.421 ******** 2026-08-18 11:56:05.357563 | mon1 | skipping: [mon1] 2026-08-18 11:56:05.357665 | mon1 | skipping: [mon2] 2026-08-18 11:56:05.357715 | mon1 | skipping: [mon3] 2026-08-18 11:56:05.357817 | mon1 | 2026-08-18 11:56:05.357993 | mon1 | PLAY [Deploy Ceph RADOS Gateways] ********************************************** 2026-08-18 11:56:05.358098 | mon1 | 2026-08-18 11:56:05.358215 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:56:05.358331 | mon1 | Tuesday 18 August 2026 11:56:05 +0000 (0:00:00.120) 0:14:00.542 ******** 2026-08-18 11:56:06.517923 | mon1 | ok: [mon1] 2026-08-18 11:56:06.517985 | mon1 | ok: [mon3] 2026-08-18 11:56:06.518402 | mon1 | ok: [mon2] 2026-08-18 11:56:06.518428 | mon1 | 2026-08-18 11:56:06.518433 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:56:06.518438 | mon1 | Tuesday 18 August 2026 11:56:06 +0000 (0:00:01.160) 0:14:01.702 ******** 2026-08-18 11:56:06.829325 | mon1 | ok: [mon1] 2026-08-18 11:56:06.829390 | mon1 | ok: [mon2] 2026-08-18 11:56:06.829483 | mon1 | ok: [mon3] 2026-08-18 11:56:06.829586 | mon1 | 2026-08-18 11:56:06.829829 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:56:06.829864 | mon1 | Tuesday 18 August 2026 11:56:06 +0000 (0:00:00.310) 0:14:02.013 ******** 2026-08-18 11:56:06.872455 | mon1 | skipping: [mon1] 2026-08-18 11:56:06.927116 | mon1 | skipping: [mon2] 2026-08-18 11:56:06.927158 | mon1 | skipping: [mon3] 2026-08-18 11:56:06.927165 | mon1 | 2026-08-18 11:56:06.927171 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 11:56:06.927177 | mon1 | Tuesday 18 August 2026 11:56:06 +0000 (0:00:00.097) 0:14:02.111 ******** 2026-08-18 11:56:07.232911 | mon1 | ok: [mon1] 2026-08-18 11:56:07.232947 | mon1 | ok: [mon2] 2026-08-18 11:56:07.232951 | mon1 | ok: [mon3] 2026-08-18 11:56:07.232955 | mon1 | 2026-08-18 11:56:07.232959 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:56:07.232964 | mon1 | Tuesday 18 August 2026 11:56:07 +0000 (0:00:00.302) 0:14:02.413 ******** 2026-08-18 11:56:07.330611 | mon1 | ok: [mon1] => { 2026-08-18 11:56:07.331272 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:56:07.331599 | mon1 | } 2026-08-18 11:56:07.331990 | mon1 | ok: [mon2] => { 2026-08-18 11:56:07.332347 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:56:07.332645 | mon1 | } 2026-08-18 11:56:07.332989 | mon1 | ok: [mon3] => { 2026-08-18 11:56:07.333342 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:56:07.333638 | mon1 | } 2026-08-18 11:56:07.333966 | mon1 | 2026-08-18 11:56:07.334317 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:56:07.334652 | mon1 | Tuesday 18 August 2026 11:56:07 +0000 (0:00:00.100) 0:14:02.514 ******** 2026-08-18 11:56:07.736580 | mon1 | ok: [mon1] 2026-08-18 11:56:07.736985 | mon1 | ok: [mon2] 2026-08-18 11:56:07.737292 | mon1 | ok: [mon3] 2026-08-18 11:56:07.737580 | mon1 | 2026-08-18 11:56:07.737965 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:56:07.739671 | mon1 | Tuesday 18 August 2026 11:56:07 +0000 (0:00:00.406) 0:14:02.921 ******** 2026-08-18 11:56:07.852184 | mon1 | skipping: [mon1] 2026-08-18 11:56:07.852576 | mon1 | skipping: [mon2] 2026-08-18 11:56:07.852928 | mon1 | skipping: [mon3] 2026-08-18 11:56:07.853264 | mon1 | 2026-08-18 11:56:07.853704 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:56:07.854175 | mon1 | Tuesday 18 August 2026 11:56:07 +0000 (0:00:00.115) 0:14:03.036 ******** 2026-08-18 11:56:07.954680 | mon1 | skipping: [mon1] 2026-08-18 11:56:07.954852 | mon1 | skipping: [mon2] 2026-08-18 11:56:07.955011 | mon1 | skipping: [mon3] 2026-08-18 11:56:07.955141 | mon1 | 2026-08-18 11:56:07.955278 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:56:07.955415 | mon1 | Tuesday 18 August 2026 11:56:07 +0000 (0:00:00.102) 0:14:03.139 ******** 2026-08-18 11:56:08.284506 | mon1 | ok: [mon1] 2026-08-18 11:56:08.284932 | mon1 | ok: [mon2] 2026-08-18 11:56:08.285266 | mon1 | ok: [mon3] 2026-08-18 11:56:08.285601 | mon1 | 2026-08-18 11:56:08.285951 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:56:08.286271 | mon1 | Tuesday 18 August 2026 11:56:08 +0000 (0:00:00.329) 0:14:03.468 ******** 2026-08-18 11:56:09.589085 | mon1 | ok: [mon1] 2026-08-18 11:56:09.589454 | mon1 | ok: [mon2] 2026-08-18 11:56:09.589752 | mon1 | ok: [mon3] 2026-08-18 11:56:09.590063 | mon1 | 2026-08-18 11:56:09.590382 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:56:09.590684 | mon1 | Tuesday 18 August 2026 11:56:09 +0000 (0:00:01.304) 0:14:04.773 ******** 2026-08-18 11:56:09.700676 | mon1 | ok: [mon1] => { 2026-08-18 11:56:09.701106 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:56:09.701410 | mon1 | } 2026-08-18 11:56:09.701703 | mon1 | ok: [mon2] => { 2026-08-18 11:56:09.702049 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:56:09.702346 | mon1 | } 2026-08-18 11:56:09.702641 | mon1 | ok: [mon3] => { 2026-08-18 11:56:09.702989 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:56:09.703286 | mon1 | } 2026-08-18 11:56:09.703573 | mon1 | 2026-08-18 11:56:09.703918 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:56:09.704235 | mon1 | Tuesday 18 August 2026 11:56:09 +0000 (0:00:00.111) 0:14:04.885 ******** 2026-08-18 11:56:10.180644 | mon1 | ok: [mon1] 2026-08-18 11:56:10.181071 | mon1 | ok: [mon2] 2026-08-18 11:56:10.181383 | mon1 | ok: [mon3] 2026-08-18 11:56:10.182216 | mon1 | 2026-08-18 11:56:10.182242 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:56:10.182253 | mon1 | Tuesday 18 August 2026 11:56:10 +0000 (0:00:00.479) 0:14:05.364 ******** 2026-08-18 11:56:12.413691 | mon1 | ok: [mon1] 2026-08-18 11:56:12.414009 | mon1 | ok: [mon2] 2026-08-18 11:56:12.414376 | mon1 | ok: [mon3] 2026-08-18 11:56:12.414679 | mon1 | 2026-08-18 11:56:12.415006 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 11:56:12.415369 | mon1 | Tuesday 18 August 2026 11:56:12 +0000 (0:00:02.233) 0:14:07.598 ******** 2026-08-18 11:56:12.450923 | mon1 | skipping: [mon1] 2026-08-18 11:56:12.486764 | mon1 | skipping: [mon2] 2026-08-18 11:56:12.486811 | mon1 | skipping: [mon3] 2026-08-18 11:56:12.486867 | mon1 | 2026-08-18 11:56:12.487054 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 11:56:12.487214 | mon1 | Tuesday 18 August 2026 11:56:12 +0000 (0:00:00.070) 0:14:07.668 ******** 2026-08-18 11:56:12.550565 | mon1 | skipping: [mon1] 2026-08-18 11:56:12.550820 | mon1 | skipping: [mon2] 2026-08-18 11:56:12.551105 | mon1 | skipping: [mon3] 2026-08-18 11:56:12.551331 | mon1 | 2026-08-18 11:56:12.551615 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 11:56:12.551866 | mon1 | Tuesday 18 August 2026 11:56:12 +0000 (0:00:00.065) 0:14:07.734 ******** 2026-08-18 11:56:12.617363 | mon1 | skipping: [mon1] 2026-08-18 11:56:12.617578 | mon1 | skipping: [mon2] 2026-08-18 11:56:12.617831 | mon1 | skipping: [mon3] 2026-08-18 11:56:12.618117 | mon1 | 2026-08-18 11:56:12.618377 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 11:56:12.618641 | mon1 | Tuesday 18 August 2026 11:56:12 +0000 (0:00:00.067) 0:14:07.801 ******** 2026-08-18 11:56:13.770347 | mon1 | ok: [mon1] 2026-08-18 11:56:13.770568 | mon1 | ok: [mon2] 2026-08-18 11:56:13.770863 | mon1 | ok: [mon3] 2026-08-18 11:56:13.771159 | mon1 | 2026-08-18 11:56:13.771428 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 11:56:13.771683 | mon1 | Tuesday 18 August 2026 11:56:13 +0000 (0:00:01.152) 0:14:08.954 ******** 2026-08-18 11:56:14.405854 | mon1 | ok: [mon1] 2026-08-18 11:56:14.405914 | mon1 | ok: [mon2] 2026-08-18 11:56:14.405921 | mon1 | ok: [mon3] 2026-08-18 11:56:14.405936 | mon1 | 2026-08-18 11:56:14.405940 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 11:56:14.406095 | mon1 | Tuesday 18 August 2026 11:56:14 +0000 (0:00:00.634) 0:14:09.588 ******** 2026-08-18 11:56:15.623335 | mon1 | ok: [mon2] => (item={'path': '/etc/containerd'}) 2026-08-18 11:56:15.623416 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:56:15.623519 | mon1 | ok: [mon3] => (item={'path': '/etc/containerd'}) 2026-08-18 11:56:15.623634 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:56:15.623751 | mon1 | ok: [mon2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:56:15.623867 | mon1 | ok: [mon3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:56:15.623996 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:56:15.624110 | mon1 | ok: [mon2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:56:15.624222 | mon1 | ok: [mon3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:56:15.624358 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:56:15.624472 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:56:15.624588 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:56:15.624706 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:56:15.624821 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:56:15.624966 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:56:15.625063 | mon1 | 2026-08-18 11:56:15.625175 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 11:56:15.625286 | mon1 | Tuesday 18 August 2026 11:56:15 +0000 (0:00:01.217) 0:14:10.805 ******** 2026-08-18 11:56:16.409335 | mon1 | ok: [mon1] 2026-08-18 11:56:16.409401 | mon1 | ok: [mon2] 2026-08-18 11:56:16.410901 | mon1 | ok: [mon3] 2026-08-18 11:56:16.410918 | mon1 | 2026-08-18 11:56:16.410924 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:56:16.410930 | mon1 | Tuesday 18 August 2026 11:56:16 +0000 (0:00:00.767) 0:14:11.572 ******** 2026-08-18 11:56:16.410935 | mon1 | 2026-08-18 11:56:16.410940 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:56:16.410945 | mon1 | Tuesday 18 August 2026 11:56:16 +0000 (0:00:00.006) 0:14:11.579 ******** 2026-08-18 11:56:16.410950 | mon1 | 2026-08-18 11:56:16.410955 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:56:16.410960 | mon1 | Tuesday 18 August 2026 11:56:16 +0000 (0:00:00.006) 0:14:11.585 ******** 2026-08-18 11:56:16.410965 | mon1 | 2026-08-18 11:56:16.410970 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 11:56:16.410976 | mon1 | Tuesday 18 August 2026 11:56:16 +0000 (0:00:00.008) 0:14:11.593 ******** 2026-08-18 11:56:16.920785 | mon1 | ok: [mon1] 2026-08-18 11:56:16.920842 | mon1 | ok: [mon2] 2026-08-18 11:56:16.920855 | mon1 | ok: [mon3] 2026-08-18 11:56:16.920867 | mon1 | 2026-08-18 11:56:16.920919 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:56:16.920931 | mon1 | Tuesday 18 August 2026 11:56:16 +0000 (0:00:00.510) 0:14:12.104 ******** 2026-08-18 11:56:17.221044 | mon1 | ok: [mon1] 2026-08-18 11:56:17.221100 | mon1 | ok: [mon2] 2026-08-18 11:56:17.221113 | mon1 | ok: [mon3] 2026-08-18 11:56:17.221126 | mon1 | 2026-08-18 11:56:17.221138 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:56:17.221151 | mon1 | Tuesday 18 August 2026 11:56:17 +0000 (0:00:00.300) 0:14:12.404 ******** 2026-08-18 11:56:17.316947 | mon1 | ok: [mon1] => { 2026-08-18 11:56:17.316990 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:56:17.317027 | mon1 | } 2026-08-18 11:56:17.317036 | mon1 | ok: [mon2] => { 2026-08-18 11:56:17.317044 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:56:17.317053 | mon1 | } 2026-08-18 11:56:17.317061 | mon1 | ok: [mon3] => { 2026-08-18 11:56:17.317069 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:56:17.317330 | mon1 | } 2026-08-18 11:56:17.317615 | mon1 | 2026-08-18 11:56:17.317959 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:56:17.318307 | mon1 | Tuesday 18 August 2026 11:56:17 +0000 (0:00:00.095) 0:14:12.499 ******** 2026-08-18 11:56:17.781570 | mon1 | ok: [mon1] 2026-08-18 11:56:17.781804 | mon1 | ok: [mon2] 2026-08-18 11:56:17.782103 | mon1 | ok: [mon3] 2026-08-18 11:56:17.782324 | mon1 | 2026-08-18 11:56:17.782571 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:56:17.782818 | mon1 | Tuesday 18 August 2026 11:56:17 +0000 (0:00:00.466) 0:14:12.966 ******** 2026-08-18 11:56:21.298166 | mon1 | ok: [mon3] 2026-08-18 11:56:21.298544 | mon1 | ok: [mon1] 2026-08-18 11:56:21.298851 | mon1 | ok: [mon2] 2026-08-18 11:56:21.299195 | mon1 | 2026-08-18 11:56:21.299523 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 11:56:21.299857 | mon1 | Tuesday 18 August 2026 11:56:21 +0000 (0:00:03.516) 0:14:16.482 ******** 2026-08-18 11:56:23.404345 | mon1 | ok: [mon3] 2026-08-18 11:56:23.404465 | mon1 | ok: [mon1] 2026-08-18 11:56:23.404611 | mon1 | ok: [mon2] 2026-08-18 11:56:23.404749 | mon1 | 2026-08-18 11:56:23.404946 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 11:56:23.405104 | mon1 | Tuesday 18 August 2026 11:56:23 +0000 (0:00:02.104) 0:14:18.587 ******** 2026-08-18 11:56:23.682786 | mon1 | ok: [mon1] 2026-08-18 11:56:23.683563 | mon1 | ok: [mon2] 2026-08-18 11:56:23.683598 | mon1 | ok: [mon3] 2026-08-18 11:56:23.683606 | mon1 | 2026-08-18 11:56:23.683625 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 11:56:23.683633 | mon1 | Tuesday 18 August 2026 11:56:23 +0000 (0:00:00.280) 0:14:18.867 ******** 2026-08-18 11:56:24.284390 | mon1 | ok: [mon1] 2026-08-18 11:56:24.284494 | mon1 | ok: [mon2] 2026-08-18 11:56:24.284648 | mon1 | ok: [mon3] 2026-08-18 11:56:24.284859 | mon1 | 2026-08-18 11:56:24.285114 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 11:56:24.285267 | mon1 | Tuesday 18 August 2026 11:56:24 +0000 (0:00:00.598) 0:14:19.466 ******** 2026-08-18 11:56:25.015731 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 11:56:25.015995 | mon1 | ok: [mon2] => (item={'path': '/etc/docker'}) 2026-08-18 11:56:25.016252 | mon1 | ok: [mon3] => (item={'path': '/etc/docker'}) 2026-08-18 11:56:25.016520 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:56:25.016825 | mon1 | ok: [mon2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:56:25.017144 | mon1 | ok: [mon3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:56:25.017369 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:56:25.017673 | mon1 | ok: [mon2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:56:25.017849 | mon1 | ok: [mon3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:56:25.018096 | mon1 | 2026-08-18 11:56:25.018401 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 11:56:25.018649 | mon1 | Tuesday 18 August 2026 11:56:25 +0000 (0:00:00.733) 0:14:20.200 ******** 2026-08-18 11:56:25.610749 | mon1 | ok: [mon1] 2026-08-18 11:56:25.611008 | mon1 | ok: [mon2] 2026-08-18 11:56:25.611217 | mon1 | ok: [mon3] 2026-08-18 11:56:25.611431 | mon1 | 2026-08-18 11:56:25.611677 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 11:56:25.611957 | mon1 | Tuesday 18 August 2026 11:56:25 +0000 (0:00:00.595) 0:14:20.795 ******** 2026-08-18 11:56:26.211770 | mon1 | ok: [mon1] 2026-08-18 11:56:26.212047 | mon1 | ok: [mon3] 2026-08-18 11:56:26.212280 | mon1 | ok: [mon2] 2026-08-18 11:56:26.212503 | mon1 | 2026-08-18 11:56:26.212818 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:56:26.213108 | mon1 | Tuesday 18 August 2026 11:56:26 +0000 (0:00:00.578) 0:14:21.373 ******** 2026-08-18 11:56:26.213271 | mon1 | 2026-08-18 11:56:26.215052 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:56:26.215111 | mon1 | Tuesday 18 August 2026 11:56:26 +0000 (0:00:00.009) 0:14:21.383 ******** 2026-08-18 11:56:26.215120 | mon1 | 2026-08-18 11:56:26.215127 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:56:26.215135 | mon1 | Tuesday 18 August 2026 11:56:26 +0000 (0:00:00.006) 0:14:21.389 ******** 2026-08-18 11:56:26.215141 | mon1 | 2026-08-18 11:56:26.215146 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 11:56:26.215157 | mon1 | Tuesday 18 August 2026 11:56:26 +0000 (0:00:00.006) 0:14:21.396 ******** 2026-08-18 11:56:26.701301 | mon1 | ok: [mon1] 2026-08-18 11:56:26.701376 | mon1 | ok: [mon2] 2026-08-18 11:56:26.701471 | mon1 | ok: [mon3] 2026-08-18 11:56:26.701810 | mon1 | 2026-08-18 11:56:26.701845 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:56:26.701852 | mon1 | Tuesday 18 August 2026 11:56:26 +0000 (0:00:00.489) 0:14:21.885 ******** 2026-08-18 11:56:26.782998 | mon1 | ok: [mon1] => { 2026-08-18 11:56:26.783052 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:56:26.783065 | mon1 | } 2026-08-18 11:56:26.783165 | mon1 | ok: [mon2] => { 2026-08-18 11:56:26.783420 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:56:26.783657 | mon1 | } 2026-08-18 11:56:26.783924 | mon1 | ok: [mon3] => { 2026-08-18 11:56:26.784182 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:56:26.784417 | mon1 | } 2026-08-18 11:56:26.784696 | mon1 | 2026-08-18 11:56:26.784993 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:56:26.785235 | mon1 | Tuesday 18 August 2026 11:56:26 +0000 (0:00:00.080) 0:14:21.966 ******** 2026-08-18 11:56:27.231782 | mon1 | ok: [mon2] 2026-08-18 11:56:27.232033 | mon1 | ok: [mon1] 2026-08-18 11:56:27.232273 | mon1 | ok: [mon3] 2026-08-18 11:56:27.232533 | mon1 | 2026-08-18 11:56:27.232826 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:56:27.233072 | mon1 | Tuesday 18 August 2026 11:56:27 +0000 (0:00:00.450) 0:14:22.416 ******** 2026-08-18 11:56:27.317548 | mon1 | skipping: [mon1] 2026-08-18 11:56:27.317764 | mon1 | skipping: [mon2] 2026-08-18 11:56:27.318046 | mon1 | skipping: [mon3] 2026-08-18 11:56:27.318262 | mon1 | 2026-08-18 11:56:27.318511 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 11:56:27.318757 | mon1 | Tuesday 18 August 2026 11:56:27 +0000 (0:00:00.086) 0:14:22.502 ******** 2026-08-18 11:56:27.399367 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:56:27.399683 | mon1 | ok: [mon2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:56:27.400093 | mon1 | ok: [mon3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:56:27.400438 | mon1 | 2026-08-18 11:56:27.401413 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 11:56:27.401524 | mon1 | Tuesday 18 August 2026 11:56:27 +0000 (0:00:00.081) 0:14:22.584 ******** 2026-08-18 11:56:28.529777 | mon1 | ok: [mon1] 2026-08-18 11:56:28.529813 | mon1 | ok: [mon3] 2026-08-18 11:56:28.529818 | mon1 | ok: [mon2] 2026-08-18 11:56:28.529824 | mon1 | 2026-08-18 11:56:28.529829 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 11:56:28.529835 | mon1 | Tuesday 18 August 2026 11:56:28 +0000 (0:00:01.129) 0:14:23.713 ******** 2026-08-18 11:56:29.379976 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-08-18 11:56:29.380051 | mon1 | ok: [mon2] => (item=systemd-timesyncd) 2026-08-18 11:56:29.380115 | mon1 | ok: [mon3] => (item=systemd-timesyncd) 2026-08-18 11:56:29.380360 | mon1 | ok: [mon1] => (item=ssh) 2026-08-18 11:56:29.380721 | mon1 | ok: [mon2] => (item=ssh) 2026-08-18 11:56:29.381013 | mon1 | ok: [mon3] => (item=ssh) 2026-08-18 11:56:29.381240 | mon1 | 2026-08-18 11:56:29.381491 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 11:56:29.381759 | mon1 | Tuesday 18 August 2026 11:56:29 +0000 (0:00:00.849) 0:14:24.563 ******** 2026-08-18 11:56:29.692011 | mon1 | ok: [mon1] 2026-08-18 11:56:29.692069 | mon1 | ok: [mon2] 2026-08-18 11:56:29.692079 | mon1 | ok: [mon3] 2026-08-18 11:56:29.692088 | mon1 | 2026-08-18 11:56:29.692097 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 11:56:29.692107 | mon1 | Tuesday 18 August 2026 11:56:29 +0000 (0:00:00.311) 0:14:24.875 ******** 2026-08-18 11:56:30.030023 | mon1 | ok: [mon1] 2026-08-18 11:56:30.030073 | mon1 | ok: [mon3] 2026-08-18 11:56:30.030083 | mon1 | ok: [mon2] 2026-08-18 11:56:30.030092 | mon1 | 2026-08-18 11:56:30.030102 | mon1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 11:56:30.030117 | mon1 | Tuesday 18 August 2026 11:56:30 +0000 (0:00:00.338) 0:14:25.213 ******** 2026-08-18 11:56:30.594123 | mon1 | ok: [mon1] 2026-08-18 11:56:30.594300 | mon1 | ok: [mon3] 2026-08-18 11:56:30.594533 | mon1 | ok: [mon2] 2026-08-18 11:56:30.594758 | mon1 | 2026-08-18 11:56:30.595057 | mon1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 11:56:30.595291 | mon1 | Tuesday 18 August 2026 11:56:30 +0000 (0:00:00.564) 0:14:25.778 ******** 2026-08-18 11:56:30.664679 | mon1 | skipping: [mon1] 2026-08-18 11:56:30.664946 | mon1 | skipping: [mon2] 2026-08-18 11:56:30.665179 | mon1 | skipping: [mon3] 2026-08-18 11:56:30.665406 | mon1 | 2026-08-18 11:56:30.665656 | mon1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 11:56:30.665921 | mon1 | Tuesday 18 August 2026 11:56:30 +0000 (0:00:00.071) 0:14:25.849 ******** 2026-08-18 11:56:31.151018 | mon1 | ok: [mon1] 2026-08-18 11:56:31.151075 | mon1 | ok: [mon2] 2026-08-18 11:56:31.151085 | mon1 | ok: [mon3] 2026-08-18 11:56:31.151101 | mon1 | 2026-08-18 11:56:31.151337 | mon1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 11:56:31.151640 | mon1 | Tuesday 18 August 2026 11:56:31 +0000 (0:00:00.485) 0:14:26.334 ******** 2026-08-18 11:56:31.756394 | mon1 | ok: [mon1] 2026-08-18 11:56:31.756589 | mon1 | ok: [mon2] 2026-08-18 11:56:31.756830 | mon1 | ok: [mon3] 2026-08-18 11:56:31.757104 | mon1 | 2026-08-18 11:56:31.757361 | mon1 | TASK [vexxhost.ceph.rgw : Locate the cluster admin host] *********************** 2026-08-18 11:56:31.757609 | mon1 | Tuesday 18 August 2026 11:56:31 +0000 (0:00:00.606) 0:14:26.940 ******** 2026-08-18 11:56:31.837950 | mon1 | skipping: [mon1] => (item=mon1) 2026-08-18 11:56:31.838033 | mon1 | skipping: [mon1] => (item=mon2) 2026-08-18 11:56:31.838280 | mon1 | skipping: [mon1] => (item=mon3) 2026-08-18 11:56:31.838533 | mon1 | skipping: [mon1] 2026-08-18 11:56:31.838777 | mon1 | 2026-08-18 11:56:31.839084 | mon1 | TASK [vexxhost.ceph.rgw : Select the admin host] ******************************* 2026-08-18 11:56:31.839389 | mon1 | Tuesday 18 August 2026 11:56:31 +0000 (0:00:00.080) 0:14:27.021 ******** 2026-08-18 11:56:31.919396 | mon1 | skipping: [mon1] 2026-08-18 11:56:31.919635 | mon1 | skipping: [mon2] 2026-08-18 11:56:31.919913 | mon1 | skipping: [mon3] 2026-08-18 11:56:31.920177 | mon1 | 2026-08-18 11:56:31.920500 | mon1 | TASK [vexxhost.ceph.rgw : Set the admin mon config path] *********************** 2026-08-18 11:56:31.920800 | mon1 | Tuesday 18 August 2026 11:56:31 +0000 (0:00:00.082) 0:14:27.103 ******** 2026-08-18 11:56:31.993659 | mon1 | skipping: [mon1] 2026-08-18 11:56:31.993940 | mon1 | skipping: [mon2] 2026-08-18 11:56:31.994182 | mon1 | skipping: [mon3] 2026-08-18 11:56:31.994418 | mon1 | 2026-08-18 11:56:31.994640 | mon1 | TASK [Register this RGW host] ************************************************** 2026-08-18 11:56:31.994898 | mon1 | Tuesday 18 August 2026 11:56:31 +0000 (0:00:00.074) 0:14:27.178 ******** 2026-08-18 11:56:32.064455 | mon1 | skipping: [mon1] 2026-08-18 11:56:32.064669 | mon1 | skipping: [mon2] 2026-08-18 11:56:32.064917 | mon1 | skipping: [mon3] 2026-08-18 11:56:32.065148 | mon1 | 2026-08-18 11:56:32.065396 | mon1 | TASK [vexxhost.ceph.rgw : Configure RGW multisite (realm, zonegroup, zone)] **** 2026-08-18 11:56:32.065636 | mon1 | Tuesday 18 August 2026 11:56:32 +0000 (0:00:00.071) 0:14:27.249 ******** 2026-08-18 11:56:32.102813 | mon1 | skipping: [mon1] 2026-08-18 11:56:32.103048 | mon1 | 2026-08-18 11:56:32.103327 | mon1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] ************************* 2026-08-18 11:56:32.103553 | mon1 | Tuesday 18 August 2026 11:56:32 +0000 (0:00:00.038) 0:14:27.287 ******** 2026-08-18 11:56:32.142443 | mon1 | skipping: [mon1] 2026-08-18 11:56:32.142622 | mon1 | 2026-08-18 11:56:32.142865 | mon1 | TASK [vexxhost.ceph.rgw : Remove the default zone / zonegroup / pools] ********* 2026-08-18 11:56:32.143144 | mon1 | Tuesday 18 August 2026 11:56:32 +0000 (0:00:00.039) 0:14:27.327 ******** 2026-08-18 11:56:32.235979 | mon1 | skipping: [mon1] 2026-08-18 11:56:32.236169 | mon1 | 2026-08-18 11:56:32.236442 | mon1 | PLAY [Deploy Ceph monitoring stack] ******************************************** 2026-08-18 11:56:32.236653 | mon1 | 2026-08-18 11:56:32.236945 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:56:32.237197 | mon1 | Tuesday 18 August 2026 11:56:32 +0000 (0:00:00.093) 0:14:27.421 ******** 2026-08-18 11:56:33.288990 | mon1 | ok: [mon1] 2026-08-18 11:56:33.289248 | mon1 | ok: [mon2] 2026-08-18 11:56:33.289530 | mon1 | ok: [mon3] 2026-08-18 11:56:33.289800 | mon1 | 2026-08-18 11:56:33.290165 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:56:33.290485 | mon1 | Tuesday 18 August 2026 11:56:33 +0000 (0:00:01.052) 0:14:28.473 ******** 2026-08-18 11:56:33.618743 | mon1 | ok: [mon1] 2026-08-18 11:56:33.619101 | mon1 | ok: [mon2] 2026-08-18 11:56:33.635056 | mon1 | ok: [mon3] 2026-08-18 11:56:33.635128 | mon1 | 2026-08-18 11:56:33.635149 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:56:33.635249 | mon1 | Tuesday 18 August 2026 11:56:33 +0000 (0:00:00.328) 0:14:28.801 ******** 2026-08-18 11:56:33.718549 | mon1 | skipping: [mon1] 2026-08-18 11:56:33.718775 | mon1 | skipping: [mon2] 2026-08-18 11:56:33.719098 | mon1 | skipping: [mon3] 2026-08-18 11:56:33.719325 | mon1 | 2026-08-18 11:56:33.719592 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 11:56:33.719846 | mon1 | Tuesday 18 August 2026 11:56:33 +0000 (0:00:00.101) 0:14:28.903 ******** 2026-08-18 11:56:34.052060 | mon1 | ok: [mon1] 2026-08-18 11:56:34.052115 | mon1 | ok: [mon2] 2026-08-18 11:56:34.052174 | mon1 | ok: [mon3] 2026-08-18 11:56:34.052430 | mon1 | 2026-08-18 11:56:34.052683 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:56:34.052984 | mon1 | Tuesday 18 August 2026 11:56:34 +0000 (0:00:00.332) 0:14:29.235 ******** 2026-08-18 11:56:34.141819 | mon1 | ok: [mon1] => { 2026-08-18 11:56:34.142127 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:56:34.142370 | mon1 | } 2026-08-18 11:56:34.142613 | mon1 | ok: [mon2] => { 2026-08-18 11:56:34.142927 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:56:34.143248 | mon1 | } 2026-08-18 11:56:34.143561 | mon1 | ok: [mon3] => { 2026-08-18 11:56:34.143930 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:56:34.144249 | mon1 | } 2026-08-18 11:56:34.144639 | mon1 | 2026-08-18 11:56:34.145028 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:56:34.145359 | mon1 | Tuesday 18 August 2026 11:56:34 +0000 (0:00:00.090) 0:14:29.326 ******** 2026-08-18 11:56:34.537184 | mon1 | ok: [mon2] 2026-08-18 11:56:34.537347 | mon1 | ok: [mon1] 2026-08-18 11:56:34.537598 | mon1 | ok: [mon3] 2026-08-18 11:56:34.537813 | mon1 | 2026-08-18 11:56:34.538163 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:56:34.538360 | mon1 | Tuesday 18 August 2026 11:56:34 +0000 (0:00:00.394) 0:14:29.721 ******** 2026-08-18 11:56:34.645736 | mon1 | skipping: [mon1] 2026-08-18 11:56:34.646115 | mon1 | skipping: [mon2] 2026-08-18 11:56:34.646313 | mon1 | skipping: [mon3] 2026-08-18 11:56:34.646552 | mon1 | 2026-08-18 11:56:34.646817 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:56:34.647161 | mon1 | Tuesday 18 August 2026 11:56:34 +0000 (0:00:00.108) 0:14:29.830 ******** 2026-08-18 11:56:34.756670 | mon1 | skipping: [mon1] 2026-08-18 11:56:34.756929 | mon1 | skipping: [mon2] 2026-08-18 11:56:34.757183 | mon1 | skipping: [mon3] 2026-08-18 11:56:34.757423 | mon1 | 2026-08-18 11:56:34.757688 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:56:34.757962 | mon1 | Tuesday 18 August 2026 11:56:34 +0000 (0:00:00.110) 0:14:29.941 ******** 2026-08-18 11:56:35.044649 | mon1 | ok: [mon1] 2026-08-18 11:56:35.044844 | mon1 | ok: [mon2] 2026-08-18 11:56:35.045117 | mon1 | ok: [mon3] 2026-08-18 11:56:35.045339 | mon1 | 2026-08-18 11:56:35.045613 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:56:35.045843 | mon1 | Tuesday 18 August 2026 11:56:35 +0000 (0:00:00.287) 0:14:30.229 ******** 2026-08-18 11:56:36.155984 | mon1 | ok: [mon1] 2026-08-18 11:56:36.156070 | mon1 | ok: [mon3] 2026-08-18 11:56:36.156087 | mon1 | ok: [mon2] 2026-08-18 11:56:36.156288 | mon1 | 2026-08-18 11:56:36.156596 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:56:36.156853 | mon1 | Tuesday 18 August 2026 11:56:36 +0000 (0:00:01.111) 0:14:31.340 ******** 2026-08-18 11:56:36.252140 | mon1 | ok: [mon1] => { 2026-08-18 11:56:36.252455 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:56:36.252688 | mon1 | } 2026-08-18 11:56:36.252971 | mon1 | ok: [mon2] => { 2026-08-18 11:56:36.253211 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:56:36.253446 | mon1 | } 2026-08-18 11:56:36.253674 | mon1 | ok: [mon3] => { 2026-08-18 11:56:36.253937 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:56:36.254159 | mon1 | } 2026-08-18 11:56:36.254372 | mon1 | 2026-08-18 11:56:36.254614 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:56:36.254852 | mon1 | Tuesday 18 August 2026 11:56:36 +0000 (0:00:00.096) 0:14:31.436 ******** 2026-08-18 11:56:36.713376 | mon1 | ok: [mon1] 2026-08-18 11:56:36.713551 | mon1 | ok: [mon2] 2026-08-18 11:56:36.713777 | mon1 | ok: [mon3] 2026-08-18 11:56:36.714023 | mon1 | 2026-08-18 11:56:36.714309 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:56:36.714593 | mon1 | Tuesday 18 August 2026 11:56:36 +0000 (0:00:00.461) 0:14:31.897 ******** 2026-08-18 11:56:38.955109 | mon1 | ok: [mon1] 2026-08-18 11:56:38.955225 | mon1 | ok: [mon3] 2026-08-18 11:56:38.955241 | mon1 | ok: [mon2] 2026-08-18 11:56:38.955915 | mon1 | 2026-08-18 11:56:38.955928 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 11:56:38.956073 | mon1 | Tuesday 18 August 2026 11:56:38 +0000 (0:00:02.241) 0:14:34.138 ******** 2026-08-18 11:56:39.030924 | mon1 | skipping: [mon1] 2026-08-18 11:56:39.030983 | mon1 | skipping: [mon2] 2026-08-18 11:56:39.030996 | mon1 | skipping: [mon3] 2026-08-18 11:56:39.031008 | mon1 | 2026-08-18 11:56:39.031020 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 11:56:39.031033 | mon1 | Tuesday 18 August 2026 11:56:39 +0000 (0:00:00.074) 0:14:34.213 ******** 2026-08-18 11:56:39.102953 | mon1 | skipping: [mon1] 2026-08-18 11:56:39.103018 | mon1 | skipping: [mon2] 2026-08-18 11:56:39.103030 | mon1 | skipping: [mon3] 2026-08-18 11:56:39.103042 | mon1 | 2026-08-18 11:56:39.103054 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 11:56:39.103067 | mon1 | Tuesday 18 August 2026 11:56:39 +0000 (0:00:00.071) 0:14:34.285 ******** 2026-08-18 11:56:39.173071 | mon1 | skipping: [mon1] 2026-08-18 11:56:39.173117 | mon1 | skipping: [mon2] 2026-08-18 11:56:39.173125 | mon1 | skipping: [mon3] 2026-08-18 11:56:39.173133 | mon1 | 2026-08-18 11:56:39.173141 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 11:56:39.173277 | mon1 | Tuesday 18 August 2026 11:56:39 +0000 (0:00:00.070) 0:14:34.356 ******** 2026-08-18 11:56:40.415383 | mon1 | ok: [mon1] 2026-08-18 11:56:40.415948 | mon1 | ok: [mon3] 2026-08-18 11:56:40.416381 | mon1 | ok: [mon2] 2026-08-18 11:56:40.416763 | mon1 | 2026-08-18 11:56:40.417157 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 11:56:40.417503 | mon1 | Tuesday 18 August 2026 11:56:40 +0000 (0:00:01.243) 0:14:35.600 ******** 2026-08-18 11:56:41.010674 | mon1 | ok: [mon1] 2026-08-18 11:56:41.011077 | mon1 | ok: [mon3] 2026-08-18 11:56:41.011386 | mon1 | ok: [mon2] 2026-08-18 11:56:41.012088 | mon1 | 2026-08-18 11:56:41.012150 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 11:56:41.012280 | mon1 | Tuesday 18 August 2026 11:56:41 +0000 (0:00:00.595) 0:14:36.195 ******** 2026-08-18 11:56:42.241729 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:56:42.242016 | mon1 | ok: [mon3] => (item={'path': '/etc/containerd'}) 2026-08-18 11:56:42.242265 | mon1 | ok: [mon2] => (item={'path': '/etc/containerd'}) 2026-08-18 11:56:42.242512 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:56:42.242759 | mon1 | ok: [mon3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:56:42.243047 | mon1 | ok: [mon2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:56:42.243288 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:56:42.243529 | mon1 | ok: [mon3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:56:42.243776 | mon1 | ok: [mon2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:56:42.244076 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:56:42.244333 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:56:42.244586 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:56:42.244936 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:56:42.245204 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:56:42.245456 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:56:42.245681 | mon1 | 2026-08-18 11:56:42.245898 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 11:56:42.246064 | mon1 | Tuesday 18 August 2026 11:56:42 +0000 (0:00:01.230) 0:14:37.426 ******** 2026-08-18 11:56:42.964039 | mon1 | ok: [mon1] 2026-08-18 11:56:42.964227 | mon1 | ok: [mon2] 2026-08-18 11:56:42.964459 | mon1 | ok: [mon3] 2026-08-18 11:56:42.964718 | mon1 | 2026-08-18 11:56:42.964996 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:56:42.965245 | mon1 | Tuesday 18 August 2026 11:56:42 +0000 (0:00:00.702) 0:14:38.129 ******** 2026-08-18 11:56:42.965465 | mon1 | 2026-08-18 11:56:42.965703 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:56:42.965989 | mon1 | Tuesday 18 August 2026 11:56:42 +0000 (0:00:00.007) 0:14:38.136 ******** 2026-08-18 11:56:42.966202 | mon1 | 2026-08-18 11:56:42.966458 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:56:42.966713 | mon1 | Tuesday 18 August 2026 11:56:42 +0000 (0:00:00.006) 0:14:38.142 ******** 2026-08-18 11:56:42.966991 | mon1 | 2026-08-18 11:56:42.967232 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 11:56:42.967500 | mon1 | Tuesday 18 August 2026 11:56:42 +0000 (0:00:00.006) 0:14:38.148 ******** 2026-08-18 11:56:43.461014 | mon1 | ok: [mon1] 2026-08-18 11:56:43.461143 | mon1 | ok: [mon3] 2026-08-18 11:56:43.461425 | mon1 | ok: [mon2] 2026-08-18 11:56:43.461566 | mon1 | 2026-08-18 11:56:43.461739 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:56:43.461919 | mon1 | Tuesday 18 August 2026 11:56:43 +0000 (0:00:00.496) 0:14:38.645 ******** 2026-08-18 11:56:43.753292 | mon1 | ok: [mon1] 2026-08-18 11:56:43.753386 | mon1 | ok: [mon2] 2026-08-18 11:56:43.753456 | mon1 | ok: [mon3] 2026-08-18 11:56:43.753555 | mon1 | 2026-08-18 11:56:43.753669 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:56:43.754958 | mon1 | Tuesday 18 August 2026 11:56:43 +0000 (0:00:00.292) 0:14:38.937 ******** 2026-08-18 11:56:43.849786 | mon1 | ok: [mon1] => { 2026-08-18 11:56:43.850099 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:56:43.850276 | mon1 | } 2026-08-18 11:56:43.850510 | mon1 | ok: [mon2] => { 2026-08-18 11:56:43.850765 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:56:43.851033 | mon1 | } 2026-08-18 11:56:43.851279 | mon1 | ok: [mon3] => { 2026-08-18 11:56:43.851542 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:56:43.851773 | mon1 | } 2026-08-18 11:56:43.852029 | mon1 | 2026-08-18 11:56:43.852299 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:56:43.852544 | mon1 | Tuesday 18 August 2026 11:56:43 +0000 (0:00:00.096) 0:14:39.034 ******** 2026-08-18 11:56:44.314352 | mon1 | ok: [mon1] 2026-08-18 11:56:44.314541 | mon1 | ok: [mon2] 2026-08-18 11:56:44.314782 | mon1 | ok: [mon3] 2026-08-18 11:56:44.315086 | mon1 | 2026-08-18 11:56:44.315341 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:56:44.315590 | mon1 | Tuesday 18 August 2026 11:56:44 +0000 (0:00:00.464) 0:14:39.498 ******** 2026-08-18 11:56:47.696286 | mon1 | ok: [mon1] 2026-08-18 11:56:47.696351 | mon1 | ok: [mon3] 2026-08-18 11:56:47.696466 | mon1 | ok: [mon2] 2026-08-18 11:56:47.696567 | mon1 | 2026-08-18 11:56:47.696682 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 11:56:47.696796 | mon1 | Tuesday 18 August 2026 11:56:47 +0000 (0:00:03.382) 0:14:42.881 ******** 2026-08-18 11:56:48.839475 | mon1 | ok: [mon1] 2026-08-18 11:56:48.839667 | mon1 | ok: [mon3] 2026-08-18 11:56:48.839923 | mon1 | ok: [mon2] 2026-08-18 11:56:48.840155 | mon1 | 2026-08-18 11:56:48.840410 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 11:56:48.840658 | mon1 | Tuesday 18 August 2026 11:56:48 +0000 (0:00:01.142) 0:14:44.023 ******** 2026-08-18 11:56:49.130815 | mon1 | ok: [mon1] 2026-08-18 11:56:49.131048 | mon1 | ok: [mon2] 2026-08-18 11:56:49.131202 | mon1 | ok: [mon3] 2026-08-18 11:56:49.131341 | mon1 | 2026-08-18 11:56:49.131507 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 11:56:49.131668 | mon1 | Tuesday 18 August 2026 11:56:49 +0000 (0:00:00.291) 0:14:44.314 ******** 2026-08-18 11:56:49.739423 | mon1 | ok: [mon1] 2026-08-18 11:56:49.739639 | mon1 | ok: [mon2] 2026-08-18 11:56:49.739912 | mon1 | ok: [mon3] 2026-08-18 11:56:49.740167 | mon1 | 2026-08-18 11:56:49.740423 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 11:56:49.740670 | mon1 | Tuesday 18 August 2026 11:56:49 +0000 (0:00:00.609) 0:14:44.924 ******** 2026-08-18 11:56:50.485082 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 11:56:50.485188 | mon1 | ok: [mon3] => (item={'path': '/etc/docker'}) 2026-08-18 11:56:50.485202 | mon1 | ok: [mon2] => (item={'path': '/etc/docker'}) 2026-08-18 11:56:50.485215 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:56:50.485228 | mon1 | ok: [mon2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:56:50.485248 | mon1 | ok: [mon3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:56:50.486782 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:56:50.486844 | mon1 | ok: [mon2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:56:50.486857 | mon1 | ok: [mon3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:56:50.486899 | mon1 | 2026-08-18 11:56:50.486916 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 11:56:50.486929 | mon1 | Tuesday 18 August 2026 11:56:50 +0000 (0:00:00.744) 0:14:45.668 ******** 2026-08-18 11:56:51.071923 | mon1 | ok: [mon1] 2026-08-18 11:56:51.071993 | mon1 | ok: [mon2] 2026-08-18 11:56:51.072042 | mon1 | ok: [mon3] 2026-08-18 11:56:51.072052 | mon1 | 2026-08-18 11:56:51.072061 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 11:56:51.072070 | mon1 | Tuesday 18 August 2026 11:56:51 +0000 (0:00:00.584) 0:14:46.253 ******** 2026-08-18 11:56:51.671944 | mon1 | ok: [mon1] 2026-08-18 11:56:51.672000 | mon1 | ok: [mon2] 2026-08-18 11:56:51.672009 | mon1 | ok: [mon3] 2026-08-18 11:56:51.672019 | mon1 | 2026-08-18 11:56:51.672028 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:56:51.672037 | mon1 | Tuesday 18 August 2026 11:56:51 +0000 (0:00:00.579) 0:14:46.832 ******** 2026-08-18 11:56:51.672046 | mon1 | 2026-08-18 11:56:51.672054 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:56:51.672063 | mon1 | Tuesday 18 August 2026 11:56:51 +0000 (0:00:00.007) 0:14:46.840 ******** 2026-08-18 11:56:51.672071 | mon1 | 2026-08-18 11:56:51.672319 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:56:51.672626 | mon1 | Tuesday 18 August 2026 11:56:51 +0000 (0:00:00.006) 0:14:46.846 ******** 2026-08-18 11:56:51.672967 | mon1 | 2026-08-18 11:56:51.673296 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 11:56:51.673598 | mon1 | Tuesday 18 August 2026 11:56:51 +0000 (0:00:00.006) 0:14:46.853 ******** 2026-08-18 11:56:52.166635 | mon1 | ok: [mon1] 2026-08-18 11:56:52.167051 | mon1 | ok: [mon2] 2026-08-18 11:56:52.167371 | mon1 | ok: [mon3] 2026-08-18 11:56:52.167659 | mon1 | 2026-08-18 11:56:52.168014 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:56:52.168394 | mon1 | Tuesday 18 August 2026 11:56:52 +0000 (0:00:00.497) 0:14:47.350 ******** 2026-08-18 11:56:52.245673 | mon1 | ok: [mon1] => { 2026-08-18 11:56:52.246112 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:56:52.246434 | mon1 | } 2026-08-18 11:56:52.284665 | mon1 | ok: [mon2] => { 2026-08-18 11:56:52.285085 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:56:52.285392 | mon1 | } 2026-08-18 11:56:52.285694 | mon1 | ok: [mon3] => { 2026-08-18 11:56:52.286070 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:56:52.286406 | mon1 | } 2026-08-18 11:56:52.286687 | mon1 | 2026-08-18 11:56:52.287035 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:56:52.287349 | mon1 | Tuesday 18 August 2026 11:56:52 +0000 (0:00:00.118) 0:14:47.468 ******** 2026-08-18 11:56:52.657578 | mon1 | ok: [mon1] 2026-08-18 11:56:52.657864 | mon1 | ok: [mon2] 2026-08-18 11:56:52.658205 | mon1 | ok: [mon3] 2026-08-18 11:56:52.658445 | mon1 | 2026-08-18 11:56:52.658718 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:56:52.659018 | mon1 | Tuesday 18 August 2026 11:56:52 +0000 (0:00:00.373) 0:14:47.841 ******** 2026-08-18 11:56:52.742628 | mon1 | skipping: [mon1] 2026-08-18 11:56:52.742761 | mon1 | skipping: [mon2] 2026-08-18 11:56:52.742938 | mon1 | skipping: [mon3] 2026-08-18 11:56:52.743075 | mon1 | 2026-08-18 11:56:52.743312 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 11:56:52.743471 | mon1 | Tuesday 18 August 2026 11:56:52 +0000 (0:00:00.085) 0:14:47.927 ******** 2026-08-18 11:56:52.831296 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:56:52.831629 | mon1 | ok: [mon2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:56:52.831934 | mon1 | ok: [mon3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:56:52.832163 | mon1 | 2026-08-18 11:56:52.832414 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 11:56:52.832665 | mon1 | Tuesday 18 August 2026 11:56:52 +0000 (0:00:00.087) 0:14:48.015 ******** 2026-08-18 11:56:53.973558 | mon1 | ok: [mon1] 2026-08-18 11:56:53.973783 | mon1 | ok: [mon2] 2026-08-18 11:56:53.974085 | mon1 | ok: [mon3] 2026-08-18 11:56:53.974310 | mon1 | 2026-08-18 11:56:53.974605 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 11:56:53.974889 | mon1 | Tuesday 18 August 2026 11:56:53 +0000 (0:00:01.142) 0:14:49.158 ******** 2026-08-18 11:56:54.832997 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-08-18 11:56:54.833146 | mon1 | ok: [mon2] => (item=systemd-timesyncd) 2026-08-18 11:56:54.833458 | mon1 | ok: [mon3] => (item=systemd-timesyncd) 2026-08-18 11:56:54.833714 | mon1 | ok: [mon1] => (item=ssh) 2026-08-18 11:56:54.834053 | mon1 | ok: [mon2] => (item=ssh) 2026-08-18 11:56:54.834355 | mon1 | ok: [mon3] => (item=ssh) 2026-08-18 11:56:54.834606 | mon1 | 2026-08-18 11:56:54.834905 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 11:56:54.835191 | mon1 | Tuesday 18 August 2026 11:56:54 +0000 (0:00:00.859) 0:14:50.017 ******** 2026-08-18 11:56:55.114959 | mon1 | ok: [mon1] 2026-08-18 11:56:55.115011 | mon1 | ok: [mon2] 2026-08-18 11:56:55.115024 | mon1 | ok: [mon3] 2026-08-18 11:56:55.115036 | mon1 | 2026-08-18 11:56:55.115054 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 11:56:55.115334 | mon1 | Tuesday 18 August 2026 11:56:55 +0000 (0:00:00.281) 0:14:50.298 ******** 2026-08-18 11:56:55.457280 | mon1 | ok: [mon1] 2026-08-18 11:56:55.457349 | mon1 | ok: [mon2] 2026-08-18 11:56:55.457463 | mon1 | ok: [mon3] 2026-08-18 11:56:55.457560 | mon1 | 2026-08-18 11:56:55.457679 | mon1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 11:56:55.457790 | mon1 | Tuesday 18 August 2026 11:56:55 +0000 (0:00:00.342) 0:14:50.641 ******** 2026-08-18 11:56:56.025409 | mon1 | ok: [mon1] 2026-08-18 11:56:56.025544 | mon1 | ok: [mon2] 2026-08-18 11:56:56.025726 | mon1 | ok: [mon3] 2026-08-18 11:56:56.025938 | mon1 | 2026-08-18 11:56:56.026117 | mon1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 11:56:56.026297 | mon1 | Tuesday 18 August 2026 11:56:56 +0000 (0:00:00.567) 0:14:51.208 ******** 2026-08-18 11:56:56.057599 | mon1 | skipping: [mon1] 2026-08-18 11:56:56.088752 | mon1 | skipping: [mon2] 2026-08-18 11:56:56.088791 | mon1 | skipping: [mon3] 2026-08-18 11:56:56.088797 | mon1 | 2026-08-18 11:56:56.088803 | mon1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 11:56:56.088809 | mon1 | Tuesday 18 August 2026 11:56:56 +0000 (0:00:00.064) 0:14:51.273 ******** 2026-08-18 11:56:56.531911 | mon1 | ok: [mon1] 2026-08-18 11:56:56.531966 | mon1 | ok: [mon2] 2026-08-18 11:56:56.531979 | mon1 | ok: [mon3] 2026-08-18 11:56:56.531991 | mon1 | 2026-08-18 11:56:56.532003 | mon1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 11:56:56.532015 | mon1 | Tuesday 18 August 2026 11:56:56 +0000 (0:00:00.441) 0:14:51.714 ******** 2026-08-18 11:56:57.129019 | mon1 | ok: [mon1] 2026-08-18 11:56:57.129090 | mon1 | ok: [mon2] 2026-08-18 11:56:57.130023 | mon1 | ok: [mon3] 2026-08-18 11:56:57.130080 | mon1 | 2026-08-18 11:56:57.130094 | mon1 | TASK [vexxhost.ceph.monitoring : Locate the cluster admin host] **************** 2026-08-18 11:56:57.130107 | mon1 | Tuesday 18 August 2026 11:56:57 +0000 (0:00:00.597) 0:14:52.312 ******** 2026-08-18 11:56:57.887952 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:56:57.888011 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:56:57.888025 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:56:57.888037 | mon1 | 2026-08-18 11:56:57.888049 | mon1 | TASK [vexxhost.ceph.monitoring : Select the admin host] ************************ 2026-08-18 11:56:57.888061 | mon1 | Tuesday 18 August 2026 11:56:57 +0000 (0:00:00.757) 0:14:53.070 ******** 2026-08-18 11:56:57.976997 | mon1 | ok: [mon1] 2026-08-18 11:56:57.977058 | mon1 | ok: [mon2] 2026-08-18 11:56:57.977078 | mon1 | ok: [mon3] 2026-08-18 11:56:57.977847 | mon1 | 2026-08-18 11:56:57.977942 | mon1 | TASK [vexxhost.ceph.monitoring : Set the admin mon config path] **************** 2026-08-18 11:56:57.977960 | mon1 | Tuesday 18 August 2026 11:56:57 +0000 (0:00:00.090) 0:14:53.160 ******** 2026-08-18 11:56:58.055845 | mon1 | ok: [mon1] 2026-08-18 11:56:58.055932 | mon1 | ok: [mon2] 2026-08-18 11:56:58.055945 | mon1 | ok: [mon3] 2026-08-18 11:56:58.055978 | mon1 | 2026-08-18 11:56:58.055987 | mon1 | TASK [vexxhost.ceph.monitoring : Pin monitoring container images] ************** 2026-08-18 11:56:58.055996 | mon1 | Tuesday 18 August 2026 11:56:58 +0000 (0:00:00.078) 0:14:53.239 ******** 2026-08-18 11:56:58.091296 | mon1 | skipping: [mon1] 2026-08-18 11:56:58.091341 | mon1 | 2026-08-18 11:56:58.091351 | mon1 | TASK [vexxhost.ceph.monitoring : Apply the monitoring service specs] *********** 2026-08-18 11:56:58.091360 | mon1 | Tuesday 18 August 2026 11:56:58 +0000 (0:00:00.036) 0:14:53.275 ******** 2026-08-18 11:57:01.309931 | mon1 | changed: [mon1] => (item=ceph-exporter) 2026-08-18 11:57:01.309993 | mon1 | 2026-08-18 11:57:01.310007 | mon1 | PLAY RECAP ********************************************************************* 2026-08-18 11:57:01.310020 | mon1 | mon1 : ok=213 changed=37 unreachable=0 failed=0 skipped=57 rescued=0 ignored=0 2026-08-18 11:57:01.310032 | mon1 | mon2 : ok=191 changed=27 unreachable=0 failed=0 skipped=52 rescued=0 ignored=0 2026-08-18 11:57:01.310043 | mon1 | mon3 : ok=191 changed=27 unreachable=0 failed=0 skipped=52 rescued=0 ignored=0 2026-08-18 11:57:01.310073 | mon1 | osd1 : ok=53 changed=27 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-08-18 11:57:01.310085 | mon1 | 2026-08-18 11:57:01.310097 | mon1 | 2026-08-18 11:57:01.310108 | mon1 | TASKS RECAP ******************************************************************** 2026-08-18 11:57:01.310398 | mon1 | Tuesday 18 August 2026 11:57:01 +0000 (0:00:03.217) 0:14:56.492 ******** 2026-08-18 11:57:01.310703 | mon1 | =============================================================================== 2026-08-18 11:57:01.311093 | mon1 | vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices ------ 513.51s 2026-08-18 11:57:01.311423 | mon1 | vexxhost.ceph.mon : Bootstrap the cluster ------------------------------ 41.92s 2026-08-18 11:57:01.311669 | mon1 | vexxhost.ceph.cephadm : Pre-pull the Ceph image ------------------------ 41.71s 2026-08-18 11:57:01.311866 | mon1 | vexxhost.ceph.cephadm : Pre-pull the Ceph image ------------------------ 41.31s 2026-08-18 11:57:01.312091 | mon1 | vexxhost.ceph.cephadm_host : Register the host (labels) ---------------- 21.17s 2026-08-18 11:57:01.312326 | mon1 | vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host -- 15.27s 2026-08-18 11:57:01.312552 | mon1 | vexxhost.containers.containerd : Install AppArmor packages ------------- 12.80s 2026-08-18 11:57:01.312764 | mon1 | vexxhost.ceph.cephadm_host : Register the host (labels) ---------------- 10.74s 2026-08-18 11:57:01.312994 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.97s 2026-08-18 11:57:01.313208 | mon1 | vexxhost.ceph.mgr : Configure ceph-mgr modules -------------------------- 7.96s 2026-08-18 11:57:01.313425 | mon1 | vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate --- 7.75s 2026-08-18 11:57:01.313635 | mon1 | vexxhost.ceph.mon : Wait for this monitor's daemon to be present -------- 6.43s 2026-08-18 11:57:01.313846 | mon1 | vexxhost.ceph.mgr : Wait for this manager's daemon to be present -------- 6.28s 2026-08-18 11:57:01.314062 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.71s 2026-08-18 11:57:01.314275 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.70s 2026-08-18 11:57:01.314471 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.52s 2026-08-18 11:57:01.314682 | mon1 | vexxhost.ceph.mgr : Apply the manager service spec ---------------------- 3.47s 2026-08-18 11:57:01.314906 | mon1 | vexxhost.ceph.mon : Apply the monitor service spec ---------------------- 3.41s 2026-08-18 11:57:01.315132 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.38s 2026-08-18 11:57:01.315342 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.29s 2026-08-18 11:57:01.413641 | mon1 | INFO [default > converge] Executed: Successful 2026-08-18 11:57:01.422623 | mon1 | INFO [default > idempotence] Executing 2026-08-18 11:57:02.618595 | mon1 | 2026-08-18 11:57:02.618843 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-18 11:57:02.619098 | mon1 | 2026-08-18 11:57:02.619364 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:57:02.619605 | mon1 | Tuesday 18 August 2026 11:57:02 +0000 (0:00:00.063) 0:00:00.063 ******** 2026-08-18 11:57:03.850353 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-18 11:57:03.850442 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 11:57:03.850568 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:57:03.850687 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:57:03.850802 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:57:03.909916 | mon1 | [WARNING]: Platform linux on host mon2 is using the discovered Python 2026-08-18 11:57:03.909951 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 11:57:03.909958 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:57:03.909963 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:57:03.909968 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:57:03.916203 | mon1 | [WARNING]: Platform linux on host mon3 is using the discovered Python 2026-08-18 11:57:03.916446 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 11:57:03.916731 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:57:03.917032 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:57:03.917294 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:57:03.979115 | mon1 | ok: [mon1] 2026-08-18 11:57:03.979331 | mon1 | ok: [mon2] 2026-08-18 11:57:03.979589 | mon1 | ok: [mon3] 2026-08-18 11:57:03.979827 | mon1 | 2026-08-18 11:57:03.980108 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:57:03.980427 | mon1 | Tuesday 18 August 2026 11:57:03 +0000 (0:00:01.360) 0:00:01.424 ******** 2026-08-18 11:57:04.343283 | mon1 | ok: [mon3] 2026-08-18 11:57:04.343395 | mon1 | ok: [mon1] 2026-08-18 11:57:04.343566 | mon1 | ok: [mon2] 2026-08-18 11:57:04.343698 | mon1 | 2026-08-18 11:57:04.343854 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:57:04.344021 | mon1 | Tuesday 18 August 2026 11:57:04 +0000 (0:00:00.364) 0:00:01.788 ******** 2026-08-18 11:57:04.384944 | mon1 | skipping: [mon1] 2026-08-18 11:57:04.444812 | mon1 | skipping: [mon2] 2026-08-18 11:57:04.444913 | mon1 | skipping: [mon3] 2026-08-18 11:57:04.445078 | mon1 | 2026-08-18 11:57:04.445236 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 11:57:04.445400 | mon1 | Tuesday 18 August 2026 11:57:04 +0000 (0:00:00.101) 0:00:01.890 ******** 2026-08-18 11:57:04.901906 | mon1 | ok: [mon1] 2026-08-18 11:57:04.901936 | mon1 | ok: [mon3] 2026-08-18 11:57:04.901942 | mon1 | ok: [mon2] 2026-08-18 11:57:04.901947 | mon1 | 2026-08-18 11:57:04.901953 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:57:04.901959 | mon1 | Tuesday 18 August 2026 11:57:04 +0000 (0:00:00.454) 0:00:02.344 ******** 2026-08-18 11:57:05.009971 | mon1 | ok: [mon1] => { 2026-08-18 11:57:05.010230 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:57:05.010465 | mon1 | } 2026-08-18 11:57:05.010704 | mon1 | ok: [mon2] => { 2026-08-18 11:57:05.010987 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:57:05.011217 | mon1 | } 2026-08-18 11:57:05.011453 | mon1 | ok: [mon3] => { 2026-08-18 11:57:05.011800 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:57:05.012056 | mon1 | } 2026-08-18 11:57:05.012277 | mon1 | 2026-08-18 11:57:05.012525 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:57:05.012781 | mon1 | Tuesday 18 August 2026 11:57:05 +0000 (0:00:00.110) 0:00:02.455 ******** 2026-08-18 11:57:05.515291 | mon1 | ok: [mon1] 2026-08-18 11:57:05.515504 | mon1 | ok: [mon2] 2026-08-18 11:57:05.515766 | mon1 | ok: [mon3] 2026-08-18 11:57:05.516023 | mon1 | 2026-08-18 11:57:05.516268 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:57:05.516506 | mon1 | Tuesday 18 August 2026 11:57:05 +0000 (0:00:00.505) 0:00:02.960 ******** 2026-08-18 11:57:05.553411 | mon1 | skipping: [mon1] 2026-08-18 11:57:05.635466 | mon1 | skipping: [mon2] 2026-08-18 11:57:05.635785 | mon1 | skipping: [mon3] 2026-08-18 11:57:05.636232 | mon1 | 2026-08-18 11:57:05.636508 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:57:05.636715 | mon1 | Tuesday 18 August 2026 11:57:05 +0000 (0:00:00.120) 0:00:03.080 ******** 2026-08-18 11:57:05.666589 | mon1 | skipping: [mon1] 2026-08-18 11:57:05.750343 | mon1 | skipping: [mon2] 2026-08-18 11:57:05.750581 | mon1 | skipping: [mon3] 2026-08-18 11:57:05.750800 | mon1 | 2026-08-18 11:57:05.751087 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:57:05.751334 | mon1 | Tuesday 18 August 2026 11:57:05 +0000 (0:00:00.114) 0:00:03.195 ******** 2026-08-18 11:57:06.051772 | mon1 | ok: [mon1] 2026-08-18 11:57:06.052050 | mon1 | ok: [mon2] 2026-08-18 11:57:06.052287 | mon1 | ok: [mon3] 2026-08-18 11:57:06.052513 | mon1 | 2026-08-18 11:57:06.052774 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:57:06.053071 | mon1 | Tuesday 18 August 2026 11:57:06 +0000 (0:00:00.301) 0:00:03.496 ******** 2026-08-18 11:57:07.368614 | mon1 | ok: [mon1] 2026-08-18 11:57:07.368718 | mon1 | ok: [mon3] 2026-08-18 11:57:07.369228 | mon1 | ok: [mon2] 2026-08-18 11:57:07.369291 | mon1 | 2026-08-18 11:57:07.369511 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:57:07.369761 | mon1 | Tuesday 18 August 2026 11:57:07 +0000 (0:00:01.316) 0:00:04.813 ******** 2026-08-18 11:57:07.598939 | mon1 | ok: [mon1] => { 2026-08-18 11:57:07.599001 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:57:07.599120 | mon1 | } 2026-08-18 11:57:07.599284 | mon1 | ok: [mon2] => { 2026-08-18 11:57:07.599563 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:57:07.599809 | mon1 | } 2026-08-18 11:57:07.600119 | mon1 | ok: [mon3] => { 2026-08-18 11:57:07.600393 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:57:07.600638 | mon1 | } 2026-08-18 11:57:07.600882 | mon1 | 2026-08-18 11:57:07.601169 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:57:07.601433 | mon1 | Tuesday 18 August 2026 11:57:07 +0000 (0:00:00.230) 0:00:05.043 ******** 2026-08-18 11:57:08.200201 | mon1 | ok: [mon1] 2026-08-18 11:57:08.200250 | mon1 | ok: [mon3] 2026-08-18 11:57:08.200263 | mon1 | ok: [mon2] 2026-08-18 11:57:08.200274 | mon1 | 2026-08-18 11:57:08.200287 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:57:08.200299 | mon1 | Tuesday 18 August 2026 11:57:08 +0000 (0:00:00.598) 0:00:05.642 ******** 2026-08-18 11:57:10.661048 | mon1 | ok: [mon1] 2026-08-18 11:57:10.661123 | mon1 | ok: [mon2] 2026-08-18 11:57:10.661136 | mon1 | ok: [mon3] 2026-08-18 11:57:10.661148 | mon1 | 2026-08-18 11:57:10.661167 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 11:57:10.661305 | mon1 | Tuesday 18 August 2026 11:57:10 +0000 (0:00:02.462) 0:00:08.104 ******** 2026-08-18 11:57:10.725719 | mon1 | skipping: [mon1] 2026-08-18 11:57:10.725951 | mon1 | skipping: [mon2] 2026-08-18 11:57:10.726188 | mon1 | skipping: [mon3] 2026-08-18 11:57:10.726404 | mon1 | 2026-08-18 11:57:10.726676 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 11:57:10.726959 | mon1 | Tuesday 18 August 2026 11:57:10 +0000 (0:00:00.065) 0:00:08.170 ******** 2026-08-18 11:57:10.760346 | mon1 | skipping: [mon1] 2026-08-18 11:57:10.798039 | mon1 | skipping: [mon2] 2026-08-18 11:57:10.798221 | mon1 | skipping: [mon3] 2026-08-18 11:57:10.798442 | mon1 | 2026-08-18 11:57:10.798684 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 11:57:10.798961 | mon1 | Tuesday 18 August 2026 11:57:10 +0000 (0:00:00.072) 0:00:08.243 ******** 2026-08-18 11:57:10.867188 | mon1 | skipping: [mon1] 2026-08-18 11:57:10.867399 | mon1 | skipping: [mon2] 2026-08-18 11:57:10.867650 | mon1 | skipping: [mon3] 2026-08-18 11:57:10.867898 | mon1 | 2026-08-18 11:57:10.868154 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 11:57:10.868398 | mon1 | Tuesday 18 August 2026 11:57:10 +0000 (0:00:00.069) 0:00:08.312 ******** 2026-08-18 11:57:12.124194 | mon1 | ok: [mon1] 2026-08-18 11:57:12.124374 | mon1 | ok: [mon2] 2026-08-18 11:57:12.124607 | mon1 | ok: [mon3] 2026-08-18 11:57:12.124857 | mon1 | 2026-08-18 11:57:12.125184 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 11:57:12.125426 | mon1 | Tuesday 18 August 2026 11:57:12 +0000 (0:00:01.256) 0:00:09.568 ******** 2026-08-18 11:57:12.725818 | mon1 | ok: [mon1] 2026-08-18 11:57:12.726019 | mon1 | ok: [mon2] 2026-08-18 11:57:12.726268 | mon1 | ok: [mon3] 2026-08-18 11:57:12.726486 | mon1 | 2026-08-18 11:57:12.727113 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 11:57:12.727361 | mon1 | Tuesday 18 August 2026 11:57:12 +0000 (0:00:00.602) 0:00:10.170 ******** 2026-08-18 11:57:13.976073 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:57:13.976300 | mon1 | ok: [mon2] => (item={'path': '/etc/containerd'}) 2026-08-18 11:57:13.976541 | mon1 | ok: [mon3] => (item={'path': '/etc/containerd'}) 2026-08-18 11:57:13.976797 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:57:13.977105 | mon1 | ok: [mon2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:57:13.977328 | mon1 | ok: [mon3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:57:13.978043 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:57:13.978097 | mon1 | ok: [mon2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:57:13.978113 | mon1 | ok: [mon3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:57:13.978322 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:57:13.978574 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:57:13.978824 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:57:13.979118 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:57:13.979359 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:57:13.979901 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:57:13.980141 | mon1 | 2026-08-18 11:57:13.980405 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 11:57:13.980632 | mon1 | Tuesday 18 August 2026 11:57:13 +0000 (0:00:01.250) 0:00:11.421 ******** 2026-08-18 11:57:14.744558 | mon1 | ok: [mon1] 2026-08-18 11:57:14.744766 | mon1 | ok: [mon2] 2026-08-18 11:57:14.745066 | mon1 | ok: [mon3] 2026-08-18 11:57:14.745314 | mon1 | 2026-08-18 11:57:14.745852 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:57:14.745901 | mon1 | Tuesday 18 August 2026 11:57:14 +0000 (0:00:00.743) 0:00:12.164 ******** 2026-08-18 11:57:14.746078 | mon1 | 2026-08-18 11:57:14.746342 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:57:14.746592 | mon1 | Tuesday 18 August 2026 11:57:14 +0000 (0:00:00.008) 0:00:12.173 ******** 2026-08-18 11:57:14.746799 | mon1 | 2026-08-18 11:57:14.747184 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:57:14.747731 | mon1 | Tuesday 18 August 2026 11:57:14 +0000 (0:00:00.007) 0:00:12.180 ******** 2026-08-18 11:57:14.747742 | mon1 | 2026-08-18 11:57:14.747922 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 11:57:14.748216 | mon1 | Tuesday 18 August 2026 11:57:14 +0000 (0:00:00.008) 0:00:12.189 ******** 2026-08-18 11:57:15.454927 | mon1 | ok: [mon1] 2026-08-18 11:57:15.455210 | mon1 | ok: [mon2] 2026-08-18 11:57:15.455466 | mon1 | ok: [mon3] 2026-08-18 11:57:15.455689 | mon1 | 2026-08-18 11:57:15.456012 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:57:15.456259 | mon1 | Tuesday 18 August 2026 11:57:15 +0000 (0:00:00.709) 0:00:12.898 ******** 2026-08-18 11:57:15.796272 | mon1 | ok: [mon1] 2026-08-18 11:57:15.796495 | mon1 | ok: [mon2] 2026-08-18 11:57:15.796734 | mon1 | ok: [mon3] 2026-08-18 11:57:15.797004 | mon1 | 2026-08-18 11:57:15.797333 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:57:15.797579 | mon1 | Tuesday 18 August 2026 11:57:15 +0000 (0:00:00.342) 0:00:13.240 ******** 2026-08-18 11:57:15.912213 | mon1 | ok: [mon1] => { 2026-08-18 11:57:15.912428 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:57:15.912662 | mon1 | } 2026-08-18 11:57:15.912930 | mon1 | ok: [mon2] => { 2026-08-18 11:57:15.913208 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:57:15.913472 | mon1 | } 2026-08-18 11:57:15.913707 | mon1 | ok: [mon3] => { 2026-08-18 11:57:15.914014 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:57:15.914235 | mon1 | } 2026-08-18 11:57:15.914452 | mon1 | 2026-08-18 11:57:15.914701 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:57:15.914993 | mon1 | Tuesday 18 August 2026 11:57:15 +0000 (0:00:00.116) 0:00:13.357 ******** 2026-08-18 11:57:16.424286 | mon1 | ok: [mon1] 2026-08-18 11:57:16.424488 | mon1 | ok: [mon2] 2026-08-18 11:57:16.424721 | mon1 | ok: [mon3] 2026-08-18 11:57:16.424973 | mon1 | 2026-08-18 11:57:16.425237 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:57:16.425566 | mon1 | Tuesday 18 August 2026 11:57:16 +0000 (0:00:00.511) 0:00:13.868 ******** 2026-08-18 11:57:19.846707 | mon1 | ok: [mon1] 2026-08-18 11:57:19.846924 | mon1 | ok: [mon2] 2026-08-18 11:57:19.847176 | mon1 | ok: [mon3] 2026-08-18 11:57:19.847385 | mon1 | 2026-08-18 11:57:19.847636 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 11:57:19.847904 | mon1 | Tuesday 18 August 2026 11:57:19 +0000 (0:00:03.421) 0:00:17.290 ******** 2026-08-18 11:57:21.119140 | mon1 | ok: [mon1] 2026-08-18 11:57:21.119252 | mon1 | ok: [mon2] 2026-08-18 11:57:21.119408 | mon1 | ok: [mon3] 2026-08-18 11:57:21.119557 | mon1 | 2026-08-18 11:57:21.119727 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 11:57:21.119927 | mon1 | Tuesday 18 August 2026 11:57:21 +0000 (0:00:01.273) 0:00:18.564 ******** 2026-08-18 11:57:21.515918 | mon1 | ok: [mon1] 2026-08-18 11:57:21.515960 | mon1 | ok: [mon3] 2026-08-18 11:57:21.515968 | mon1 | ok: [mon2] 2026-08-18 11:57:21.515975 | mon1 | 2026-08-18 11:57:21.515981 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 11:57:21.515988 | mon1 | Tuesday 18 August 2026 11:57:21 +0000 (0:00:00.393) 0:00:18.957 ******** 2026-08-18 11:57:22.144208 | mon1 | ok: [mon1] 2026-08-18 11:57:22.144564 | mon1 | ok: [mon2] 2026-08-18 11:57:22.144874 | mon1 | ok: [mon3] 2026-08-18 11:57:22.145195 | mon1 | 2026-08-18 11:57:22.145522 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 11:57:22.145879 | mon1 | Tuesday 18 August 2026 11:57:22 +0000 (0:00:00.631) 0:00:19.589 ******** 2026-08-18 11:57:22.897555 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 11:57:22.897767 | mon1 | ok: [mon2] => (item={'path': '/etc/docker'}) 2026-08-18 11:57:22.898229 | mon1 | ok: [mon3] => (item={'path': '/etc/docker'}) 2026-08-18 11:57:22.898631 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:57:22.898875 | mon1 | ok: [mon3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:57:22.900261 | mon1 | ok: [mon2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:57:22.900518 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:57:22.900751 | mon1 | ok: [mon3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:57:22.900992 | mon1 | ok: [mon2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:57:22.901186 | mon1 | 2026-08-18 11:57:22.901406 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 11:57:22.901609 | mon1 | Tuesday 18 August 2026 11:57:22 +0000 (0:00:00.752) 0:00:20.342 ******** 2026-08-18 11:57:23.511647 | mon1 | ok: [mon1] 2026-08-18 11:57:23.511935 | mon1 | ok: [mon2] 2026-08-18 11:57:23.512228 | mon1 | ok: [mon3] 2026-08-18 11:57:23.512463 | mon1 | 2026-08-18 11:57:23.512707 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 11:57:23.513000 | mon1 | Tuesday 18 August 2026 11:57:23 +0000 (0:00:00.614) 0:00:20.956 ******** 2026-08-18 11:57:24.180329 | mon1 | ok: [mon1] 2026-08-18 11:57:24.180396 | mon1 | ok: [mon2] 2026-08-18 11:57:24.180517 | mon1 | ok: [mon3] 2026-08-18 11:57:24.180620 | mon1 | 2026-08-18 11:57:24.180735 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:57:24.180847 | mon1 | Tuesday 18 August 2026 11:57:24 +0000 (0:00:00.643) 0:00:21.600 ******** 2026-08-18 11:57:24.180972 | mon1 | 2026-08-18 11:57:24.181076 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:57:24.181225 | mon1 | Tuesday 18 August 2026 11:57:24 +0000 (0:00:00.008) 0:00:21.608 ******** 2026-08-18 11:57:24.181305 | mon1 | 2026-08-18 11:57:24.182959 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:57:24.183002 | mon1 | Tuesday 18 August 2026 11:57:24 +0000 (0:00:00.008) 0:00:21.616 ******** 2026-08-18 11:57:24.183008 | mon1 | 2026-08-18 11:57:24.183014 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 11:57:24.183019 | mon1 | Tuesday 18 August 2026 11:57:24 +0000 (0:00:00.008) 0:00:21.625 ******** 2026-08-18 11:57:24.720004 | mon1 | ok: [mon1] 2026-08-18 11:57:24.720092 | mon1 | ok: [mon2] 2026-08-18 11:57:24.720106 | mon1 | ok: [mon3] 2026-08-18 11:57:24.720126 | mon1 | 2026-08-18 11:57:24.720193 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:57:24.720358 | mon1 | Tuesday 18 August 2026 11:57:24 +0000 (0:00:00.539) 0:00:22.164 ******** 2026-08-18 11:57:24.795950 | mon1 | ok: [mon1] => { 2026-08-18 11:57:24.796254 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:57:24.796474 | mon1 | } 2026-08-18 11:57:24.796901 | mon1 | ok: [mon2] => { 2026-08-18 11:57:24.797071 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:57:24.797304 | mon1 | } 2026-08-18 11:57:24.797540 | mon1 | ok: [mon3] => { 2026-08-18 11:57:24.797827 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:57:24.798154 | mon1 | } 2026-08-18 11:57:24.798415 | mon1 | 2026-08-18 11:57:24.798531 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:57:24.798639 | mon1 | Tuesday 18 August 2026 11:57:24 +0000 (0:00:00.075) 0:00:22.240 ******** 2026-08-18 11:57:25.189700 | mon1 | ok: [mon1] 2026-08-18 11:57:25.189856 | mon1 | ok: [mon2] 2026-08-18 11:57:25.189975 | mon1 | ok: [mon3] 2026-08-18 11:57:25.189988 | mon1 | 2026-08-18 11:57:25.190018 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:57:25.190141 | mon1 | Tuesday 18 August 2026 11:57:25 +0000 (0:00:00.393) 0:00:22.634 ******** 2026-08-18 11:57:25.229199 | mon1 | skipping: [mon1] 2026-08-18 11:57:25.303942 | mon1 | skipping: [mon2] 2026-08-18 11:57:25.303997 | mon1 | skipping: [mon3] 2026-08-18 11:57:25.304086 | mon1 | 2026-08-18 11:57:25.304336 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 11:57:25.304572 | mon1 | Tuesday 18 August 2026 11:57:25 +0000 (0:00:00.114) 0:00:22.748 ******** 2026-08-18 11:57:25.397260 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:57:25.397493 | mon1 | ok: [mon2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:57:25.397751 | mon1 | ok: [mon3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:57:25.398012 | mon1 | 2026-08-18 11:57:25.398259 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 11:57:25.398506 | mon1 | Tuesday 18 August 2026 11:57:25 +0000 (0:00:00.093) 0:00:22.842 ******** 2026-08-18 11:57:26.559944 | mon1 | ok: [mon1] 2026-08-18 11:57:26.560000 | mon1 | ok: [mon3] 2026-08-18 11:57:26.560005 | mon1 | ok: [mon2] 2026-08-18 11:57:26.560011 | mon1 | 2026-08-18 11:57:26.560017 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 11:57:26.560022 | mon1 | Tuesday 18 August 2026 11:57:26 +0000 (0:00:01.161) 0:00:24.003 ******** 2026-08-18 11:57:27.416745 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-08-18 11:57:27.416843 | mon1 | ok: [mon3] => (item=systemd-timesyncd) 2026-08-18 11:57:27.416982 | mon1 | ok: [mon2] => (item=systemd-timesyncd) 2026-08-18 11:57:27.417093 | mon1 | ok: [mon1] => (item=ssh) 2026-08-18 11:57:27.417195 | mon1 | ok: [mon3] => (item=ssh) 2026-08-18 11:57:27.417301 | mon1 | ok: [mon2] => (item=ssh) 2026-08-18 11:57:27.417417 | mon1 | 2026-08-18 11:57:27.417531 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 11:57:27.417640 | mon1 | Tuesday 18 August 2026 11:57:27 +0000 (0:00:00.857) 0:00:24.861 ******** 2026-08-18 11:57:27.699156 | mon1 | ok: [mon1] 2026-08-18 11:57:27.699236 | mon1 | ok: [mon2] 2026-08-18 11:57:27.699339 | mon1 | ok: [mon3] 2026-08-18 11:57:27.699436 | mon1 | 2026-08-18 11:57:27.699666 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 11:57:27.699933 | mon1 | Tuesday 18 August 2026 11:57:27 +0000 (0:00:00.282) 0:00:25.144 ******** 2026-08-18 11:57:28.161054 | mon1 | ok: [mon1] 2026-08-18 11:57:28.161116 | mon1 | ok: [mon3] 2026-08-18 11:57:28.161130 | mon1 | ok: [mon2] 2026-08-18 11:57:28.161149 | mon1 | 2026-08-18 11:57:28.161366 | mon1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 11:57:28.161658 | mon1 | Tuesday 18 August 2026 11:57:28 +0000 (0:00:00.460) 0:00:25.605 ******** 2026-08-18 11:57:28.758421 | mon1 | ok: [mon1] 2026-08-18 11:57:28.758538 | mon1 | ok: [mon2] 2026-08-18 11:57:28.758687 | mon1 | ok: [mon3] 2026-08-18 11:57:28.759091 | mon1 | 2026-08-18 11:57:28.759116 | mon1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 11:57:28.759186 | mon1 | Tuesday 18 August 2026 11:57:28 +0000 (0:00:00.596) 0:00:26.202 ******** 2026-08-18 11:57:28.831101 | mon1 | skipping: [mon1] 2026-08-18 11:57:28.831482 | mon1 | skipping: [mon2] 2026-08-18 11:57:28.832739 | mon1 | skipping: [mon3] 2026-08-18 11:57:28.832772 | mon1 | 2026-08-18 11:57:28.832786 | mon1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 11:57:28.832799 | mon1 | Tuesday 18 August 2026 11:57:28 +0000 (0:00:00.073) 0:00:26.276 ******** 2026-08-18 11:57:29.497885 | mon1 | ok: [mon2] 2026-08-18 11:57:29.497969 | mon1 | ok: [mon3] 2026-08-18 11:57:29.498208 | mon1 | ok: [mon1] 2026-08-18 11:57:29.498563 | mon1 | 2026-08-18 11:57:29.498801 | mon1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 11:57:29.499024 | mon1 | Tuesday 18 August 2026 11:57:29 +0000 (0:00:00.666) 0:00:26.942 ******** 2026-08-18 11:57:30.112028 | mon1 | ok: [mon1] 2026-08-18 11:57:30.113005 | mon1 | ok: [mon2] 2026-08-18 11:57:30.113029 | mon1 | ok: [mon3] 2026-08-18 11:57:30.113060 | mon1 | 2026-08-18 11:57:30.113262 | mon1 | TASK [vexxhost.ceph.mon : Find this monitor's addresses on the public network] *** 2026-08-18 11:57:30.113503 | mon1 | Tuesday 18 August 2026 11:57:30 +0000 (0:00:00.614) 0:00:27.556 ******** 2026-08-18 11:57:30.239782 | mon1 | ok: [mon1] 2026-08-18 11:57:30.240022 | mon1 | ok: [mon2] 2026-08-18 11:57:30.240255 | mon1 | ok: [mon3] 2026-08-18 11:57:30.240560 | mon1 | 2026-08-18 11:57:30.240774 | mon1 | TASK [vexxhost.ceph.mon : Assert exactly one address matches the public network] *** 2026-08-18 11:57:30.241045 | mon1 | Tuesday 18 August 2026 11:57:30 +0000 (0:00:00.127) 0:00:27.684 ******** 2026-08-18 11:57:30.331455 | mon1 | ok: [mon1] => { 2026-08-18 11:57:30.331687 | mon1 | "changed": false, 2026-08-18 11:57:30.331962 | mon1 | "msg": "All assertions passed" 2026-08-18 11:57:30.332195 | mon1 | } 2026-08-18 11:57:30.332427 | mon1 | ok: [mon2] => { 2026-08-18 11:57:30.332664 | mon1 | "changed": false, 2026-08-18 11:57:30.332924 | mon1 | "msg": "All assertions passed" 2026-08-18 11:57:30.333154 | mon1 | } 2026-08-18 11:57:30.333446 | mon1 | ok: [mon3] => { 2026-08-18 11:57:30.333677 | mon1 | "changed": false, 2026-08-18 11:57:30.333988 | mon1 | "msg": "All assertions passed" 2026-08-18 11:57:30.334161 | mon1 | } 2026-08-18 11:57:30.334405 | mon1 | 2026-08-18 11:57:30.334621 | mon1 | TASK [vexxhost.ceph.mon : Set this monitor's Ceph public IP] ******************* 2026-08-18 11:57:30.334863 | mon1 | Tuesday 18 August 2026 11:57:30 +0000 (0:00:00.091) 0:00:27.776 ******** 2026-08-18 11:57:30.413035 | mon1 | ok: [mon1] 2026-08-18 11:57:30.413285 | mon1 | ok: [mon2] 2026-08-18 11:57:30.413547 | mon1 | ok: [mon3] 2026-08-18 11:57:30.413782 | mon1 | 2026-08-18 11:57:30.414160 | mon1 | TASK [vexxhost.ceph.mon : Check whether any monitor is already bootstrapped] *** 2026-08-18 11:57:30.414428 | mon1 | Tuesday 18 August 2026 11:57:30 +0000 (0:00:00.081) 0:00:27.858 ******** 2026-08-18 11:57:31.187778 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:57:31.190901 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:57:31.190917 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:57:31.190923 | mon1 | 2026-08-18 11:57:31.190929 | mon1 | TASK [vexxhost.ceph.mon : Select the bootstrap node (existing one, else the first monitor)] *** 2026-08-18 11:57:31.190934 | mon1 | Tuesday 18 August 2026 11:57:31 +0000 (0:00:00.774) 0:00:28.632 ******** 2026-08-18 11:57:31.276943 | mon1 | ok: [mon1] 2026-08-18 11:57:31.277097 | mon1 | ok: [mon2] 2026-08-18 11:57:31.277243 | mon1 | ok: [mon3] 2026-08-18 11:57:31.277378 | mon1 | 2026-08-18 11:57:31.277532 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] ******************************* 2026-08-18 11:57:31.277690 | mon1 | Tuesday 18 August 2026 11:57:31 +0000 (0:00:00.089) 0:00:28.722 ******** 2026-08-18 11:57:31.370467 | mon1 | skipping: [mon1] 2026-08-18 11:57:31.370705 | mon1 | skipping: [mon2] 2026-08-18 11:57:31.370978 | mon1 | skipping: [mon3] 2026-08-18 11:57:31.371205 | mon1 | 2026-08-18 11:57:31.371452 | mon1 | TASK [Register this monitor host] ********************************************** 2026-08-18 11:57:31.371738 | mon1 | Tuesday 18 August 2026 11:57:31 +0000 (0:00:00.093) 0:00:28.815 ******** 2026-08-18 11:57:31.510927 | mon1 | included: vexxhost.ceph.cephadm_host for mon1, mon2, mon3 2026-08-18 11:57:31.511160 | mon1 | 2026-08-18 11:57:31.511407 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 11:57:31.511647 | mon1 | Tuesday 18 August 2026 11:57:31 +0000 (0:00:00.140) 0:00:28.955 ******** 2026-08-18 11:57:33.276210 | mon1 | ok: [mon1] 2026-08-18 11:57:33.276456 | mon1 | 2026-08-18 11:57:33.276723 | mon1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 11:57:33.276998 | mon1 | Tuesday 18 August 2026 11:57:33 +0000 (0:00:01.765) 0:00:30.721 ******** 2026-08-18 11:57:33.369616 | mon1 | ok: [mon1] 2026-08-18 11:57:33.369843 | mon1 | ok: [mon2] 2026-08-18 11:57:33.370107 | mon1 | ok: [mon3] 2026-08-18 11:57:33.370325 | mon1 | 2026-08-18 11:57:33.370576 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 11:57:33.370838 | mon1 | Tuesday 18 August 2026 11:57:33 +0000 (0:00:00.093) 0:00:30.814 ******** 2026-08-18 11:57:33.457266 | mon1 | ok: [mon1] => { 2026-08-18 11:57:33.457555 | mon1 | "changed": false, 2026-08-18 11:57:33.457794 | mon1 | "msg": "All assertions passed" 2026-08-18 11:57:33.458069 | mon1 | } 2026-08-18 11:57:33.458303 | mon1 | ok: [mon2] => { 2026-08-18 11:57:33.458543 | mon1 | "changed": false, 2026-08-18 11:57:33.458772 | mon1 | "msg": "All assertions passed" 2026-08-18 11:57:33.459032 | mon1 | } 2026-08-18 11:57:33.459270 | mon1 | ok: [mon3] => { 2026-08-18 11:57:33.459502 | mon1 | "changed": false, 2026-08-18 11:57:33.459746 | mon1 | "msg": "All assertions passed" 2026-08-18 11:57:33.460002 | mon1 | } 2026-08-18 11:57:33.460217 | mon1 | 2026-08-18 11:57:33.460473 | mon1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 11:57:33.460726 | mon1 | Tuesday 18 August 2026 11:57:33 +0000 (0:00:00.087) 0:00:30.902 ******** 2026-08-18 11:57:33.928741 | mon1 | ok: [mon1] 2026-08-18 11:57:33.929004 | mon1 | ok: [mon2] 2026-08-18 11:57:33.929256 | mon1 | ok: [mon3] 2026-08-18 11:57:33.929487 | mon1 | 2026-08-18 11:57:33.929766 | mon1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 11:57:33.930059 | mon1 | Tuesday 18 August 2026 11:57:33 +0000 (0:00:00.470) 0:00:31.373 ******** 2026-08-18 11:57:34.024660 | mon1 | ok: [mon1] 2026-08-18 11:57:34.024983 | mon1 | ok: [mon2] 2026-08-18 11:57:34.025173 | mon1 | ok: [mon3] 2026-08-18 11:57:34.025549 | mon1 | 2026-08-18 11:57:34.025643 | mon1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 11:57:34.025907 | mon1 | Tuesday 18 August 2026 11:57:34 +0000 (0:00:00.096) 0:00:31.469 ******** 2026-08-18 11:57:34.144782 | mon1 | ok: [mon1] 2026-08-18 11:57:34.145065 | mon1 | ok: [mon2] 2026-08-18 11:57:34.145296 | mon1 | ok: [mon3] 2026-08-18 11:57:34.145509 | mon1 | 2026-08-18 11:57:34.145774 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 11:57:34.146055 | mon1 | Tuesday 18 August 2026 11:57:34 +0000 (0:00:00.119) 0:00:31.589 ******** 2026-08-18 11:57:34.228464 | mon1 | ok: [mon1] => { 2026-08-18 11:57:34.228708 | mon1 | "changed": false, 2026-08-18 11:57:34.228978 | mon1 | "msg": "All assertions passed" 2026-08-18 11:57:34.229273 | mon1 | } 2026-08-18 11:57:34.229513 | mon1 | ok: [mon2] => { 2026-08-18 11:57:34.229741 | mon1 | "changed": false, 2026-08-18 11:57:34.230026 | mon1 | "msg": "All assertions passed" 2026-08-18 11:57:34.230229 | mon1 | } 2026-08-18 11:57:34.230457 | mon1 | ok: [mon3] => { 2026-08-18 11:57:34.230685 | mon1 | "changed": false, 2026-08-18 11:57:34.230944 | mon1 | "msg": "All assertions passed" 2026-08-18 11:57:34.231168 | mon1 | } 2026-08-18 11:57:34.231378 | mon1 | 2026-08-18 11:57:34.231631 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 11:57:34.231897 | mon1 | Tuesday 18 August 2026 11:57:34 +0000 (0:00:00.084) 0:00:31.673 ******** 2026-08-18 11:57:36.112290 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:57:36.112367 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:57:36.112475 | mon1 | ok: [mon1] 2026-08-18 11:57:36.112574 | mon1 | 2026-08-18 11:57:36.112709 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 11:57:36.112830 | mon1 | Tuesday 18 August 2026 11:57:36 +0000 (0:00:01.883) 0:00:33.556 ******** 2026-08-18 11:57:36.233273 | mon1 | skipping: [mon1] 2026-08-18 11:57:36.233372 | mon1 | skipping: [mon2] 2026-08-18 11:57:36.233496 | mon1 | skipping: [mon3] 2026-08-18 11:57:36.233597 | mon1 | 2026-08-18 11:57:36.233709 | mon1 | TASK [vexxhost.ceph.mon : Apply the monitor service spec] ********************** 2026-08-18 11:57:36.233812 | mon1 | Tuesday 18 August 2026 11:57:36 +0000 (0:00:00.121) 0:00:33.678 ******** 2026-08-18 11:57:38.046651 | mon1 | ok: [mon1] 2026-08-18 11:57:38.046708 | mon1 | 2026-08-18 11:57:38.046722 | mon1 | TASK [vexxhost.ceph.mon : Wait for this monitor's daemon to be present] ******** 2026-08-18 11:57:38.046734 | mon1 | Tuesday 18 August 2026 11:57:38 +0000 (0:00:01.812) 0:00:35.490 ******** 2026-08-18 11:57:39.968739 | mon1 | ok: [mon1] 2026-08-18 11:57:39.968830 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:57:39.968844 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:57:39.968856 | mon1 | 2026-08-18 11:57:39.968868 | mon1 | TASK [vexxhost.ceph.mgr : Locate the cluster admin host] *********************** 2026-08-18 11:57:39.968911 | mon1 | Tuesday 18 August 2026 11:57:39 +0000 (0:00:01.921) 0:00:37.412 ******** 2026-08-18 11:57:40.766192 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:57:40.766313 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:57:40.766332 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:57:40.766348 | mon1 | 2026-08-18 11:57:40.766362 | mon1 | TASK [vexxhost.ceph.mgr : Select the admin host] ******************************* 2026-08-18 11:57:40.766428 | mon1 | Tuesday 18 August 2026 11:57:40 +0000 (0:00:00.797) 0:00:38.209 ******** 2026-08-18 11:57:40.857972 | mon1 | ok: [mon1] 2026-08-18 11:57:40.858157 | mon1 | ok: [mon2] 2026-08-18 11:57:40.858419 | mon1 | ok: [mon3] 2026-08-18 11:57:40.858654 | mon1 | 2026-08-18 11:57:40.858935 | mon1 | TASK [Register this manager host] ********************************************** 2026-08-18 11:57:40.859288 | mon1 | Tuesday 18 August 2026 11:57:40 +0000 (0:00:00.093) 0:00:38.303 ******** 2026-08-18 11:57:40.992517 | mon1 | included: vexxhost.ceph.cephadm_host for mon1, mon2, mon3 2026-08-18 11:57:40.992591 | mon1 | 2026-08-18 11:57:40.992631 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 11:57:40.992642 | mon1 | Tuesday 18 August 2026 11:57:40 +0000 (0:00:00.133) 0:00:38.436 ******** 2026-08-18 11:57:42.789487 | mon1 | ok: [mon1] 2026-08-18 11:57:42.789554 | mon1 | 2026-08-18 11:57:42.789569 | mon1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 11:57:42.789582 | mon1 | Tuesday 18 August 2026 11:57:42 +0000 (0:00:01.797) 0:00:40.233 ******** 2026-08-18 11:57:42.879415 | mon1 | ok: [mon1] 2026-08-18 11:57:42.879477 | mon1 | ok: [mon2] 2026-08-18 11:57:42.879575 | mon1 | ok: [mon3] 2026-08-18 11:57:42.879689 | mon1 | 2026-08-18 11:57:42.879817 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 11:57:42.879982 | mon1 | Tuesday 18 August 2026 11:57:42 +0000 (0:00:00.090) 0:00:40.323 ******** 2026-08-18 11:57:42.973931 | mon1 | ok: [mon1] => { 2026-08-18 11:57:42.973987 | mon1 | "changed": false, 2026-08-18 11:57:42.974001 | mon1 | "msg": "All assertions passed" 2026-08-18 11:57:42.974012 | mon1 | } 2026-08-18 11:57:42.974023 | mon1 | ok: [mon2] => { 2026-08-18 11:57:42.974034 | mon1 | "changed": false, 2026-08-18 11:57:42.974048 | mon1 | "msg": "All assertions passed" 2026-08-18 11:57:42.974060 | mon1 | } 2026-08-18 11:57:42.974130 | mon1 | ok: [mon3] => { 2026-08-18 11:57:42.974144 | mon1 | "changed": false, 2026-08-18 11:57:42.974156 | mon1 | "msg": "All assertions passed" 2026-08-18 11:57:42.974421 | mon1 | } 2026-08-18 11:57:42.974707 | mon1 | 2026-08-18 11:57:42.975070 | mon1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 11:57:42.975386 | mon1 | Tuesday 18 August 2026 11:57:42 +0000 (0:00:00.091) 0:00:40.414 ******** 2026-08-18 11:57:43.347965 | mon1 | ok: [mon1] 2026-08-18 11:57:43.348424 | mon1 | ok: [mon2] 2026-08-18 11:57:43.348751 | mon1 | ok: [mon3] 2026-08-18 11:57:43.349090 | mon1 | 2026-08-18 11:57:43.349447 | mon1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 11:57:43.349779 | mon1 | Tuesday 18 August 2026 11:57:43 +0000 (0:00:00.377) 0:00:40.792 ******** 2026-08-18 11:57:43.433508 | mon1 | ok: [mon1] 2026-08-18 11:57:43.433857 | mon1 | ok: [mon2] 2026-08-18 11:57:43.434224 | mon1 | ok: [mon3] 2026-08-18 11:57:43.434510 | mon1 | 2026-08-18 11:57:43.434895 | mon1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 11:57:43.435226 | mon1 | Tuesday 18 August 2026 11:57:43 +0000 (0:00:00.085) 0:00:40.877 ******** 2026-08-18 11:57:43.547863 | mon1 | ok: [mon1] 2026-08-18 11:57:43.548283 | mon1 | ok: [mon2] 2026-08-18 11:57:43.548592 | mon1 | ok: [mon3] 2026-08-18 11:57:43.548912 | mon1 | 2026-08-18 11:57:43.549405 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 11:57:43.549720 | mon1 | Tuesday 18 August 2026 11:57:43 +0000 (0:00:00.114) 0:00:40.992 ******** 2026-08-18 11:57:43.633512 | mon1 | ok: [mon1] => { 2026-08-18 11:57:43.633860 | mon1 | "changed": false, 2026-08-18 11:57:43.634214 | mon1 | "msg": "All assertions passed" 2026-08-18 11:57:43.634512 | mon1 | } 2026-08-18 11:57:43.634813 | mon1 | ok: [mon2] => { 2026-08-18 11:57:43.635206 | mon1 | "changed": false, 2026-08-18 11:57:43.635530 | mon1 | "msg": "All assertions passed" 2026-08-18 11:57:43.635860 | mon1 | } 2026-08-18 11:57:43.636319 | mon1 | ok: [mon3] => { 2026-08-18 11:57:43.636691 | mon1 | "changed": false, 2026-08-18 11:57:43.637085 | mon1 | "msg": "All assertions passed" 2026-08-18 11:57:43.637438 | mon1 | } 2026-08-18 11:57:43.638453 | mon1 | 2026-08-18 11:57:43.638489 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 11:57:43.638538 | mon1 | Tuesday 18 August 2026 11:57:43 +0000 (0:00:00.085) 0:00:41.077 ******** 2026-08-18 11:57:45.423253 | mon1 | ok: [mon1] 2026-08-18 11:57:45.424011 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:57:45.424054 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:57:45.424227 | mon1 | 2026-08-18 11:57:45.424529 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 11:57:45.424926 | mon1 | Tuesday 18 August 2026 11:57:45 +0000 (0:00:01.789) 0:00:42.867 ******** 2026-08-18 11:57:45.535497 | mon1 | skipping: [mon1] 2026-08-18 11:57:45.535737 | mon1 | skipping: [mon2] 2026-08-18 11:57:45.536024 | mon1 | skipping: [mon3] 2026-08-18 11:57:45.536277 | mon1 | 2026-08-18 11:57:45.536531 | mon1 | TASK [vexxhost.ceph.mgr : Apply the manager service spec] ********************** 2026-08-18 11:57:45.536778 | mon1 | Tuesday 18 August 2026 11:57:45 +0000 (0:00:00.112) 0:00:42.980 ******** 2026-08-18 11:57:47.310652 | mon1 | ok: [mon1] 2026-08-18 11:57:47.310888 | mon1 | 2026-08-18 11:57:47.311193 | mon1 | TASK [vexxhost.ceph.mgr : Wait for this manager's daemon to be present] ******** 2026-08-18 11:57:47.311479 | mon1 | Tuesday 18 August 2026 11:57:47 +0000 (0:00:01.774) 0:00:44.755 ******** 2026-08-18 11:57:49.091138 | mon1 | ok: [mon1] 2026-08-18 11:57:49.091400 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:57:49.091676 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:57:49.091986 | mon1 | 2026-08-18 11:57:49.092279 | mon1 | TASK [vexxhost.ceph.mgr : Configure ceph-mgr modules] ************************** 2026-08-18 11:57:49.092556 | mon1 | Tuesday 18 August 2026 11:57:49 +0000 (0:00:01.780) 0:00:46.535 ******** 2026-08-18 11:57:57.832028 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-08-18 11:57:57.832115 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-08-18 11:57:57.832129 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-08-18 11:57:57.832140 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-08-18 11:57:57.832152 | mon1 | 2026-08-18 11:57:57.832227 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-08-18 11:57:57.833037 | mon1 | 2026-08-18 11:57:57.833131 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:57:57.833333 | mon1 | Tuesday 18 August 2026 11:57:57 +0000 (0:00:08.740) 0:00:55.275 ******** 2026-08-18 11:57:59.102774 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-08-18 11:57:59.103202 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 11:57:59.103520 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:57:59.103856 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:57:59.104272 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:57:59.164102 | mon1 | ok: [mon1] 2026-08-18 11:57:59.164174 | mon1 | ok: [mon2] 2026-08-18 11:57:59.164358 | mon1 | ok: [mon3] 2026-08-18 11:57:59.164582 | mon1 | ok: [osd1] 2026-08-18 11:57:59.164797 | mon1 | 2026-08-18 11:57:59.165142 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:57:59.165320 | mon1 | Tuesday 18 August 2026 11:57:59 +0000 (0:00:01.333) 0:00:56.608 ******** 2026-08-18 11:57:59.470736 | mon1 | ok: [mon1] 2026-08-18 11:57:59.472081 | mon1 | ok: [mon2] 2026-08-18 11:57:59.472133 | mon1 | ok: [mon3] 2026-08-18 11:57:59.472146 | mon1 | ok: [osd1] 2026-08-18 11:57:59.472158 | mon1 | 2026-08-18 11:57:59.472170 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:57:59.472188 | mon1 | Tuesday 18 August 2026 11:57:59 +0000 (0:00:00.307) 0:00:56.915 ******** 2026-08-18 11:57:59.521170 | mon1 | skipping: [mon1] 2026-08-18 11:57:59.576817 | mon1 | skipping: [mon2] 2026-08-18 11:57:59.577020 | mon1 | skipping: [mon3] 2026-08-18 11:57:59.577256 | mon1 | skipping: [osd1] 2026-08-18 11:57:59.577473 | mon1 | 2026-08-18 11:57:59.577764 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 11:57:59.578042 | mon1 | Tuesday 18 August 2026 11:57:59 +0000 (0:00:00.105) 0:00:57.021 ******** 2026-08-18 11:57:59.892132 | mon1 | ok: [mon1] 2026-08-18 11:57:59.892351 | mon1 | ok: [mon2] 2026-08-18 11:57:59.892584 | mon1 | ok: [mon3] 2026-08-18 11:57:59.892819 | mon1 | ok: [osd1] 2026-08-18 11:57:59.893079 | mon1 | 2026-08-18 11:57:59.893338 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:57:59.893615 | mon1 | Tuesday 18 August 2026 11:57:59 +0000 (0:00:00.315) 0:00:57.337 ******** 2026-08-18 11:58:00.011903 | mon1 | ok: [mon1] => { 2026-08-18 11:58:00.011962 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:58:00.012058 | mon1 | } 2026-08-18 11:58:00.012161 | mon1 | ok: [mon2] => { 2026-08-18 11:58:00.012276 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:58:00.012420 | mon1 | } 2026-08-18 11:58:00.012518 | mon1 | ok: [mon3] => { 2026-08-18 11:58:00.012633 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:58:00.012739 | mon1 | } 2026-08-18 11:58:00.012843 | mon1 | ok: [osd1] => { 2026-08-18 11:58:00.012981 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:58:00.013077 | mon1 | } 2026-08-18 11:58:00.013174 | mon1 | 2026-08-18 11:58:00.013284 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:58:00.013393 | mon1 | Tuesday 18 August 2026 11:58:00 +0000 (0:00:00.119) 0:00:57.456 ******** 2026-08-18 11:58:00.453691 | mon1 | ok: [mon1] 2026-08-18 11:58:00.453930 | mon1 | ok: [mon2] 2026-08-18 11:58:00.454169 | mon1 | ok: [mon3] 2026-08-18 11:58:00.454466 | mon1 | ok: [osd1] 2026-08-18 11:58:00.454745 | mon1 | 2026-08-18 11:58:00.455054 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:58:00.455288 | mon1 | Tuesday 18 August 2026 11:58:00 +0000 (0:00:00.441) 0:00:57.898 ******** 2026-08-18 11:58:00.505668 | mon1 | skipping: [mon1] 2026-08-18 11:58:00.582848 | mon1 | skipping: [mon2] 2026-08-18 11:58:00.583124 | mon1 | skipping: [mon3] 2026-08-18 11:58:00.583355 | mon1 | skipping: [osd1] 2026-08-18 11:58:00.583573 | mon1 | 2026-08-18 11:58:00.583819 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:58:00.584125 | mon1 | Tuesday 18 August 2026 11:58:00 +0000 (0:00:00.129) 0:00:58.027 ******** 2026-08-18 11:58:00.639540 | mon1 | skipping: [mon1] 2026-08-18 11:58:00.715745 | mon1 | skipping: [mon2] 2026-08-18 11:58:00.716071 | mon1 | skipping: [mon3] 2026-08-18 11:58:00.716360 | mon1 | skipping: [osd1] 2026-08-18 11:58:00.716590 | mon1 | 2026-08-18 11:58:00.716844 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:58:00.717137 | mon1 | Tuesday 18 August 2026 11:58:00 +0000 (0:00:00.132) 0:00:58.160 ******** 2026-08-18 11:58:01.052974 | mon1 | ok: [mon1] 2026-08-18 11:58:01.053253 | mon1 | ok: [mon2] 2026-08-18 11:58:01.053530 | mon1 | ok: [osd1] 2026-08-18 11:58:01.053799 | mon1 | ok: [mon3] 2026-08-18 11:58:01.054122 | mon1 | 2026-08-18 11:58:01.054420 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:58:01.054704 | mon1 | Tuesday 18 August 2026 11:58:01 +0000 (0:00:00.336) 0:00:58.497 ******** 2026-08-18 11:58:03.155368 | mon1 | ok: [mon1] 2026-08-18 11:58:03.155562 | mon1 | ok: [osd1] 2026-08-18 11:58:03.155788 | mon1 | ok: [mon2] 2026-08-18 11:58:03.156051 | mon1 | ok: [mon3] 2026-08-18 11:58:03.156268 | mon1 | 2026-08-18 11:58:03.156519 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:58:03.156759 | mon1 | Tuesday 18 August 2026 11:58:03 +0000 (0:00:02.102) 0:01:00.600 ******** 2026-08-18 11:58:03.392661 | mon1 | ok: [mon1] => { 2026-08-18 11:58:03.392944 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:58:03.393185 | mon1 | } 2026-08-18 11:58:03.393419 | mon1 | ok: [mon2] => { 2026-08-18 11:58:03.393668 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:58:03.393923 | mon1 | } 2026-08-18 11:58:03.394166 | mon1 | ok: [mon3] => { 2026-08-18 11:58:03.394419 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:58:03.394644 | mon1 | } 2026-08-18 11:58:03.394907 | mon1 | ok: [osd1] => { 2026-08-18 11:58:03.395164 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:58:03.395387 | mon1 | } 2026-08-18 11:58:03.395599 | mon1 | 2026-08-18 11:58:03.395842 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:58:03.396127 | mon1 | Tuesday 18 August 2026 11:58:03 +0000 (0:00:00.237) 0:01:00.837 ******** 2026-08-18 11:58:04.016487 | mon1 | ok: [mon1] 2026-08-18 11:58:04.016700 | mon1 | ok: [mon2] 2026-08-18 11:58:04.016971 | mon1 | ok: [osd1] 2026-08-18 11:58:04.017205 | mon1 | ok: [mon3] 2026-08-18 11:58:04.017435 | mon1 | 2026-08-18 11:58:04.017681 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:58:04.017950 | mon1 | Tuesday 18 August 2026 11:58:04 +0000 (0:00:00.623) 0:01:01.461 ******** 2026-08-18 11:58:06.402745 | mon1 | ok: [mon1] 2026-08-18 11:58:06.403005 | mon1 | ok: [osd1] 2026-08-18 11:58:06.403224 | mon1 | ok: [mon3] 2026-08-18 11:58:06.403493 | mon1 | ok: [mon2] 2026-08-18 11:58:06.403710 | mon1 | 2026-08-18 11:58:06.403976 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 11:58:06.404227 | mon1 | Tuesday 18 August 2026 11:58:06 +0000 (0:00:02.386) 0:01:03.847 ******** 2026-08-18 11:58:06.449082 | mon1 | skipping: [mon1] 2026-08-18 11:58:06.481194 | mon1 | skipping: [mon2] 2026-08-18 11:58:06.481428 | mon1 | skipping: [mon3] 2026-08-18 11:58:06.481676 | mon1 | skipping: [osd1] 2026-08-18 11:58:06.482019 | mon1 | 2026-08-18 11:58:06.482392 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 11:58:06.482645 | mon1 | Tuesday 18 August 2026 11:58:06 +0000 (0:00:00.078) 0:01:03.926 ******** 2026-08-18 11:58:06.525466 | mon1 | skipping: [mon1] 2026-08-18 11:58:06.558600 | mon1 | skipping: [mon2] 2026-08-18 11:58:06.558822 | mon1 | skipping: [mon3] 2026-08-18 11:58:06.559110 | mon1 | skipping: [osd1] 2026-08-18 11:58:06.559314 | mon1 | 2026-08-18 11:58:06.559558 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 11:58:06.559796 | mon1 | Tuesday 18 August 2026 11:58:06 +0000 (0:00:00.077) 0:01:04.003 ******** 2026-08-18 11:58:06.606899 | mon1 | skipping: [mon1] 2026-08-18 11:58:06.639474 | mon1 | skipping: [mon2] 2026-08-18 11:58:06.639631 | mon1 | skipping: [mon3] 2026-08-18 11:58:06.639794 | mon1 | skipping: [osd1] 2026-08-18 11:58:06.639997 | mon1 | 2026-08-18 11:58:06.640200 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 11:58:06.640361 | mon1 | Tuesday 18 August 2026 11:58:06 +0000 (0:00:00.080) 0:01:04.084 ******** 2026-08-18 11:58:07.880831 | mon1 | ok: [mon1] 2026-08-18 11:58:07.881131 | mon1 | ok: [osd1] 2026-08-18 11:58:07.881498 | mon1 | ok: [mon2] 2026-08-18 11:58:07.881739 | mon1 | ok: [mon3] 2026-08-18 11:58:07.882023 | mon1 | 2026-08-18 11:58:07.882437 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 11:58:07.882813 | mon1 | Tuesday 18 August 2026 11:58:07 +0000 (0:00:01.241) 0:01:05.325 ******** 2026-08-18 11:58:08.483481 | mon1 | ok: [mon1] 2026-08-18 11:58:08.483698 | mon1 | ok: [mon2] 2026-08-18 11:58:08.483997 | mon1 | ok: [osd1] 2026-08-18 11:58:08.484258 | mon1 | ok: [mon3] 2026-08-18 11:58:08.484497 | mon1 | 2026-08-18 11:58:08.484804 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 11:58:08.485106 | mon1 | Tuesday 18 August 2026 11:58:08 +0000 (0:00:00.602) 0:01:05.928 ******** 2026-08-18 11:58:09.694428 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:58:09.694555 | mon1 | ok: [mon2] => (item={'path': '/etc/containerd'}) 2026-08-18 11:58:09.694818 | mon1 | ok: [mon3] => (item={'path': '/etc/containerd'}) 2026-08-18 11:58:09.695096 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:58:09.695344 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:58:09.695654 | mon1 | ok: [mon2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:58:09.695924 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:58:09.696186 | mon1 | ok: [mon3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:58:09.696554 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:58:09.696680 | mon1 | ok: [mon2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:58:09.696984 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:58:09.697225 | mon1 | ok: [mon3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:58:09.697476 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:58:09.697727 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:58:09.698083 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:58:09.698307 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:58:09.698558 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:58:09.698809 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:58:09.699166 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:58:09.699362 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:58:09.699601 | mon1 | 2026-08-18 11:58:09.699842 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 11:58:09.700178 | mon1 | Tuesday 18 August 2026 11:58:09 +0000 (0:00:01.210) 0:01:07.139 ******** 2026-08-18 11:58:10.436800 | mon1 | ok: [mon1] 2026-08-18 11:58:10.437087 | mon1 | ok: [mon2] 2026-08-18 11:58:10.437300 | mon1 | ok: [osd1] 2026-08-18 11:58:10.437530 | mon1 | ok: [mon3] 2026-08-18 11:58:10.437752 | mon1 | 2026-08-18 11:58:10.438043 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:58:10.438288 | mon1 | Tuesday 18 August 2026 11:58:10 +0000 (0:00:00.716) 0:01:07.856 ******** 2026-08-18 11:58:10.438508 | mon1 | 2026-08-18 11:58:10.438754 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:58:10.439033 | mon1 | Tuesday 18 August 2026 11:58:10 +0000 (0:00:00.007) 0:01:07.864 ******** 2026-08-18 11:58:10.439252 | mon1 | 2026-08-18 11:58:10.439497 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:58:10.439741 | mon1 | Tuesday 18 August 2026 11:58:10 +0000 (0:00:00.005) 0:01:07.870 ******** 2026-08-18 11:58:10.439993 | mon1 | 2026-08-18 11:58:10.440240 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:58:10.440485 | mon1 | Tuesday 18 August 2026 11:58:10 +0000 (0:00:00.005) 0:01:07.875 ******** 2026-08-18 11:58:10.440761 | mon1 | 2026-08-18 11:58:10.441029 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 11:58:10.441171 | mon1 | Tuesday 18 August 2026 11:58:10 +0000 (0:00:00.005) 0:01:07.881 ******** 2026-08-18 11:58:10.939822 | mon1 | ok: [mon1] 2026-08-18 11:58:10.940063 | mon1 | ok: [osd1] 2026-08-18 11:58:10.940281 | mon1 | ok: [mon2] 2026-08-18 11:58:10.940499 | mon1 | ok: [mon3] 2026-08-18 11:58:10.940713 | mon1 | 2026-08-18 11:58:10.941007 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:58:10.941228 | mon1 | Tuesday 18 August 2026 11:58:10 +0000 (0:00:00.502) 0:01:08.384 ******** 2026-08-18 11:58:11.246107 | mon1 | ok: [mon1] 2026-08-18 11:58:11.246320 | mon1 | ok: [mon2] 2026-08-18 11:58:11.246548 | mon1 | ok: [mon3] 2026-08-18 11:58:11.246779 | mon1 | ok: [osd1] 2026-08-18 11:58:11.247038 | mon1 | 2026-08-18 11:58:11.247278 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:58:11.247512 | mon1 | Tuesday 18 August 2026 11:58:11 +0000 (0:00:00.306) 0:01:08.691 ******** 2026-08-18 11:58:11.365662 | mon1 | ok: [mon1] => { 2026-08-18 11:58:11.365985 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:58:11.366297 | mon1 | } 2026-08-18 11:58:11.366549 | mon1 | ok: [mon2] => { 2026-08-18 11:58:11.366827 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:58:11.367132 | mon1 | } 2026-08-18 11:58:11.367354 | mon1 | ok: [mon3] => { 2026-08-18 11:58:11.367606 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:58:11.367835 | mon1 | } 2026-08-18 11:58:11.368091 | mon1 | ok: [osd1] => { 2026-08-18 11:58:11.368341 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:58:11.368562 | mon1 | } 2026-08-18 11:58:11.368778 | mon1 | 2026-08-18 11:58:11.369063 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:58:11.369290 | mon1 | Tuesday 18 August 2026 11:58:11 +0000 (0:00:00.119) 0:01:08.810 ******** 2026-08-18 11:58:11.830863 | mon1 | ok: [mon1] 2026-08-18 11:58:11.831008 | mon1 | ok: [mon2] 2026-08-18 11:58:11.831160 | mon1 | ok: [mon3] 2026-08-18 11:58:11.831308 | mon1 | ok: [osd1] 2026-08-18 11:58:11.831450 | mon1 | 2026-08-18 11:58:11.831609 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:58:11.831758 | mon1 | Tuesday 18 August 2026 11:58:11 +0000 (0:00:00.465) 0:01:09.276 ******** 2026-08-18 11:58:15.277017 | mon1 | ok: [mon1] 2026-08-18 11:58:15.277074 | mon1 | ok: [osd1] 2026-08-18 11:58:15.277284 | mon1 | ok: [mon3] 2026-08-18 11:58:15.277518 | mon1 | ok: [mon2] 2026-08-18 11:58:15.277739 | mon1 | 2026-08-18 11:58:15.278032 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 11:58:15.278273 | mon1 | Tuesday 18 August 2026 11:58:15 +0000 (0:00:03.445) 0:01:12.721 ******** 2026-08-18 11:58:16.442948 | mon1 | ok: [mon1] 2026-08-18 11:58:16.443252 | mon1 | ok: [osd1] 2026-08-18 11:58:16.443544 | mon1 | ok: [mon2] 2026-08-18 11:58:16.443857 | mon1 | ok: [mon3] 2026-08-18 11:58:16.444163 | mon1 | 2026-08-18 11:58:16.444460 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 11:58:16.444745 | mon1 | Tuesday 18 August 2026 11:58:16 +0000 (0:00:01.166) 0:01:13.887 ******** 2026-08-18 11:58:16.711187 | mon1 | ok: [mon1] 2026-08-18 11:58:16.711243 | mon1 | ok: [mon2] 2026-08-18 11:58:16.711324 | mon1 | ok: [mon3] 2026-08-18 11:58:16.711425 | mon1 | ok: [osd1] 2026-08-18 11:58:16.711524 | mon1 | 2026-08-18 11:58:16.711638 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 11:58:16.711741 | mon1 | Tuesday 18 August 2026 11:58:16 +0000 (0:00:00.268) 0:01:14.156 ******** 2026-08-18 11:58:17.294368 | mon1 | ok: [mon1] 2026-08-18 11:58:17.294428 | mon1 | ok: [osd1] 2026-08-18 11:58:17.294590 | mon1 | ok: [mon2] 2026-08-18 11:58:17.294730 | mon1 | ok: [mon3] 2026-08-18 11:58:17.294900 | mon1 | 2026-08-18 11:58:17.295064 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 11:58:17.295214 | mon1 | Tuesday 18 August 2026 11:58:17 +0000 (0:00:00.582) 0:01:14.739 ******** 2026-08-18 11:58:18.053001 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 11:58:18.053106 | mon1 | ok: [mon2] => (item={'path': '/etc/docker'}) 2026-08-18 11:58:18.055178 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-08-18 11:58:18.055224 | mon1 | ok: [mon3] => (item={'path': '/etc/docker'}) 2026-08-18 11:58:18.055231 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:58:18.055237 | mon1 | ok: [mon2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:58:18.055243 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:58:18.055248 | mon1 | ok: [mon3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:58:18.055254 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:58:18.055260 | mon1 | ok: [mon2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:58:18.055265 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:58:18.055271 | mon1 | ok: [mon3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:58:18.055277 | mon1 | 2026-08-18 11:58:18.055283 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 11:58:18.055305 | mon1 | Tuesday 18 August 2026 11:58:18 +0000 (0:00:00.758) 0:01:15.497 ******** 2026-08-18 11:58:18.638050 | mon1 | ok: [mon1] 2026-08-18 11:58:18.638102 | mon1 | ok: [mon2] 2026-08-18 11:58:18.638113 | mon1 | ok: [mon3] 2026-08-18 11:58:18.638122 | mon1 | ok: [osd1] 2026-08-18 11:58:18.638132 | mon1 | 2026-08-18 11:58:18.638142 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 11:58:18.638157 | mon1 | Tuesday 18 August 2026 11:58:18 +0000 (0:00:00.583) 0:01:16.081 ******** 2026-08-18 11:58:19.256981 | mon1 | ok: [mon1] 2026-08-18 11:58:19.257034 | mon1 | ok: [mon2] 2026-08-18 11:58:19.258940 | mon1 | ok: [mon3] 2026-08-18 11:58:19.259000 | mon1 | ok: [osd1] 2026-08-18 11:58:19.259011 | mon1 | 2026-08-18 11:58:19.259020 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:58:19.259066 | mon1 | Tuesday 18 August 2026 11:58:19 +0000 (0:00:00.592) 0:01:16.673 ******** 2026-08-18 11:58:19.259076 | mon1 | 2026-08-18 11:58:19.259085 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:58:19.259139 | mon1 | Tuesday 18 August 2026 11:58:19 +0000 (0:00:00.007) 0:01:16.680 ******** 2026-08-18 11:58:19.259468 | mon1 | 2026-08-18 11:58:19.259802 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:58:19.260153 | mon1 | Tuesday 18 August 2026 11:58:19 +0000 (0:00:00.006) 0:01:16.687 ******** 2026-08-18 11:58:19.260467 | mon1 | 2026-08-18 11:58:19.260776 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:58:19.261138 | mon1 | Tuesday 18 August 2026 11:58:19 +0000 (0:00:00.006) 0:01:16.693 ******** 2026-08-18 11:58:19.261549 | mon1 | 2026-08-18 11:58:19.261854 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 11:58:19.262190 | mon1 | Tuesday 18 August 2026 11:58:19 +0000 (0:00:00.006) 0:01:16.700 ******** 2026-08-18 11:58:19.788122 | mon1 | ok: [mon1] 2026-08-18 11:58:19.788494 | mon1 | ok: [mon2] 2026-08-18 11:58:19.788833 | mon1 | ok: [mon3] 2026-08-18 11:58:19.789176 | mon1 | ok: [osd1] 2026-08-18 11:58:19.789576 | mon1 | 2026-08-18 11:58:19.789798 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:58:19.790140 | mon1 | Tuesday 18 August 2026 11:58:19 +0000 (0:00:00.532) 0:01:17.232 ******** 2026-08-18 11:58:19.836922 | mon1 | ok: [mon1] => { 2026-08-18 11:58:19.837299 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:58:19.837603 | mon1 | } 2026-08-18 11:58:19.874530 | mon1 | ok: [mon2] => { 2026-08-18 11:58:19.874912 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:58:19.875347 | mon1 | } 2026-08-18 11:58:19.875679 | mon1 | ok: [mon3] => { 2026-08-18 11:58:19.876074 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:58:19.876375 | mon1 | } 2026-08-18 11:58:19.876669 | mon1 | ok: [osd1] => { 2026-08-18 11:58:19.877155 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:58:19.877401 | mon1 | } 2026-08-18 11:58:19.877576 | mon1 | 2026-08-18 11:58:19.877772 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:58:19.877986 | mon1 | Tuesday 18 August 2026 11:58:19 +0000 (0:00:00.086) 0:01:17.319 ******** 2026-08-18 11:58:20.329286 | mon1 | ok: [mon1] 2026-08-18 11:58:20.330081 | mon1 | ok: [mon2] 2026-08-18 11:58:20.330148 | mon1 | ok: [mon3] 2026-08-18 11:58:20.330269 | mon1 | ok: [osd1] 2026-08-18 11:58:20.330487 | mon1 | 2026-08-18 11:58:20.330738 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:58:20.331023 | mon1 | Tuesday 18 August 2026 11:58:20 +0000 (0:00:00.454) 0:01:17.774 ******** 2026-08-18 11:58:20.375525 | mon1 | skipping: [mon1] 2026-08-18 11:58:20.432283 | mon1 | skipping: [mon2] 2026-08-18 11:58:20.432477 | mon1 | skipping: [mon3] 2026-08-18 11:58:20.432708 | mon1 | skipping: [osd1] 2026-08-18 11:58:20.432948 | mon1 | 2026-08-18 11:58:20.433221 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 11:58:20.433442 | mon1 | Tuesday 18 August 2026 11:58:20 +0000 (0:00:00.103) 0:01:17.877 ******** 2026-08-18 11:58:20.480087 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:58:20.538964 | mon1 | ok: [mon2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:58:20.539223 | mon1 | ok: [mon3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:58:20.539486 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:58:20.539710 | mon1 | 2026-08-18 11:58:20.540005 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 11:58:20.540239 | mon1 | Tuesday 18 August 2026 11:58:20 +0000 (0:00:00.106) 0:01:17.983 ******** 2026-08-18 11:58:22.669593 | mon1 | ok: [mon1] 2026-08-18 11:58:22.669798 | mon1 | ok: [mon2] 2026-08-18 11:58:22.670089 | mon1 | ok: [osd1] 2026-08-18 11:58:22.670371 | mon1 | ok: [mon3] 2026-08-18 11:58:22.670599 | mon1 | 2026-08-18 11:58:22.670855 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 11:58:22.671142 | mon1 | Tuesday 18 August 2026 11:58:22 +0000 (0:00:02.130) 0:01:20.114 ******** 2026-08-18 11:58:23.522054 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-08-18 11:58:23.522267 | mon1 | ok: [mon2] => (item=systemd-timesyncd) 2026-08-18 11:58:23.522510 | mon1 | ok: [mon3] => (item=systemd-timesyncd) 2026-08-18 11:58:23.522750 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-08-18 11:58:23.523027 | mon1 | ok: [mon1] => (item=ssh) 2026-08-18 11:58:23.523266 | mon1 | ok: [mon2] => (item=ssh) 2026-08-18 11:58:23.523532 | mon1 | ok: [mon3] => (item=ssh) 2026-08-18 11:58:23.523799 | mon1 | ok: [osd1] => (item=ssh) 2026-08-18 11:58:23.524072 | mon1 | 2026-08-18 11:58:23.524308 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 11:58:23.524566 | mon1 | Tuesday 18 August 2026 11:58:23 +0000 (0:00:00.852) 0:01:20.966 ******** 2026-08-18 11:58:23.814617 | mon1 | ok: [mon1] 2026-08-18 11:58:23.814825 | mon1 | ok: [mon2] 2026-08-18 11:58:23.815118 | mon1 | ok: [mon3] 2026-08-18 11:58:23.815348 | mon1 | ok: [osd1] 2026-08-18 11:58:23.815569 | mon1 | 2026-08-18 11:58:23.815823 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 11:58:23.816172 | mon1 | Tuesday 18 August 2026 11:58:23 +0000 (0:00:00.292) 0:01:21.259 ******** 2026-08-18 11:58:24.175261 | mon1 | ok: [mon1] 2026-08-18 11:58:24.175440 | mon1 | ok: [mon2] 2026-08-18 11:58:24.175681 | mon1 | ok: [mon3] 2026-08-18 11:58:24.175944 | mon1 | ok: [osd1] 2026-08-18 11:58:24.176180 | mon1 | 2026-08-18 11:58:24.176449 | mon1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 11:58:24.176762 | mon1 | Tuesday 18 August 2026 11:58:24 +0000 (0:00:00.360) 0:01:21.620 ******** 2026-08-18 11:58:24.751972 | mon1 | ok: [mon1] 2026-08-18 11:58:24.752227 | mon1 | ok: [osd1] 2026-08-18 11:58:24.752481 | mon1 | ok: [mon2] 2026-08-18 11:58:24.752728 | mon1 | ok: [mon3] 2026-08-18 11:58:24.753020 | mon1 | 2026-08-18 11:58:24.753314 | mon1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 11:58:24.753620 | mon1 | Tuesday 18 August 2026 11:58:24 +0000 (0:00:00.576) 0:01:22.196 ******** 2026-08-18 11:58:24.839304 | mon1 | skipping: [mon1] 2026-08-18 11:58:24.839484 | mon1 | skipping: [mon2] 2026-08-18 11:58:24.839736 | mon1 | skipping: [mon3] 2026-08-18 11:58:24.840035 | mon1 | skipping: [osd1] 2026-08-18 11:58:24.840260 | mon1 | 2026-08-18 11:58:24.840537 | mon1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 11:58:24.840781 | mon1 | Tuesday 18 August 2026 11:58:24 +0000 (0:00:00.087) 0:01:22.284 ******** 2026-08-18 11:58:25.315612 | mon1 | ok: [mon1] 2026-08-18 11:58:25.315890 | mon1 | ok: [mon3] 2026-08-18 11:58:25.316232 | mon1 | ok: [osd1] 2026-08-18 11:58:25.316551 | mon1 | ok: [mon2] 2026-08-18 11:58:25.316850 | mon1 | 2026-08-18 11:58:25.317254 | mon1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 11:58:25.317596 | mon1 | Tuesday 18 August 2026 11:58:25 +0000 (0:00:00.475) 0:01:22.759 ******** 2026-08-18 11:58:25.911027 | mon1 | ok: [mon1] 2026-08-18 11:58:25.911086 | mon1 | ok: [mon3] 2026-08-18 11:58:25.911096 | mon1 | ok: [mon2] 2026-08-18 11:58:25.911111 | mon1 | ok: [osd1] 2026-08-18 11:58:25.911305 | mon1 | 2026-08-18 11:58:25.911557 | mon1 | TASK [vexxhost.ceph.osd : Locate the cluster admin host] *********************** 2026-08-18 11:58:25.911800 | mon1 | Tuesday 18 August 2026 11:58:25 +0000 (0:00:00.595) 0:01:23.355 ******** 2026-08-18 11:58:26.688943 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:58:26.689224 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:58:26.689496 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:58:26.689736 | mon1 | 2026-08-18 11:58:26.690043 | mon1 | TASK [vexxhost.ceph.osd : Select the admin host and its mon config path] ******* 2026-08-18 11:58:26.690302 | mon1 | Tuesday 18 August 2026 11:58:26 +0000 (0:00:00.778) 0:01:24.133 ******** 2026-08-18 11:58:26.783798 | mon1 | ok: [mon1] 2026-08-18 11:58:26.784091 | mon1 | ok: [mon2] 2026-08-18 11:58:26.784332 | mon1 | ok: [mon3] 2026-08-18 11:58:26.784609 | mon1 | ok: [osd1] 2026-08-18 11:58:26.784822 | mon1 | 2026-08-18 11:58:26.785129 | mon1 | TASK [vexxhost.ceph.osd : Set the admin mon config path] *********************** 2026-08-18 11:58:26.785386 | mon1 | Tuesday 18 August 2026 11:58:26 +0000 (0:00:00.095) 0:01:24.228 ******** 2026-08-18 11:58:26.832084 | mon1 | ok: [mon1] 2026-08-18 11:58:26.874416 | mon1 | ok: [mon2] 2026-08-18 11:58:26.874565 | mon1 | ok: [mon3] 2026-08-18 11:58:26.874809 | mon1 | ok: [osd1] 2026-08-18 11:58:26.875072 | mon1 | 2026-08-18 11:58:26.875304 | mon1 | TASK [Register this OSD host] ************************************************** 2026-08-18 11:58:26.875542 | mon1 | Tuesday 18 August 2026 11:58:26 +0000 (0:00:00.090) 0:01:24.319 ******** 2026-08-18 11:58:27.020093 | mon1 | included: vexxhost.ceph.cephadm_host for mon1, mon2, mon3, osd1 2026-08-18 11:58:27.020182 | mon1 | 2026-08-18 11:58:27.020193 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 11:58:27.020203 | mon1 | Tuesday 18 August 2026 11:58:27 +0000 (0:00:00.144) 0:01:24.463 ******** 2026-08-18 11:58:28.712955 | mon1 | ok: [mon1] 2026-08-18 11:58:28.713019 | mon1 | 2026-08-18 11:58:28.713402 | mon1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 11:58:28.713457 | mon1 | Tuesday 18 August 2026 11:58:28 +0000 (0:00:01.693) 0:01:26.157 ******** 2026-08-18 11:58:28.767703 | mon1 | ok: [mon1] 2026-08-18 11:58:28.811244 | mon1 | ok: [mon2] 2026-08-18 11:58:28.811285 | mon1 | ok: [mon3] 2026-08-18 11:58:28.811291 | mon1 | ok: [osd1] 2026-08-18 11:58:28.811297 | mon1 | 2026-08-18 11:58:28.811304 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 11:58:28.811310 | mon1 | Tuesday 18 August 2026 11:58:28 +0000 (0:00:00.097) 0:01:26.254 ******** 2026-08-18 11:58:28.862610 | mon1 | ok: [mon1] => { 2026-08-18 11:58:28.862649 | mon1 | "changed": false, 2026-08-18 11:58:28.862655 | mon1 | "msg": "All assertions passed" 2026-08-18 11:58:28.862660 | mon1 | } 2026-08-18 11:58:28.908034 | mon1 | ok: [mon2] => { 2026-08-18 11:58:28.908110 | mon1 | "changed": false, 2026-08-18 11:58:28.908146 | mon1 | "msg": "All assertions passed" 2026-08-18 11:58:28.909942 | mon1 | } 2026-08-18 11:58:28.910004 | mon1 | ok: [mon3] => { 2026-08-18 11:58:28.910017 | mon1 | "changed": false, 2026-08-18 11:58:28.910029 | mon1 | "msg": "All assertions passed" 2026-08-18 11:58:28.910040 | mon1 | } 2026-08-18 11:58:28.910051 | mon1 | ok: [osd1] => { 2026-08-18 11:58:28.910062 | mon1 | "changed": false, 2026-08-18 11:58:28.910255 | mon1 | "msg": "All assertions passed" 2026-08-18 11:58:28.910602 | mon1 | } 2026-08-18 11:58:28.910928 | mon1 | 2026-08-18 11:58:28.911265 | mon1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 11:58:28.911573 | mon1 | Tuesday 18 August 2026 11:58:28 +0000 (0:00:00.097) 0:01:26.352 ******** 2026-08-18 11:58:29.272324 | mon1 | ok: [mon1] 2026-08-18 11:58:29.272384 | mon1 | ok: [mon3] 2026-08-18 11:58:29.272471 | mon1 | ok: [mon2] 2026-08-18 11:58:29.272575 | mon1 | ok: [osd1] 2026-08-18 11:58:29.272674 | mon1 | 2026-08-18 11:58:29.272804 | mon1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 11:58:29.272936 | mon1 | Tuesday 18 August 2026 11:58:29 +0000 (0:00:00.364) 0:01:26.717 ******** 2026-08-18 11:58:29.368000 | mon1 | ok: [mon1] 2026-08-18 11:58:29.368042 | mon1 | ok: [mon2] 2026-08-18 11:58:29.368051 | mon1 | ok: [mon3] 2026-08-18 11:58:29.368059 | mon1 | ok: [osd1] 2026-08-18 11:58:29.368068 | mon1 | 2026-08-18 11:58:29.368077 | mon1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 11:58:29.368085 | mon1 | Tuesday 18 August 2026 11:58:29 +0000 (0:00:00.095) 0:01:26.812 ******** 2026-08-18 11:58:29.505402 | mon1 | ok: [mon1] 2026-08-18 11:58:29.505465 | mon1 | ok: [mon2] 2026-08-18 11:58:29.505665 | mon1 | ok: [mon3] 2026-08-18 11:58:29.505804 | mon1 | ok: [osd1] 2026-08-18 11:58:29.506323 | mon1 | 2026-08-18 11:58:29.506355 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 11:58:29.506362 | mon1 | Tuesday 18 August 2026 11:58:29 +0000 (0:00:00.137) 0:01:26.949 ******** 2026-08-18 11:58:29.561931 | mon1 | ok: [mon1] => { 2026-08-18 11:58:29.561950 | mon1 | "changed": false, 2026-08-18 11:58:29.561956 | mon1 | "msg": "All assertions passed" 2026-08-18 11:58:29.561962 | mon1 | } 2026-08-18 11:58:29.611514 | mon1 | ok: [mon2] => { 2026-08-18 11:58:29.611566 | mon1 | "changed": false, 2026-08-18 11:58:29.611572 | mon1 | "msg": "All assertions passed" 2026-08-18 11:58:29.611900 | mon1 | } 2026-08-18 11:58:29.611907 | mon1 | ok: [mon3] => { 2026-08-18 11:58:29.612965 | mon1 | "changed": false, 2026-08-18 11:58:29.613042 | mon1 | "msg": "All assertions passed" 2026-08-18 11:58:29.613052 | mon1 | } 2026-08-18 11:58:29.613061 | mon1 | ok: [osd1] => { 2026-08-18 11:58:29.613303 | mon1 | "changed": false, 2026-08-18 11:58:29.613706 | mon1 | "msg": "All assertions passed" 2026-08-18 11:58:29.614161 | mon1 | } 2026-08-18 11:58:29.614498 | mon1 | 2026-08-18 11:58:29.614718 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 11:58:29.614944 | mon1 | Tuesday 18 August 2026 11:58:29 +0000 (0:00:00.104) 0:01:27.054 ******** 2026-08-18 11:58:31.387822 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:58:31.388279 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:58:31.388636 | mon1 | ok: [mon1] 2026-08-18 11:58:31.389010 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:58:31.389308 | mon1 | 2026-08-18 11:58:31.390036 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 11:58:31.390072 | mon1 | Tuesday 18 August 2026 11:58:31 +0000 (0:00:01.777) 0:01:28.831 ******** 2026-08-18 11:58:31.502321 | mon1 | skipping: [mon1] 2026-08-18 11:58:31.502373 | mon1 | skipping: [mon2] 2026-08-18 11:58:31.502496 | mon1 | skipping: [mon3] 2026-08-18 11:58:31.502601 | mon1 | skipping: [osd1] 2026-08-18 11:58:31.502703 | mon1 | 2026-08-18 11:58:31.502899 | mon1 | TASK [vexxhost.ceph.osd : Apply OSD service specs (drive groups)] ************** 2026-08-18 11:58:31.502973 | mon1 | Tuesday 18 August 2026 11:58:31 +0000 (0:00:00.115) 0:01:28.946 ******** 2026-08-18 11:58:31.538452 | mon1 | skipping: [mon1] 2026-08-18 11:58:31.538507 | mon1 | 2026-08-18 11:58:31.538520 | mon1 | TASK [vexxhost.ceph.osd : List existing ceph-volume OSDs on this host] ********* 2026-08-18 11:58:31.538533 | mon1 | Tuesday 18 August 2026 11:58:31 +0000 (0:00:00.035) 0:01:28.982 ******** 2026-08-18 11:58:33.208266 | mon1 | ok: [mon1] 2026-08-18 11:58:33.208329 | mon1 | ok: [mon2] 2026-08-18 11:58:33.208441 | mon1 | ok: [osd1] 2026-08-18 11:58:33.208543 | mon1 | ok: [mon3] 2026-08-18 11:58:33.208643 | mon1 | 2026-08-18 11:58:33.208758 | mon1 | TASK [vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices] ******** 2026-08-18 11:58:33.208859 | mon1 | Tuesday 18 August 2026 11:58:33 +0000 (0:00:01.668) 0:01:30.650 ******** 2026-08-18 11:58:33.258805 | mon1 | skipping: [mon1] => (item=/dev/ceph-mon1-osd0/data) 2026-08-18 11:58:33.258840 | mon1 | skipping: [mon1] => (item=/dev/ceph-mon1-osd1/data) 2026-08-18 11:58:33.336076 | mon1 | skipping: [mon2] => (item=/dev/ceph-mon2-osd0/data) 2026-08-18 11:58:33.336170 | mon1 | skipping: [mon1] => (item=/dev/ceph-mon1-osd2/data) 2026-08-18 11:58:33.336275 | mon1 | skipping: [mon1] 2026-08-18 11:58:33.336383 | mon1 | skipping: [mon3] => (item=/dev/ceph-mon3-osd0/data) 2026-08-18 11:58:33.336487 | mon1 | skipping: [mon2] => (item=/dev/ceph-mon2-osd1/data) 2026-08-18 11:58:33.336594 | mon1 | skipping: [mon3] => (item=/dev/ceph-mon3-osd1/data) 2026-08-18 11:58:33.336702 | mon1 | skipping: [mon2] => (item=/dev/ceph-mon2-osd2/data) 2026-08-18 11:58:33.336806 | mon1 | skipping: [mon2] 2026-08-18 11:58:33.336942 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-08-18 11:58:33.337059 | mon1 | skipping: [mon3] => (item=/dev/ceph-mon3-osd2/data) 2026-08-18 11:58:33.337165 | mon1 | skipping: [mon3] 2026-08-18 11:58:33.337271 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-08-18 11:58:33.337379 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-08-18 11:58:33.337483 | mon1 | skipping: [osd1] 2026-08-18 11:58:33.337583 | mon1 | 2026-08-18 11:58:33.337714 | mon1 | TASK [vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host] *** 2026-08-18 11:58:33.337813 | mon1 | Tuesday 18 August 2026 11:58:33 +0000 (0:00:00.130) 0:01:30.781 ******** 2026-08-18 11:58:35.247564 | mon1 | ok: [mon1] 2026-08-18 11:58:35.247601 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:58:35.247608 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:58:35.247613 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:58:35.247618 | mon1 | 2026-08-18 11:58:35.247624 | mon1 | TASK [vexxhost.ceph.osd : Wait for OSD drive-group services to deploy at least one daemon] *** 2026-08-18 11:58:35.247629 | mon1 | Tuesday 18 August 2026 11:58:35 +0000 (0:00:01.906) 0:01:32.688 ******** 2026-08-18 11:58:35.388780 | mon1 | skipping: [mon1] 2026-08-18 11:58:35.388819 | mon1 | 2026-08-18 11:58:35.388826 | mon1 | PLAY [Apply Ceph configuration] ************************************************ 2026-08-18 11:58:35.388832 | mon1 | 2026-08-18 11:58:35.388837 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:58:35.388842 | mon1 | Tuesday 18 August 2026 11:58:35 +0000 (0:00:00.144) 0:01:32.832 ******** 2026-08-18 11:58:36.445564 | mon1 | ok: [mon1] 2026-08-18 11:58:36.445799 | mon1 | ok: [mon2] 2026-08-18 11:58:36.446038 | mon1 | ok: [mon3] 2026-08-18 11:58:36.446227 | mon1 | 2026-08-18 11:58:36.446433 | mon1 | TASK [vexxhost.ceph.configure : Locate the cluster admin host] ***************** 2026-08-18 11:58:36.446631 | mon1 | Tuesday 18 August 2026 11:58:36 +0000 (0:00:01.058) 0:01:33.890 ******** 2026-08-18 11:58:37.196831 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:58:37.197170 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:58:37.197414 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:58:37.197631 | mon1 | 2026-08-18 11:58:37.197907 | mon1 | TASK [vexxhost.ceph.configure : Select the admin host] ************************* 2026-08-18 11:58:37.198189 | mon1 | Tuesday 18 August 2026 11:58:37 +0000 (0:00:00.750) 0:01:34.641 ******** 2026-08-18 11:58:37.267000 | mon1 | ok: [mon1] 2026-08-18 11:58:37.267379 | mon1 | ok: [mon2] 2026-08-18 11:58:37.267611 | mon1 | ok: [mon3] 2026-08-18 11:58:37.267755 | mon1 | 2026-08-18 11:58:37.267995 | mon1 | TASK [vexxhost.ceph.configure : Set the admin mon config path] ***************** 2026-08-18 11:58:37.268263 | mon1 | Tuesday 18 August 2026 11:58:37 +0000 (0:00:00.071) 0:01:34.712 ******** 2026-08-18 11:58:37.329320 | mon1 | ok: [mon1] 2026-08-18 11:58:37.329454 | mon1 | ok: [mon2] 2026-08-18 11:58:37.329603 | mon1 | ok: [mon3] 2026-08-18 11:58:37.329741 | mon1 | 2026-08-18 11:58:37.329926 | mon1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] ************** 2026-08-18 11:58:37.330084 | mon1 | Tuesday 18 August 2026 11:58:37 +0000 (0:00:00.061) 0:01:34.774 ******** 2026-08-18 11:58:37.383717 | mon1 | skipping: [mon1] 2026-08-18 11:58:37.383815 | mon1 | skipping: [mon2] 2026-08-18 11:58:37.383960 | mon1 | skipping: [mon3] 2026-08-18 11:58:37.384073 | mon1 | 2026-08-18 11:58:37.384192 | mon1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] *************** 2026-08-18 11:58:37.384306 | mon1 | Tuesday 18 August 2026 11:58:37 +0000 (0:00:00.054) 0:01:34.828 ******** 2026-08-18 11:58:37.437958 | mon1 | skipping: [mon1] 2026-08-18 11:58:37.438103 | mon1 | skipping: [mon2] 2026-08-18 11:58:37.438341 | mon1 | skipping: [mon3] 2026-08-18 11:58:37.438559 | mon1 | 2026-08-18 11:58:37.438920 | mon1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] ************************* 2026-08-18 11:58:37.439128 | mon1 | Tuesday 18 August 2026 11:58:37 +0000 (0:00:00.053) 0:01:34.882 ******** 2026-08-18 11:58:37.491187 | mon1 | skipping: [mon1] 2026-08-18 11:58:37.491394 | mon1 | skipping: [mon2] 2026-08-18 11:58:37.491598 | mon1 | skipping: [mon3] 2026-08-18 11:58:37.491837 | mon1 | 2026-08-18 11:58:37.495899 | mon1 | TASK [vexxhost.ceph.configure : Configure pools] ******************************* 2026-08-18 11:58:37.495919 | mon1 | Tuesday 18 August 2026 11:58:37 +0000 (0:00:00.053) 0:01:34.936 ******** 2026-08-18 11:58:37.562032 | mon1 | skipping: [mon1] 2026-08-18 11:58:37.562275 | mon1 | skipping: [mon2] 2026-08-18 11:58:37.562537 | mon1 | skipping: [mon3] 2026-08-18 11:58:37.562772 | mon1 | 2026-08-18 11:58:37.563065 | mon1 | TASK [vexxhost.ceph.configure : Configure CephX keys] ************************** 2026-08-18 11:58:37.563324 | mon1 | Tuesday 18 August 2026 11:58:37 +0000 (0:00:00.070) 0:01:35.006 ******** 2026-08-18 11:58:37.618595 | mon1 | skipping: [mon1] 2026-08-18 11:58:37.618805 | mon1 | skipping: [mon2] 2026-08-18 11:58:37.619065 | mon1 | skipping: [mon3] 2026-08-18 11:58:37.619302 | mon1 | 2026-08-18 11:58:37.619567 | mon1 | TASK [vexxhost.ceph.configure : Enroll the dashboard TLS certificate] ********** 2026-08-18 11:58:37.619802 | mon1 | Tuesday 18 August 2026 11:58:37 +0000 (0:00:00.056) 0:01:35.063 ******** 2026-08-18 11:58:37.696375 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard.yml for mon1, mon2, mon3 2026-08-18 11:58:37.696406 | mon1 | 2026-08-18 11:58:37.696411 | mon1 | TASK [vexxhost.ceph.configure : Check whether the dashboard mgr module is enabled] *** 2026-08-18 11:58:37.696418 | mon1 | Tuesday 18 August 2026 11:58:37 +0000 (0:00:00.073) 0:01:35.137 ******** 2026-08-18 11:58:39.434922 | mon1 | ok: [mon1] 2026-08-18 11:58:39.435129 | mon1 | 2026-08-18 11:58:39.435378 | mon1 | TASK [vexxhost.ceph.configure : Get the current dashboard certificate] ********* 2026-08-18 11:58:39.435623 | mon1 | Tuesday 18 August 2026 11:58:39 +0000 (0:00:01.742) 0:01:36.879 ******** 2026-08-18 11:58:41.734684 | mon1 | ok: [mon1] 2026-08-18 11:58:41.734742 | mon1 | 2026-08-18 11:58:41.734751 | mon1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate] ***************** 2026-08-18 11:58:41.734759 | mon1 | Tuesday 18 August 2026 11:58:41 +0000 (0:00:02.299) 0:01:39.178 ******** 2026-08-18 11:58:41.778481 | mon1 | skipping: [mon1] 2026-08-18 11:58:41.778532 | mon1 | 2026-08-18 11:58:41.778546 | mon1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate key] ************* 2026-08-18 11:58:41.778558 | mon1 | Tuesday 18 August 2026 11:58:41 +0000 (0:00:00.042) 0:01:39.221 ******** 2026-08-18 11:58:41.822071 | mon1 | skipping: [mon1] 2026-08-18 11:58:41.822503 | mon1 | 2026-08-18 11:58:41.823259 | mon1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 11:58:41.823291 | mon1 | Tuesday 18 August 2026 11:58:41 +0000 (0:00:00.043) 0:01:39.265 ******** 2026-08-18 11:58:41.860032 | mon1 | skipping: [mon1] 2026-08-18 11:58:41.860069 | mon1 | 2026-08-18 11:58:41.860199 | mon1 | TASK [vexxhost.ceph.configure : Create a self-signed certificate] ************** 2026-08-18 11:58:41.860452 | mon1 | Tuesday 18 August 2026 11:58:41 +0000 (0:00:00.039) 0:01:39.304 ******** 2026-08-18 11:58:41.906820 | mon1 | skipping: [mon1] 2026-08-18 11:58:41.907012 | mon1 | 2026-08-18 11:58:41.907252 | mon1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 11:58:41.907491 | mon1 | Tuesday 18 August 2026 11:58:41 +0000 (0:00:00.047) 0:01:39.351 ******** 2026-08-18 11:58:41.948623 | mon1 | skipping: [mon1] 2026-08-18 11:58:41.948812 | mon1 | 2026-08-18 11:58:41.949193 | mon1 | TASK [vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate] *** 2026-08-18 11:58:41.949419 | mon1 | Tuesday 18 August 2026 11:58:41 +0000 (0:00:00.041) 0:01:39.393 ******** 2026-08-18 11:58:42.010161 | mon1 | skipping: [mon1] => (item=ceph mgr module disable dashboard) 2026-08-18 11:58:42.010368 | mon1 | skipping: [mon1] => (item=ceph mgr module enable dashboard) 2026-08-18 11:58:42.010626 | mon1 | skipping: [mon1] => (item=ceph orch reconfig mgr) 2026-08-18 11:58:42.010904 | mon1 | skipping: [mon1] 2026-08-18 11:58:42.011152 | mon1 | 2026-08-18 11:58:42.011417 | mon1 | TASK [vexxhost.ceph.configure : Configure dashboard users] ********************* 2026-08-18 11:58:42.011706 | mon1 | Tuesday 18 August 2026 11:58:42 +0000 (0:00:00.061) 0:01:39.455 ******** 2026-08-18 11:58:42.114769 | mon1 | skipping: [mon1] 2026-08-18 11:58:42.115031 | mon1 | skipping: [mon2] 2026-08-18 11:58:42.115325 | mon1 | skipping: [mon3] 2026-08-18 11:58:42.115982 | mon1 | 2026-08-18 11:58:42.116013 | mon1 | PLAY [Deploy Ceph RADOS Gateways] ********************************************** 2026-08-18 11:58:42.116210 | mon1 | 2026-08-18 11:58:42.116659 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:58:42.116956 | mon1 | Tuesday 18 August 2026 11:58:42 +0000 (0:00:00.105) 0:01:39.560 ******** 2026-08-18 11:58:43.219095 | mon1 | ok: [mon1] 2026-08-18 11:58:43.219334 | mon1 | ok: [mon2] 2026-08-18 11:58:43.219581 | mon1 | ok: [mon3] 2026-08-18 11:58:43.219794 | mon1 | 2026-08-18 11:58:43.220092 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:58:43.220392 | mon1 | Tuesday 18 August 2026 11:58:43 +0000 (0:00:01.103) 0:01:40.663 ******** 2026-08-18 11:58:43.520615 | mon1 | ok: [mon1] 2026-08-18 11:58:43.520817 | mon1 | ok: [mon2] 2026-08-18 11:58:43.521119 | mon1 | ok: [mon3] 2026-08-18 11:58:43.521349 | mon1 | 2026-08-18 11:58:43.521618 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:58:43.521900 | mon1 | Tuesday 18 August 2026 11:58:43 +0000 (0:00:00.301) 0:01:40.965 ******** 2026-08-18 11:58:43.605821 | mon1 | skipping: [mon1] 2026-08-18 11:58:43.606061 | mon1 | skipping: [mon2] 2026-08-18 11:58:43.606280 | mon1 | skipping: [mon3] 2026-08-18 11:58:43.606496 | mon1 | 2026-08-18 11:58:43.606751 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 11:58:43.607050 | mon1 | Tuesday 18 August 2026 11:58:43 +0000 (0:00:00.085) 0:01:41.050 ******** 2026-08-18 11:58:43.906412 | mon1 | ok: [mon1] 2026-08-18 11:58:43.906644 | mon1 | ok: [mon3] 2026-08-18 11:58:43.906920 | mon1 | ok: [mon2] 2026-08-18 11:58:43.907164 | mon1 | 2026-08-18 11:58:43.907435 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:58:43.907694 | mon1 | Tuesday 18 August 2026 11:58:43 +0000 (0:00:00.300) 0:01:41.351 ******** 2026-08-18 11:58:44.016675 | mon1 | ok: [mon1] => { 2026-08-18 11:58:44.016958 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:58:44.017337 | mon1 | } 2026-08-18 11:58:44.017670 | mon1 | ok: [mon2] => { 2026-08-18 11:58:44.018107 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:58:44.018370 | mon1 | } 2026-08-18 11:58:44.018644 | mon1 | ok: [mon3] => { 2026-08-18 11:58:44.019130 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:58:44.019409 | mon1 | } 2026-08-18 11:58:44.019636 | mon1 | 2026-08-18 11:58:44.019918 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:58:44.020191 | mon1 | Tuesday 18 August 2026 11:58:44 +0000 (0:00:00.110) 0:01:41.461 ******** 2026-08-18 11:58:44.460689 | mon1 | ok: [mon1] 2026-08-18 11:58:44.460909 | mon1 | ok: [mon2] 2026-08-18 11:58:44.461188 | mon1 | ok: [mon3] 2026-08-18 11:58:44.461420 | mon1 | 2026-08-18 11:58:44.461664 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:58:44.461944 | mon1 | Tuesday 18 August 2026 11:58:44 +0000 (0:00:00.444) 0:01:41.905 ******** 2026-08-18 11:58:44.567229 | mon1 | skipping: [mon1] 2026-08-18 11:58:44.567465 | mon1 | skipping: [mon2] 2026-08-18 11:58:44.567750 | mon1 | skipping: [mon3] 2026-08-18 11:58:44.568040 | mon1 | 2026-08-18 11:58:44.568296 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:58:44.568571 | mon1 | Tuesday 18 August 2026 11:58:44 +0000 (0:00:00.106) 0:01:42.011 ******** 2026-08-18 11:58:44.672526 | mon1 | skipping: [mon1] 2026-08-18 11:58:44.672716 | mon1 | skipping: [mon2] 2026-08-18 11:58:44.673001 | mon1 | skipping: [mon3] 2026-08-18 11:58:44.673221 | mon1 | 2026-08-18 11:58:44.673501 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:58:44.673752 | mon1 | Tuesday 18 August 2026 11:58:44 +0000 (0:00:00.105) 0:01:42.117 ******** 2026-08-18 11:58:44.982250 | mon1 | ok: [mon1] 2026-08-18 11:58:44.982325 | mon1 | ok: [mon2] 2026-08-18 11:58:44.982338 | mon1 | ok: [mon3] 2026-08-18 11:58:44.982449 | mon1 | 2026-08-18 11:58:44.982581 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:58:44.982672 | mon1 | Tuesday 18 August 2026 11:58:44 +0000 (0:00:00.308) 0:01:42.425 ******** 2026-08-18 11:58:46.215519 | mon1 | ok: [mon1] 2026-08-18 11:58:46.215712 | mon1 | ok: [mon3] 2026-08-18 11:58:46.215986 | mon1 | ok: [mon2] 2026-08-18 11:58:46.216299 | mon1 | 2026-08-18 11:58:46.216658 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:58:46.217046 | mon1 | Tuesday 18 August 2026 11:58:46 +0000 (0:00:01.234) 0:01:43.660 ******** 2026-08-18 11:58:46.454250 | mon1 | ok: [mon1] => { 2026-08-18 11:58:46.454316 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:58:46.454410 | mon1 | } 2026-08-18 11:58:46.454537 | mon1 | ok: [mon2] => { 2026-08-18 11:58:46.454651 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:58:46.454753 | mon1 | } 2026-08-18 11:58:46.454859 | mon1 | ok: [mon3] => { 2026-08-18 11:58:46.454999 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:58:46.455093 | mon1 | } 2026-08-18 11:58:46.455203 | mon1 | 2026-08-18 11:58:46.455351 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:58:46.455446 | mon1 | Tuesday 18 August 2026 11:58:46 +0000 (0:00:00.238) 0:01:43.899 ******** 2026-08-18 11:58:47.060111 | mon1 | ok: [mon1] 2026-08-18 11:58:47.060386 | mon1 | ok: [mon2] 2026-08-18 11:58:47.060614 | mon1 | ok: [mon3] 2026-08-18 11:58:47.060833 | mon1 | 2026-08-18 11:58:47.061125 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:58:47.061422 | mon1 | Tuesday 18 August 2026 11:58:47 +0000 (0:00:00.605) 0:01:44.504 ******** 2026-08-18 11:58:49.419936 | mon1 | ok: [mon1] 2026-08-18 11:58:49.419990 | mon1 | ok: [mon2] 2026-08-18 11:58:49.419999 | mon1 | ok: [mon3] 2026-08-18 11:58:49.420008 | mon1 | 2026-08-18 11:58:49.420017 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 11:58:49.420027 | mon1 | Tuesday 18 August 2026 11:58:49 +0000 (0:00:02.359) 0:01:46.863 ******** 2026-08-18 11:58:49.483793 | mon1 | skipping: [mon1] 2026-08-18 11:58:49.483848 | mon1 | skipping: [mon2] 2026-08-18 11:58:49.483857 | mon1 | skipping: [mon3] 2026-08-18 11:58:49.483866 | mon1 | 2026-08-18 11:58:49.483905 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 11:58:49.483915 | mon1 | Tuesday 18 August 2026 11:58:49 +0000 (0:00:00.063) 0:01:46.926 ******** 2026-08-18 11:58:49.546007 | mon1 | skipping: [mon1] 2026-08-18 11:58:49.546052 | mon1 | skipping: [mon2] 2026-08-18 11:58:49.546901 | mon1 | skipping: [mon3] 2026-08-18 11:58:49.546958 | mon1 | 2026-08-18 11:58:49.546969 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 11:58:49.546978 | mon1 | Tuesday 18 August 2026 11:58:49 +0000 (0:00:00.063) 0:01:46.989 ******** 2026-08-18 11:58:49.609838 | mon1 | skipping: [mon1] 2026-08-18 11:58:49.609920 | mon1 | skipping: [mon2] 2026-08-18 11:58:49.609930 | mon1 | skipping: [mon3] 2026-08-18 11:58:49.609940 | mon1 | 2026-08-18 11:58:49.609949 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 11:58:49.609958 | mon1 | Tuesday 18 August 2026 11:58:49 +0000 (0:00:00.062) 0:01:47.052 ******** 2026-08-18 11:58:50.772933 | mon1 | ok: [mon1] 2026-08-18 11:58:50.772994 | mon1 | ok: [mon3] 2026-08-18 11:58:50.773004 | mon1 | ok: [mon2] 2026-08-18 11:58:50.773013 | mon1 | 2026-08-18 11:58:50.773022 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 11:58:50.773032 | mon1 | Tuesday 18 August 2026 11:58:50 +0000 (0:00:01.163) 0:01:48.215 ******** 2026-08-18 11:58:51.394037 | mon1 | ok: [mon1] 2026-08-18 11:58:51.394088 | mon1 | ok: [mon2] 2026-08-18 11:58:51.394104 | mon1 | ok: [mon3] 2026-08-18 11:58:51.394927 | mon1 | 2026-08-18 11:58:51.394977 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 11:58:51.394988 | mon1 | Tuesday 18 August 2026 11:58:51 +0000 (0:00:00.622) 0:01:48.838 ******** 2026-08-18 11:58:52.630660 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:58:52.630729 | mon1 | ok: [mon2] => (item={'path': '/etc/containerd'}) 2026-08-18 11:58:52.630806 | mon1 | ok: [mon3] => (item={'path': '/etc/containerd'}) 2026-08-18 11:58:52.632504 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:58:52.632567 | mon1 | ok: [mon2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:58:52.632572 | mon1 | ok: [mon3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:58:52.632576 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:58:52.632580 | mon1 | ok: [mon2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:58:52.632584 | mon1 | ok: [mon3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:58:52.632589 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:58:52.632594 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:58:52.632598 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:58:52.632602 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:58:52.632607 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:58:52.632611 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:58:52.632615 | mon1 | 2026-08-18 11:58:52.632620 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 11:58:52.632624 | mon1 | Tuesday 18 August 2026 11:58:52 +0000 (0:00:01.236) 0:01:50.074 ******** 2026-08-18 11:58:53.384955 | mon1 | ok: [mon1] 2026-08-18 11:58:53.385048 | mon1 | ok: [mon2] 2026-08-18 11:58:53.385058 | mon1 | ok: [mon3] 2026-08-18 11:58:53.385068 | mon1 | 2026-08-18 11:58:53.385077 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:58:53.385087 | mon1 | Tuesday 18 August 2026 11:58:53 +0000 (0:00:00.732) 0:01:50.807 ******** 2026-08-18 11:58:53.385095 | mon1 | 2026-08-18 11:58:53.385104 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:58:53.385112 | mon1 | Tuesday 18 August 2026 11:58:53 +0000 (0:00:00.007) 0:01:50.814 ******** 2026-08-18 11:58:53.385120 | mon1 | 2026-08-18 11:58:53.385193 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:58:53.385503 | mon1 | Tuesday 18 August 2026 11:58:53 +0000 (0:00:00.006) 0:01:50.820 ******** 2026-08-18 11:58:53.385780 | mon1 | 2026-08-18 11:58:53.386115 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 11:58:53.386424 | mon1 | Tuesday 18 August 2026 11:58:53 +0000 (0:00:00.006) 0:01:50.826 ******** 2026-08-18 11:58:53.886773 | mon1 | ok: [mon1] 2026-08-18 11:58:53.886807 | mon1 | ok: [mon2] 2026-08-18 11:58:53.886811 | mon1 | ok: [mon3] 2026-08-18 11:58:53.886815 | mon1 | 2026-08-18 11:58:53.886820 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:58:53.886824 | mon1 | Tuesday 18 August 2026 11:58:53 +0000 (0:00:00.502) 0:01:51.329 ******** 2026-08-18 11:58:54.187591 | mon1 | ok: [mon1] 2026-08-18 11:58:54.187814 | mon1 | ok: [mon2] 2026-08-18 11:58:54.188082 | mon1 | ok: [mon3] 2026-08-18 11:58:54.188300 | mon1 | 2026-08-18 11:58:54.188545 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:58:54.188801 | mon1 | Tuesday 18 August 2026 11:58:54 +0000 (0:00:00.302) 0:01:51.632 ******** 2026-08-18 11:58:54.297593 | mon1 | ok: [mon1] => { 2026-08-18 11:58:54.297860 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:58:54.298147 | mon1 | } 2026-08-18 11:58:54.298394 | mon1 | ok: [mon2] => { 2026-08-18 11:58:54.298718 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:58:54.299003 | mon1 | } 2026-08-18 11:58:54.299235 | mon1 | ok: [mon3] => { 2026-08-18 11:58:54.299521 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:58:54.299736 | mon1 | } 2026-08-18 11:58:54.300002 | mon1 | 2026-08-18 11:58:54.300241 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:58:54.300479 | mon1 | Tuesday 18 August 2026 11:58:54 +0000 (0:00:00.109) 0:01:51.742 ******** 2026-08-18 11:58:54.760055 | mon1 | ok: [mon1] 2026-08-18 11:58:54.760240 | mon1 | ok: [mon2] 2026-08-18 11:58:54.760482 | mon1 | ok: [mon3] 2026-08-18 11:58:54.760699 | mon1 | 2026-08-18 11:58:54.760975 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:58:54.761227 | mon1 | Tuesday 18 August 2026 11:58:54 +0000 (0:00:00.462) 0:01:52.204 ******** 2026-08-18 11:58:59.087095 | mon1 | ok: [mon3] 2026-08-18 11:58:59.087306 | mon1 | ok: [mon2] 2026-08-18 11:58:59.087553 | mon1 | ok: [mon1] 2026-08-18 11:58:59.087795 | mon1 | 2026-08-18 11:58:59.088106 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 11:58:59.088374 | mon1 | Tuesday 18 August 2026 11:58:59 +0000 (0:00:04.326) 0:01:56.531 ******** 2026-08-18 11:59:00.315678 | mon1 | ok: [mon1] 2026-08-18 11:59:00.315890 | mon1 | ok: [mon3] 2026-08-18 11:59:00.316157 | mon1 | ok: [mon2] 2026-08-18 11:59:00.316374 | mon1 | 2026-08-18 11:59:00.316634 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 11:59:00.316880 | mon1 | Tuesday 18 August 2026 11:59:00 +0000 (0:00:01.229) 0:01:57.760 ******** 2026-08-18 11:59:00.603275 | mon1 | ok: [mon1] 2026-08-18 11:59:00.603503 | mon1 | ok: [mon2] 2026-08-18 11:59:00.603743 | mon1 | ok: [mon3] 2026-08-18 11:59:00.604018 | mon1 | 2026-08-18 11:59:00.604292 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 11:59:00.604543 | mon1 | Tuesday 18 August 2026 11:59:00 +0000 (0:00:00.287) 0:01:58.048 ******** 2026-08-18 11:59:01.212759 | mon1 | ok: [mon1] 2026-08-18 11:59:01.212956 | mon1 | ok: [mon3] 2026-08-18 11:59:01.213207 | mon1 | ok: [mon2] 2026-08-18 11:59:01.213429 | mon1 | 2026-08-18 11:59:01.213692 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 11:59:01.213953 | mon1 | Tuesday 18 August 2026 11:59:01 +0000 (0:00:00.609) 0:01:58.657 ******** 2026-08-18 11:59:01.961049 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 11:59:01.961102 | mon1 | ok: [mon2] => (item={'path': '/etc/docker'}) 2026-08-18 11:59:01.961994 | mon1 | ok: [mon3] => (item={'path': '/etc/docker'}) 2026-08-18 11:59:01.962054 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:59:01.962065 | mon1 | ok: [mon2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:59:01.962976 | mon1 | ok: [mon3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:59:01.963010 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:59:01.963020 | mon1 | ok: [mon2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:59:01.963094 | mon1 | ok: [mon3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:59:01.963414 | mon1 | 2026-08-18 11:59:01.963775 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 11:59:01.964149 | mon1 | Tuesday 18 August 2026 11:59:01 +0000 (0:00:00.747) 0:01:59.405 ******** 2026-08-18 11:59:02.548660 | mon1 | ok: [mon1] 2026-08-18 11:59:02.549092 | mon1 | ok: [mon2] 2026-08-18 11:59:02.549427 | mon1 | ok: [mon3] 2026-08-18 11:59:02.549710 | mon1 | 2026-08-18 11:59:02.550063 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 11:59:02.550380 | mon1 | Tuesday 18 August 2026 11:59:02 +0000 (0:00:00.587) 0:01:59.992 ******** 2026-08-18 11:59:03.157667 | mon1 | ok: [mon1] 2026-08-18 11:59:03.158131 | mon1 | ok: [mon3] 2026-08-18 11:59:03.158463 | mon1 | ok: [mon2] 2026-08-18 11:59:03.160938 | mon1 | 2026-08-18 11:59:03.160966 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:59:03.160976 | mon1 | Tuesday 18 August 2026 11:59:03 +0000 (0:00:00.589) 0:02:00.582 ******** 2026-08-18 11:59:03.160985 | mon1 | 2026-08-18 11:59:03.160993 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:59:03.161001 | mon1 | Tuesday 18 August 2026 11:59:03 +0000 (0:00:00.007) 0:02:00.589 ******** 2026-08-18 11:59:03.161010 | mon1 | 2026-08-18 11:59:03.161018 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:59:03.161026 | mon1 | Tuesday 18 August 2026 11:59:03 +0000 (0:00:00.006) 0:02:00.595 ******** 2026-08-18 11:59:03.161318 | mon1 | 2026-08-18 11:59:03.161630 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 11:59:03.161978 | mon1 | Tuesday 18 August 2026 11:59:03 +0000 (0:00:00.006) 0:02:00.602 ******** 2026-08-18 11:59:03.653713 | mon1 | ok: [mon1] 2026-08-18 11:59:03.653961 | mon1 | ok: [mon3] 2026-08-18 11:59:03.654206 | mon1 | ok: [mon2] 2026-08-18 11:59:03.654430 | mon1 | 2026-08-18 11:59:03.654686 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:59:03.655042 | mon1 | Tuesday 18 August 2026 11:59:03 +0000 (0:00:00.494) 0:02:01.097 ******** 2026-08-18 11:59:03.730333 | mon1 | ok: [mon1] => { 2026-08-18 11:59:03.730586 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:59:03.730833 | mon1 | } 2026-08-18 11:59:03.731165 | mon1 | ok: [mon2] => { 2026-08-18 11:59:03.731580 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:59:03.731962 | mon1 | } 2026-08-18 11:59:03.732247 | mon1 | ok: [mon3] => { 2026-08-18 11:59:03.732495 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:59:03.732728 | mon1 | } 2026-08-18 11:59:03.732982 | mon1 | 2026-08-18 11:59:03.733419 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:59:03.733770 | mon1 | Tuesday 18 August 2026 11:59:03 +0000 (0:00:00.077) 0:02:01.175 ******** 2026-08-18 11:59:04.128367 | mon1 | ok: [mon1] 2026-08-18 11:59:04.128560 | mon1 | ok: [mon2] 2026-08-18 11:59:04.128798 | mon1 | ok: [mon3] 2026-08-18 11:59:04.129061 | mon1 | 2026-08-18 11:59:04.129327 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:59:04.129574 | mon1 | Tuesday 18 August 2026 11:59:04 +0000 (0:00:00.398) 0:02:01.573 ******** 2026-08-18 11:59:04.218360 | mon1 | skipping: [mon1] 2026-08-18 11:59:04.218581 | mon1 | skipping: [mon2] 2026-08-18 11:59:04.218806 | mon1 | skipping: [mon3] 2026-08-18 11:59:04.219061 | mon1 | 2026-08-18 11:59:04.219307 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 11:59:04.219547 | mon1 | Tuesday 18 August 2026 11:59:04 +0000 (0:00:00.090) 0:02:01.663 ******** 2026-08-18 11:59:04.309266 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:59:04.309520 | mon1 | ok: [mon2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:59:04.309775 | mon1 | ok: [mon3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:59:04.310037 | mon1 | 2026-08-18 11:59:04.310282 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 11:59:04.310524 | mon1 | Tuesday 18 August 2026 11:59:04 +0000 (0:00:00.090) 0:02:01.754 ******** 2026-08-18 11:59:05.477269 | mon1 | ok: [mon1] 2026-08-18 11:59:05.477523 | mon1 | ok: [mon2] 2026-08-18 11:59:05.477823 | mon1 | ok: [mon3] 2026-08-18 11:59:05.478152 | mon1 | 2026-08-18 11:59:05.478442 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 11:59:05.478696 | mon1 | Tuesday 18 August 2026 11:59:05 +0000 (0:00:01.167) 0:02:02.922 ******** 2026-08-18 11:59:07.256673 | mon1 | ok: [mon2] => (item=systemd-timesyncd) 2026-08-18 11:59:07.256962 | mon1 | ok: [mon3] => (item=systemd-timesyncd) 2026-08-18 11:59:07.257271 | mon1 | ok: [mon2] => (item=ssh) 2026-08-18 11:59:07.257525 | mon1 | ok: [mon3] => (item=ssh) 2026-08-18 11:59:07.257779 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-08-18 11:59:07.258083 | mon1 | ok: [mon1] => (item=ssh) 2026-08-18 11:59:07.258308 | mon1 | 2026-08-18 11:59:07.258567 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 11:59:07.258819 | mon1 | Tuesday 18 August 2026 11:59:07 +0000 (0:00:01.779) 0:02:04.701 ******** 2026-08-18 11:59:07.534125 | mon1 | ok: [mon1] 2026-08-18 11:59:07.534338 | mon1 | ok: [mon2] 2026-08-18 11:59:07.534573 | mon1 | ok: [mon3] 2026-08-18 11:59:07.534799 | mon1 | 2026-08-18 11:59:07.535100 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 11:59:07.535335 | mon1 | Tuesday 18 August 2026 11:59:07 +0000 (0:00:00.277) 0:02:04.979 ******** 2026-08-18 11:59:07.883486 | mon1 | ok: [mon1] 2026-08-18 11:59:07.883707 | mon1 | ok: [mon2] 2026-08-18 11:59:07.883987 | mon1 | ok: [mon3] 2026-08-18 11:59:07.884243 | mon1 | 2026-08-18 11:59:07.884482 | mon1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 11:59:07.884717 | mon1 | Tuesday 18 August 2026 11:59:07 +0000 (0:00:00.349) 0:02:05.328 ******** 2026-08-18 11:59:08.485788 | mon1 | ok: [mon1] 2026-08-18 11:59:08.485915 | mon1 | ok: [mon2] 2026-08-18 11:59:08.486165 | mon1 | ok: [mon3] 2026-08-18 11:59:08.486386 | mon1 | 2026-08-18 11:59:08.486643 | mon1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 11:59:08.486902 | mon1 | Tuesday 18 August 2026 11:59:08 +0000 (0:00:00.602) 0:02:05.930 ******** 2026-08-18 11:59:08.562952 | mon1 | skipping: [mon1] 2026-08-18 11:59:08.593974 | mon1 | skipping: [mon2] 2026-08-18 11:59:08.594028 | mon1 | skipping: [mon3] 2026-08-18 11:59:08.594038 | mon1 | 2026-08-18 11:59:08.594048 | mon1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 11:59:08.594069 | mon1 | Tuesday 18 August 2026 11:59:08 +0000 (0:00:00.107) 0:02:06.037 ******** 2026-08-18 11:59:09.084969 | mon1 | ok: [mon3] 2026-08-18 11:59:09.085128 | mon1 | ok: [mon1] 2026-08-18 11:59:09.085293 | mon1 | ok: [mon2] 2026-08-18 11:59:09.085498 | mon1 | 2026-08-18 11:59:09.085699 | mon1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 11:59:09.085939 | mon1 | Tuesday 18 August 2026 11:59:09 +0000 (0:00:00.492) 0:02:06.529 ******** 2026-08-18 11:59:09.698977 | mon1 | ok: [mon1] 2026-08-18 11:59:09.699016 | mon1 | ok: [mon2] 2026-08-18 11:59:09.699023 | mon1 | ok: [mon3] 2026-08-18 11:59:09.699029 | mon1 | 2026-08-18 11:59:09.699035 | mon1 | TASK [vexxhost.ceph.rgw : Locate the cluster admin host] *********************** 2026-08-18 11:59:09.699042 | mon1 | Tuesday 18 August 2026 11:59:09 +0000 (0:00:00.613) 0:02:07.143 ******** 2026-08-18 11:59:09.760099 | mon1 | skipping: [mon1] => (item=mon1) 2026-08-18 11:59:09.760153 | mon1 | skipping: [mon1] => (item=mon2) 2026-08-18 11:59:09.760163 | mon1 | skipping: [mon1] => (item=mon3) 2026-08-18 11:59:09.760171 | mon1 | skipping: [mon1] 2026-08-18 11:59:09.760180 | mon1 | 2026-08-18 11:59:09.760189 | mon1 | TASK [vexxhost.ceph.rgw : Select the admin host] ******************************* 2026-08-18 11:59:09.760198 | mon1 | Tuesday 18 August 2026 11:59:09 +0000 (0:00:00.060) 0:02:07.203 ******** 2026-08-18 11:59:09.801849 | mon1 | skipping: [mon1] 2026-08-18 11:59:09.835541 | mon1 | skipping: [mon2] 2026-08-18 11:59:09.835573 | mon1 | skipping: [mon3] 2026-08-18 11:59:09.835584 | mon1 | 2026-08-18 11:59:09.835593 | mon1 | TASK [vexxhost.ceph.rgw : Set the admin mon config path] *********************** 2026-08-18 11:59:09.835603 | mon1 | Tuesday 18 August 2026 11:59:09 +0000 (0:00:00.075) 0:02:07.278 ******** 2026-08-18 11:59:09.867481 | mon1 | skipping: [mon1] 2026-08-18 11:59:09.903717 | mon1 | skipping: [mon2] 2026-08-18 11:59:09.903747 | mon1 | skipping: [mon3] 2026-08-18 11:59:09.903752 | mon1 | 2026-08-18 11:59:09.903756 | mon1 | TASK [Register this RGW host] ************************************************** 2026-08-18 11:59:09.903761 | mon1 | Tuesday 18 August 2026 11:59:09 +0000 (0:00:00.069) 0:02:07.348 ******** 2026-08-18 11:59:09.971162 | mon1 | skipping: [mon1] 2026-08-18 11:59:09.971236 | mon1 | skipping: [mon2] 2026-08-18 11:59:09.971341 | mon1 | skipping: [mon3] 2026-08-18 11:59:09.971437 | mon1 | 2026-08-18 11:59:09.971551 | mon1 | TASK [vexxhost.ceph.rgw : Configure RGW multisite (realm, zonegroup, zone)] **** 2026-08-18 11:59:09.971660 | mon1 | Tuesday 18 August 2026 11:59:09 +0000 (0:00:00.066) 0:02:07.415 ******** 2026-08-18 11:59:10.003071 | mon1 | skipping: [mon1] 2026-08-18 11:59:10.003139 | mon1 | 2026-08-18 11:59:10.003252 | mon1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] ************************* 2026-08-18 11:59:10.003359 | mon1 | Tuesday 18 August 2026 11:59:10 +0000 (0:00:00.033) 0:02:07.448 ******** 2026-08-18 11:59:10.041001 | mon1 | skipping: [mon1] 2026-08-18 11:59:10.041061 | mon1 | 2026-08-18 11:59:10.041078 | mon1 | TASK [vexxhost.ceph.rgw : Remove the default zone / zonegroup / pools] ********* 2026-08-18 11:59:10.041359 | mon1 | Tuesday 18 August 2026 11:59:10 +0000 (0:00:00.036) 0:02:07.484 ******** 2026-08-18 11:59:10.121605 | mon1 | skipping: [mon1] 2026-08-18 11:59:10.121640 | mon1 | 2026-08-18 11:59:10.121650 | mon1 | PLAY [Deploy Ceph monitoring stack] ******************************************** 2026-08-18 11:59:10.121659 | mon1 | 2026-08-18 11:59:10.121668 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:59:10.121676 | mon1 | Tuesday 18 August 2026 11:59:10 +0000 (0:00:00.080) 0:02:07.565 ******** 2026-08-18 11:59:11.146929 | mon1 | ok: [mon1] 2026-08-18 11:59:11.146968 | mon1 | ok: [mon3] 2026-08-18 11:59:11.146976 | mon1 | ok: [mon2] 2026-08-18 11:59:11.146984 | mon1 | 2026-08-18 11:59:11.146994 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:59:11.147003 | mon1 | Tuesday 18 August 2026 11:59:11 +0000 (0:00:01.025) 0:02:08.590 ******** 2026-08-18 11:59:11.433297 | mon1 | ok: [mon1] 2026-08-18 11:59:11.433354 | mon1 | ok: [mon2] 2026-08-18 11:59:11.433520 | mon1 | ok: [mon3] 2026-08-18 11:59:11.433615 | mon1 | 2026-08-18 11:59:11.433732 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:59:11.433847 | mon1 | Tuesday 18 August 2026 11:59:11 +0000 (0:00:00.286) 0:02:08.877 ******** 2026-08-18 11:59:11.520003 | mon1 | skipping: [mon1] 2026-08-18 11:59:11.520048 | mon1 | skipping: [mon2] 2026-08-18 11:59:11.520058 | mon1 | skipping: [mon3] 2026-08-18 11:59:11.520067 | mon1 | 2026-08-18 11:59:11.520076 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 11:59:11.520085 | mon1 | Tuesday 18 August 2026 11:59:11 +0000 (0:00:00.084) 0:02:08.962 ******** 2026-08-18 11:59:11.829130 | mon1 | ok: [mon1] 2026-08-18 11:59:11.829197 | mon1 | ok: [mon2] 2026-08-18 11:59:11.829222 | mon1 | ok: [mon3] 2026-08-18 11:59:11.829245 | mon1 | 2026-08-18 11:59:11.829259 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:59:11.829269 | mon1 | Tuesday 18 August 2026 11:59:11 +0000 (0:00:00.309) 0:02:09.271 ******** 2026-08-18 11:59:11.928622 | mon1 | ok: [mon1] => { 2026-08-18 11:59:11.929033 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:59:11.929444 | mon1 | } 2026-08-18 11:59:11.930936 | mon1 | ok: [mon2] => { 2026-08-18 11:59:11.930977 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:59:11.930999 | mon1 | } 2026-08-18 11:59:11.931228 | mon1 | ok: [mon3] => { 2026-08-18 11:59:11.931580 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:59:11.931913 | mon1 | } 2026-08-18 11:59:11.932207 | mon1 | 2026-08-18 11:59:11.932610 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:59:11.933010 | mon1 | Tuesday 18 August 2026 11:59:11 +0000 (0:00:00.101) 0:02:09.373 ******** 2026-08-18 11:59:12.361519 | mon1 | ok: [mon1] 2026-08-18 11:59:12.361928 | mon1 | ok: [mon2] 2026-08-18 11:59:12.362261 | mon1 | ok: [mon3] 2026-08-18 11:59:12.362620 | mon1 | 2026-08-18 11:59:12.362981 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:59:12.363318 | mon1 | Tuesday 18 August 2026 11:59:12 +0000 (0:00:00.433) 0:02:09.806 ******** 2026-08-18 11:59:12.399559 | mon1 | skipping: [mon1] 2026-08-18 11:59:12.470338 | mon1 | skipping: [mon2] 2026-08-18 11:59:12.470666 | mon1 | skipping: [mon3] 2026-08-18 11:59:12.470991 | mon1 | 2026-08-18 11:59:12.471312 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:59:12.471673 | mon1 | Tuesday 18 August 2026 11:59:12 +0000 (0:00:00.109) 0:02:09.915 ******** 2026-08-18 11:59:12.580797 | mon1 | skipping: [mon1] 2026-08-18 11:59:12.580863 | mon1 | skipping: [mon2] 2026-08-18 11:59:12.580872 | mon1 | skipping: [mon3] 2026-08-18 11:59:12.580917 | mon1 | 2026-08-18 11:59:12.580927 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:59:12.580935 | mon1 | Tuesday 18 August 2026 11:59:12 +0000 (0:00:00.108) 0:02:10.024 ******** 2026-08-18 11:59:12.881122 | mon1 | ok: [mon1] 2026-08-18 11:59:12.881212 | mon1 | ok: [mon3] 2026-08-18 11:59:12.881226 | mon1 | ok: [mon2] 2026-08-18 11:59:12.881245 | mon1 | 2026-08-18 11:59:12.881451 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:59:12.881687 | mon1 | Tuesday 18 August 2026 11:59:12 +0000 (0:00:00.300) 0:02:10.325 ******** 2026-08-18 11:59:14.076424 | mon1 | ok: [mon1] 2026-08-18 11:59:14.076746 | mon1 | ok: [mon3] 2026-08-18 11:59:14.077026 | mon1 | ok: [mon2] 2026-08-18 11:59:14.077244 | mon1 | 2026-08-18 11:59:14.077499 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:59:14.077746 | mon1 | Tuesday 18 August 2026 11:59:14 +0000 (0:00:01.196) 0:02:11.521 ******** 2026-08-18 11:59:14.306733 | mon1 | ok: [mon1] => { 2026-08-18 11:59:14.306993 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:59:14.307233 | mon1 | } 2026-08-18 11:59:14.307470 | mon1 | ok: [mon2] => { 2026-08-18 11:59:14.307722 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:59:14.307987 | mon1 | } 2026-08-18 11:59:14.308223 | mon1 | ok: [mon3] => { 2026-08-18 11:59:14.308481 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:59:14.308712 | mon1 | } 2026-08-18 11:59:14.308974 | mon1 | 2026-08-18 11:59:14.309215 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:59:14.309457 | mon1 | Tuesday 18 August 2026 11:59:14 +0000 (0:00:00.230) 0:02:11.751 ******** 2026-08-18 11:59:14.883442 | mon1 | ok: [mon1] 2026-08-18 11:59:14.883605 | mon1 | ok: [mon2] 2026-08-18 11:59:14.883835 | mon1 | ok: [mon3] 2026-08-18 11:59:14.884152 | mon1 | 2026-08-18 11:59:14.884338 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:59:14.884576 | mon1 | Tuesday 18 August 2026 11:59:14 +0000 (0:00:00.576) 0:02:12.327 ******** 2026-08-18 11:59:17.192348 | mon1 | ok: [mon1] 2026-08-18 11:59:17.192569 | mon1 | ok: [mon2] 2026-08-18 11:59:17.192798 | mon1 | ok: [mon3] 2026-08-18 11:59:17.193053 | mon1 | 2026-08-18 11:59:17.193319 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 11:59:17.193563 | mon1 | Tuesday 18 August 2026 11:59:17 +0000 (0:00:02.309) 0:02:14.637 ******** 2026-08-18 11:59:17.221577 | mon1 | skipping: [mon1] 2026-08-18 11:59:17.251926 | mon1 | skipping: [mon2] 2026-08-18 11:59:17.252192 | mon1 | skipping: [mon3] 2026-08-18 11:59:17.252407 | mon1 | 2026-08-18 11:59:17.252649 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 11:59:17.252933 | mon1 | Tuesday 18 August 2026 11:59:17 +0000 (0:00:00.059) 0:02:14.696 ******** 2026-08-18 11:59:17.330898 | mon1 | skipping: [mon1] 2026-08-18 11:59:17.331215 | mon1 | skipping: [mon2] 2026-08-18 11:59:17.331446 | mon1 | skipping: [mon3] 2026-08-18 11:59:17.331660 | mon1 | 2026-08-18 11:59:17.331929 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 11:59:17.332176 | mon1 | Tuesday 18 August 2026 11:59:17 +0000 (0:00:00.078) 0:02:14.775 ******** 2026-08-18 11:59:17.395066 | mon1 | skipping: [mon1] 2026-08-18 11:59:17.395269 | mon1 | skipping: [mon2] 2026-08-18 11:59:17.395495 | mon1 | skipping: [mon3] 2026-08-18 11:59:17.395707 | mon1 | 2026-08-18 11:59:17.395986 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 11:59:17.396231 | mon1 | Tuesday 18 August 2026 11:59:17 +0000 (0:00:00.064) 0:02:14.840 ******** 2026-08-18 11:59:18.630950 | mon1 | ok: [mon1] 2026-08-18 11:59:18.630989 | mon1 | ok: [mon3] 2026-08-18 11:59:18.630994 | mon1 | ok: [mon2] 2026-08-18 11:59:18.631003 | mon1 | 2026-08-18 11:59:18.631297 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 11:59:18.631586 | mon1 | Tuesday 18 August 2026 11:59:18 +0000 (0:00:01.234) 0:02:16.074 ******** 2026-08-18 11:59:19.219457 | mon1 | ok: [mon1] 2026-08-18 11:59:19.219676 | mon1 | ok: [mon2] 2026-08-18 11:59:19.219945 | mon1 | ok: [mon3] 2026-08-18 11:59:19.220167 | mon1 | 2026-08-18 11:59:19.220419 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 11:59:19.220664 | mon1 | Tuesday 18 August 2026 11:59:19 +0000 (0:00:00.589) 0:02:16.664 ******** 2026-08-18 11:59:20.492964 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:59:20.493025 | mon1 | ok: [mon2] => (item={'path': '/etc/containerd'}) 2026-08-18 11:59:20.493036 | mon1 | ok: [mon3] => (item={'path': '/etc/containerd'}) 2026-08-18 11:59:20.493155 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:59:20.493409 | mon1 | ok: [mon2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:59:20.493696 | mon1 | ok: [mon3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:59:20.493973 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:59:20.494225 | mon1 | ok: [mon2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:59:20.494476 | mon1 | ok: [mon3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:59:20.494738 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:59:20.495029 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:59:20.495294 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:59:20.495549 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:59:20.495832 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:59:20.496108 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:59:20.496333 | mon1 | 2026-08-18 11:59:20.496584 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 11:59:20.496852 | mon1 | Tuesday 18 August 2026 11:59:20 +0000 (0:00:01.272) 0:02:17.937 ******** 2026-08-18 11:59:21.211550 | mon1 | ok: [mon1] 2026-08-18 11:59:21.211772 | mon1 | ok: [mon3] 2026-08-18 11:59:21.212097 | mon1 | ok: [mon2] 2026-08-18 11:59:21.212337 | mon1 | 2026-08-18 11:59:21.212598 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:59:21.212853 | mon1 | Tuesday 18 August 2026 11:59:21 +0000 (0:00:00.700) 0:02:18.637 ******** 2026-08-18 11:59:21.213143 | mon1 | 2026-08-18 11:59:21.213418 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:59:21.213690 | mon1 | Tuesday 18 August 2026 11:59:21 +0000 (0:00:00.006) 0:02:18.644 ******** 2026-08-18 11:59:21.213915 | mon1 | 2026-08-18 11:59:21.214171 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:59:21.214411 | mon1 | Tuesday 18 August 2026 11:59:21 +0000 (0:00:00.006) 0:02:18.650 ******** 2026-08-18 11:59:21.214624 | mon1 | 2026-08-18 11:59:21.214913 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 11:59:21.215161 | mon1 | Tuesday 18 August 2026 11:59:21 +0000 (0:00:00.006) 0:02:18.656 ******** 2026-08-18 11:59:21.701794 | mon1 | ok: [mon1] 2026-08-18 11:59:21.701827 | mon1 | ok: [mon3] 2026-08-18 11:59:21.701831 | mon1 | ok: [mon2] 2026-08-18 11:59:21.701835 | mon1 | 2026-08-18 11:59:21.701839 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:59:21.701859 | mon1 | Tuesday 18 August 2026 11:59:21 +0000 (0:00:00.489) 0:02:19.146 ******** 2026-08-18 11:59:22.012802 | mon1 | ok: [mon1] 2026-08-18 11:59:22.012856 | mon1 | ok: [mon2] 2026-08-18 11:59:22.012866 | mon1 | ok: [mon3] 2026-08-18 11:59:22.012908 | mon1 | 2026-08-18 11:59:22.012918 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:59:22.012927 | mon1 | Tuesday 18 August 2026 11:59:22 +0000 (0:00:00.310) 0:02:19.456 ******** 2026-08-18 11:59:22.118937 | mon1 | ok: [mon1] => { 2026-08-18 11:59:22.118988 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:59:22.118998 | mon1 | } 2026-08-18 11:59:22.119006 | mon1 | ok: [mon2] => { 2026-08-18 11:59:22.119014 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:59:22.119023 | mon1 | } 2026-08-18 11:59:22.119031 | mon1 | ok: [mon3] => { 2026-08-18 11:59:22.119039 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:59:22.119048 | mon1 | } 2026-08-18 11:59:22.119056 | mon1 | 2026-08-18 11:59:22.119177 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:59:22.119482 | mon1 | Tuesday 18 August 2026 11:59:22 +0000 (0:00:00.104) 0:02:19.560 ******** 2026-08-18 11:59:22.588305 | mon1 | ok: [mon1] 2026-08-18 11:59:22.588365 | mon1 | ok: [mon3] 2026-08-18 11:59:22.588469 | mon1 | ok: [mon2] 2026-08-18 11:59:22.588572 | mon1 | 2026-08-18 11:59:22.588700 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:59:22.588817 | mon1 | Tuesday 18 August 2026 11:59:22 +0000 (0:00:00.472) 0:02:20.033 ******** 2026-08-18 11:59:25.995765 | mon1 | ok: [mon1] 2026-08-18 11:59:25.995823 | mon1 | ok: [mon3] 2026-08-18 11:59:25.995916 | mon1 | ok: [mon2] 2026-08-18 11:59:25.995932 | mon1 | 2026-08-18 11:59:25.995942 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 11:59:25.995951 | mon1 | Tuesday 18 August 2026 11:59:25 +0000 (0:00:03.405) 0:02:23.438 ******** 2026-08-18 11:59:27.181975 | mon1 | ok: [mon1] 2026-08-18 11:59:27.182036 | mon1 | ok: [mon3] 2026-08-18 11:59:27.182845 | mon1 | ok: [mon2] 2026-08-18 11:59:27.182927 | mon1 | 2026-08-18 11:59:27.182938 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 11:59:27.182947 | mon1 | Tuesday 18 August 2026 11:59:27 +0000 (0:00:01.186) 0:02:24.625 ******** 2026-08-18 11:59:27.462576 | mon1 | ok: [mon1] 2026-08-18 11:59:27.462637 | mon1 | ok: [mon2] 2026-08-18 11:59:27.462936 | mon1 | ok: [mon3] 2026-08-18 11:59:27.463709 | mon1 | 2026-08-18 11:59:27.463752 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 11:59:27.463763 | mon1 | Tuesday 18 August 2026 11:59:27 +0000 (0:00:00.281) 0:02:24.907 ******** 2026-08-18 11:59:28.067827 | mon1 | ok: [mon1] 2026-08-18 11:59:28.067905 | mon1 | ok: [mon2] 2026-08-18 11:59:28.067919 | mon1 | ok: [mon3] 2026-08-18 11:59:28.067928 | mon1 | 2026-08-18 11:59:28.067937 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 11:59:28.067946 | mon1 | Tuesday 18 August 2026 11:59:28 +0000 (0:00:00.604) 0:02:25.511 ******** 2026-08-18 11:59:28.808467 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 11:59:28.808504 | mon1 | ok: [mon2] => (item={'path': '/etc/docker'}) 2026-08-18 11:59:28.808508 | mon1 | ok: [mon3] => (item={'path': '/etc/docker'}) 2026-08-18 11:59:28.808512 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:59:28.808516 | mon1 | ok: [mon2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:59:28.808520 | mon1 | ok: [mon3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:59:28.808524 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:59:28.808528 | mon1 | ok: [mon2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:59:28.808531 | mon1 | ok: [mon3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:59:28.808535 | mon1 | 2026-08-18 11:59:28.808539 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 11:59:28.808556 | mon1 | Tuesday 18 August 2026 11:59:28 +0000 (0:00:00.741) 0:02:26.252 ******** 2026-08-18 11:59:29.371006 | mon1 | ok: [mon1] 2026-08-18 11:59:29.371064 | mon1 | ok: [mon3] 2026-08-18 11:59:29.371078 | mon1 | ok: [mon2] 2026-08-18 11:59:29.371091 | mon1 | 2026-08-18 11:59:29.371103 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 11:59:29.371114 | mon1 | Tuesday 18 August 2026 11:59:29 +0000 (0:00:00.561) 0:02:26.813 ******** 2026-08-18 11:59:29.999030 | mon1 | ok: [mon1] 2026-08-18 11:59:29.999089 | mon1 | ok: [mon2] 2026-08-18 11:59:29.999099 | mon1 | ok: [mon3] 2026-08-18 11:59:29.999109 | mon1 | 2026-08-18 11:59:29.999119 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:59:29.999129 | mon1 | Tuesday 18 August 2026 11:59:29 +0000 (0:00:00.607) 0:02:27.421 ******** 2026-08-18 11:59:29.999183 | mon1 | 2026-08-18 11:59:29.999463 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:59:29.999708 | mon1 | Tuesday 18 August 2026 11:59:29 +0000 (0:00:00.006) 0:02:27.428 ******** 2026-08-18 11:59:29.999968 | mon1 | 2026-08-18 11:59:30.000208 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:59:30.000456 | mon1 | Tuesday 18 August 2026 11:59:29 +0000 (0:00:00.006) 0:02:27.434 ******** 2026-08-18 11:59:30.000675 | mon1 | 2026-08-18 11:59:30.000960 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 11:59:30.001199 | mon1 | Tuesday 18 August 2026 11:59:29 +0000 (0:00:00.007) 0:02:27.442 ******** 2026-08-18 11:59:30.497280 | mon1 | ok: [mon1] 2026-08-18 11:59:30.497336 | mon1 | ok: [mon2] 2026-08-18 11:59:30.497463 | mon1 | ok: [mon3] 2026-08-18 11:59:30.497565 | mon1 | 2026-08-18 11:59:30.497688 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:59:30.497790 | mon1 | Tuesday 18 August 2026 11:59:30 +0000 (0:00:00.500) 0:02:27.942 ******** 2026-08-18 11:59:30.569557 | mon1 | ok: [mon1] => { 2026-08-18 11:59:30.569770 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:59:30.570101 | mon1 | } 2026-08-18 11:59:30.570279 | mon1 | ok: [mon2] => { 2026-08-18 11:59:30.570516 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:59:30.570763 | mon1 | } 2026-08-18 11:59:30.571036 | mon1 | ok: [mon3] => { 2026-08-18 11:59:30.571305 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:59:30.571551 | mon1 | } 2026-08-18 11:59:30.571767 | mon1 | 2026-08-18 11:59:30.572104 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:59:30.572300 | mon1 | Tuesday 18 August 2026 11:59:30 +0000 (0:00:00.071) 0:02:28.013 ******** 2026-08-18 11:59:30.958303 | mon1 | ok: [mon1] 2026-08-18 11:59:30.958361 | mon1 | ok: [mon2] 2026-08-18 11:59:30.958449 | mon1 | ok: [mon3] 2026-08-18 11:59:30.958546 | mon1 | 2026-08-18 11:59:30.958660 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:59:30.958775 | mon1 | Tuesday 18 August 2026 11:59:30 +0000 (0:00:00.388) 0:02:28.402 ******** 2026-08-18 11:59:31.042797 | mon1 | skipping: [mon1] 2026-08-18 11:59:31.042853 | mon1 | skipping: [mon2] 2026-08-18 11:59:31.042970 | mon1 | skipping: [mon3] 2026-08-18 11:59:31.043100 | mon1 | 2026-08-18 11:59:31.043216 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 11:59:31.043327 | mon1 | Tuesday 18 August 2026 11:59:31 +0000 (0:00:00.085) 0:02:28.488 ******** 2026-08-18 11:59:31.128327 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:59:31.128551 | mon1 | ok: [mon2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:59:31.128847 | mon1 | ok: [mon3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 11:59:31.129135 | mon1 | 2026-08-18 11:59:31.129373 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 11:59:31.129638 | mon1 | Tuesday 18 August 2026 11:59:31 +0000 (0:00:00.085) 0:02:28.573 ******** 2026-08-18 11:59:32.302494 | mon1 | ok: [mon1] 2026-08-18 11:59:32.302705 | mon1 | ok: [mon2] 2026-08-18 11:59:32.302998 | mon1 | ok: [mon3] 2026-08-18 11:59:32.303260 | mon1 | 2026-08-18 11:59:32.303546 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 11:59:32.303818 | mon1 | Tuesday 18 August 2026 11:59:32 +0000 (0:00:01.174) 0:02:29.747 ******** 2026-08-18 11:59:33.144953 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-08-18 11:59:33.145063 | mon1 | ok: [mon2] => (item=systemd-timesyncd) 2026-08-18 11:59:33.145486 | mon1 | ok: [mon3] => (item=systemd-timesyncd) 2026-08-18 11:59:33.145936 | mon1 | ok: [mon1] => (item=ssh) 2026-08-18 11:59:33.146239 | mon1 | ok: [mon2] => (item=ssh) 2026-08-18 11:59:33.146498 | mon1 | ok: [mon3] => (item=ssh) 2026-08-18 11:59:33.146744 | mon1 | 2026-08-18 11:59:33.147084 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 11:59:33.147376 | mon1 | Tuesday 18 August 2026 11:59:33 +0000 (0:00:00.842) 0:02:30.589 ******** 2026-08-18 11:59:33.419020 | mon1 | ok: [mon1] 2026-08-18 11:59:33.419068 | mon1 | ok: [mon2] 2026-08-18 11:59:33.419077 | mon1 | ok: [mon3] 2026-08-18 11:59:33.419092 | mon1 | 2026-08-18 11:59:33.419736 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 11:59:33.419776 | mon1 | Tuesday 18 August 2026 11:59:33 +0000 (0:00:00.273) 0:02:30.863 ******** 2026-08-18 11:59:33.764817 | mon1 | ok: [mon1] 2026-08-18 11:59:33.764862 | mon1 | ok: [mon2] 2026-08-18 11:59:33.766040 | mon1 | ok: [mon3] 2026-08-18 11:59:33.766087 | mon1 | 2026-08-18 11:59:33.766098 | mon1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 11:59:33.766108 | mon1 | Tuesday 18 August 2026 11:59:33 +0000 (0:00:00.345) 0:02:31.208 ******** 2026-08-18 11:59:34.329904 | mon1 | ok: [mon1] 2026-08-18 11:59:34.329974 | mon1 | ok: [mon2] 2026-08-18 11:59:34.329985 | mon1 | ok: [mon3] 2026-08-18 11:59:34.329995 | mon1 | 2026-08-18 11:59:34.330005 | mon1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 11:59:34.330015 | mon1 | Tuesday 18 August 2026 11:59:34 +0000 (0:00:00.564) 0:02:31.772 ******** 2026-08-18 11:59:34.398842 | mon1 | skipping: [mon1] 2026-08-18 11:59:34.398909 | mon1 | skipping: [mon2] 2026-08-18 11:59:34.398920 | mon1 | skipping: [mon3] 2026-08-18 11:59:34.398929 | mon1 | 2026-08-18 11:59:34.398939 | mon1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 11:59:34.398949 | mon1 | Tuesday 18 August 2026 11:59:34 +0000 (0:00:00.069) 0:02:31.842 ******** 2026-08-18 11:59:34.916177 | mon1 | ok: [mon1] 2026-08-18 11:59:34.918068 | mon1 | ok: [mon3] 2026-08-18 11:59:34.918099 | mon1 | ok: [mon2] 2026-08-18 11:59:34.918110 | mon1 | 2026-08-18 11:59:34.918120 | mon1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 11:59:34.918130 | mon1 | Tuesday 18 August 2026 11:59:34 +0000 (0:00:00.518) 0:02:32.360 ******** 2026-08-18 11:59:36.524905 | mon1 | ok: [mon1] 2026-08-18 11:59:36.524938 | mon1 | ok: [mon3] 2026-08-18 11:59:36.525020 | mon1 | ok: [mon2] 2026-08-18 11:59:36.525236 | mon1 | 2026-08-18 11:59:36.525484 | mon1 | TASK [vexxhost.ceph.monitoring : Locate the cluster admin host] **************** 2026-08-18 11:59:36.525727 | mon1 | Tuesday 18 August 2026 11:59:36 +0000 (0:00:01.608) 0:02:33.968 ******** 2026-08-18 11:59:37.287155 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:59:37.287348 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:59:37.287582 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:59:37.287847 | mon1 | 2026-08-18 11:59:37.288181 | mon1 | TASK [vexxhost.ceph.monitoring : Select the admin host] ************************ 2026-08-18 11:59:37.288429 | mon1 | Tuesday 18 August 2026 11:59:37 +0000 (0:00:00.763) 0:02:34.731 ******** 2026-08-18 11:59:37.375685 | mon1 | ok: [mon1] 2026-08-18 11:59:37.375962 | mon1 | ok: [mon2] 2026-08-18 11:59:37.376198 | mon1 | ok: [mon3] 2026-08-18 11:59:37.376419 | mon1 | 2026-08-18 11:59:37.376668 | mon1 | TASK [vexxhost.ceph.monitoring : Set the admin mon config path] **************** 2026-08-18 11:59:37.376956 | mon1 | Tuesday 18 August 2026 11:59:37 +0000 (0:00:00.088) 0:02:34.820 ******** 2026-08-18 11:59:37.457622 | mon1 | ok: [mon1] 2026-08-18 11:59:37.457867 | mon1 | ok: [mon2] 2026-08-18 11:59:37.458142 | mon1 | ok: [mon3] 2026-08-18 11:59:37.458364 | mon1 | 2026-08-18 11:59:37.458613 | mon1 | TASK [vexxhost.ceph.monitoring : Pin monitoring container images] ************** 2026-08-18 11:59:37.458860 | mon1 | Tuesday 18 August 2026 11:59:37 +0000 (0:00:00.081) 0:02:34.902 ******** 2026-08-18 11:59:37.495385 | mon1 | skipping: [mon1] 2026-08-18 11:59:37.495617 | mon1 | 2026-08-18 11:59:37.495943 | mon1 | TASK [vexxhost.ceph.monitoring : Apply the monitoring service specs] *********** 2026-08-18 11:59:37.496191 | mon1 | Tuesday 18 August 2026 11:59:37 +0000 (0:00:00.037) 0:02:34.940 ******** 2026-08-18 11:59:39.244642 | mon1 | ok: [mon1] => (item=ceph-exporter) 2026-08-18 11:59:39.244803 | mon1 | 2026-08-18 11:59:39.245082 | mon1 | PLAY RECAP ********************************************************************* 2026-08-18 11:59:39.245347 | mon1 | mon1 : ok=199 changed=0 unreachable=0 failed=0 skipped=59 rescued=0 ignored=0 2026-08-18 11:59:39.245624 | mon1 | mon2 : ok=185 changed=0 unreachable=0 failed=0 skipped=46 rescued=0 ignored=0 2026-08-18 11:59:39.245903 | mon1 | mon3 : ok=185 changed=0 unreachable=0 failed=0 skipped=46 rescued=0 ignored=0 2026-08-18 11:59:39.246242 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=10 rescued=0 ignored=0 2026-08-18 11:59:39.246444 | mon1 | 2026-08-18 11:59:39.246658 | mon1 | 2026-08-18 11:59:39.246938 | mon1 | TASKS RECAP ******************************************************************** 2026-08-18 11:59:39.247168 | mon1 | Tuesday 18 August 2026 11:59:39 +0000 (0:00:01.749) 0:02:36.689 ******** 2026-08-18 11:59:39.247392 | mon1 | =============================================================================== 2026-08-18 11:59:39.247629 | mon1 | vexxhost.ceph.mgr : Configure ceph-mgr modules -------------------------- 8.74s 2026-08-18 11:59:39.247897 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.33s 2026-08-18 11:59:39.248146 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.45s 2026-08-18 11:59:39.248390 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.42s 2026-08-18 11:59:39.248642 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.41s 2026-08-18 11:59:39.248907 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.46s 2026-08-18 11:59:39.249151 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.39s 2026-08-18 11:59:39.249393 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.36s 2026-08-18 11:59:39.249633 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.31s 2026-08-18 11:59:39.249898 | mon1 | vexxhost.ceph.configure : Get the current dashboard certificate --------- 2.30s 2026-08-18 11:59:39.250160 | mon1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 2.13s 2026-08-18 11:59:39.250397 | mon1 | vexxhost.containers.package : Update state for tar ---------------------- 2.10s 2026-08-18 11:59:39.250638 | mon1 | vexxhost.ceph.mon : Wait for this monitor's daemon to be present -------- 1.92s 2026-08-18 11:59:39.250929 | mon1 | vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host --- 1.91s 2026-08-18 11:59:39.251187 | mon1 | vexxhost.ceph.cephadm_host : Register the host (labels) ----------------- 1.88s 2026-08-18 11:59:39.251409 | mon1 | vexxhost.ceph.mon : Apply the monitor service spec ---------------------- 1.81s 2026-08-18 11:59:39.251648 | mon1 | vexxhost.ceph.cephadm_host : Get the cephadm public key ----------------- 1.80s 2026-08-18 11:59:39.251917 | mon1 | vexxhost.ceph.cephadm_host : Register the host (labels) ----------------- 1.79s 2026-08-18 11:59:39.252172 | mon1 | vexxhost.ceph.mgr : Wait for this manager's daemon to be present -------- 1.78s 2026-08-18 11:59:39.252399 | mon1 | vexxhost.ceph.cephadm : Ensure services are started --------------------- 1.78s 2026-08-18 11:59:39.356474 | mon1 | INFO [default > idempotence] Executed: Successful 2026-08-18 11:59:39.367218 | mon1 | INFO [default > side_effect] Executing 2026-08-18 11:59:39.367505 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 11:59:39.373217 | mon1 | INFO [default > verify] Executing 2026-08-18 11:59:40.100206 | mon1 | 2026-08-18 11:59:40.100330 | mon1 | PLAY [Verify] ****************************************************************** 2026-08-18 11:59:40.100469 | mon1 | 2026-08-18 11:59:40.100613 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:59:40.100773 | mon1 | Tuesday 18 August 2026 11:59:40 +0000 (0:00:00.008) 0:00:00.008 ******** 2026-08-18 11:59:41.334495 | mon1 | [WARNING]: Platform linux on host mon2 is using the discovered Python 2026-08-18 11:59:41.334730 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 11:59:41.335053 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:59:41.335295 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:59:41.335538 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:59:41.380588 | mon1 | [WARNING]: Platform linux on host mon3 is using the discovered Python 2026-08-18 11:59:41.380816 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 11:59:41.381102 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:59:41.381345 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:59:41.381604 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:59:42.305278 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-18 11:59:42.305359 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 11:59:42.305454 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:59:42.305560 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:59:42.305669 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:59:42.317214 | mon1 | ok: [mon2] 2026-08-18 11:59:42.317317 | mon1 | ok: [mon3] 2026-08-18 11:59:42.317414 | mon1 | ok: [mon1] 2026-08-18 11:59:42.317520 | mon1 | 2026-08-18 11:59:42.317630 | mon1 | TASK [List locally deployed Ceph daemons] ************************************** 2026-08-18 11:59:42.317732 | mon1 | Tuesday 18 August 2026 11:59:42 +0000 (0:00:02.217) 0:00:02.225 ******** 2026-08-18 11:59:48.527175 | mon1 | ok: [mon1] 2026-08-18 11:59:48.527387 | mon1 | ok: [mon2] 2026-08-18 11:59:48.527620 | mon1 | ok: [mon3] 2026-08-18 11:59:48.527835 | mon1 | 2026-08-18 11:59:48.528115 | mon1 | TASK [Collect deployed Ceph container images] ********************************** 2026-08-18 11:59:48.528359 | mon1 | Tuesday 18 August 2026 11:59:48 +0000 (0:00:06.209) 0:00:08.434 ******** 2026-08-18 11:59:48.590222 | mon1 | ok: [mon1] 2026-08-18 11:59:48.590459 | mon1 | ok: [mon2] 2026-08-18 11:59:48.590713 | mon1 | ok: [mon3] 2026-08-18 11:59:48.590934 | mon1 | 2026-08-18 11:59:48.591203 | mon1 | TASK [Assert that a deployed Ceph container image was found] ******************* 2026-08-18 11:59:48.591465 | mon1 | Tuesday 18 August 2026 11:59:48 +0000 (0:00:00.063) 0:00:08.497 ******** 2026-08-18 11:59:48.649941 | mon1 | ok: [mon1] => { 2026-08-18 11:59:48.650211 | mon1 | "changed": false, 2026-08-18 11:59:48.650443 | mon1 | "msg": "All assertions passed" 2026-08-18 11:59:48.650673 | mon1 | } 2026-08-18 11:59:48.650972 | mon1 | ok: [mon2] => { 2026-08-18 11:59:48.651243 | mon1 | "changed": false, 2026-08-18 11:59:48.651497 | mon1 | "msg": "All assertions passed" 2026-08-18 11:59:48.651723 | mon1 | } 2026-08-18 11:59:48.651982 | mon1 | ok: [mon3] => { 2026-08-18 11:59:48.652234 | mon1 | "changed": false, 2026-08-18 11:59:48.652566 | mon1 | "msg": "All assertions passed" 2026-08-18 11:59:48.652748 | mon1 | } 2026-08-18 11:59:48.653026 | mon1 | 2026-08-18 11:59:48.653280 | mon1 | TASK [Get cluster health status] *********************************************** 2026-08-18 11:59:48.653525 | mon1 | Tuesday 18 August 2026 11:59:48 +0000 (0:00:00.059) 0:00:08.557 ******** 2026-08-18 11:59:50.523004 | mon1 | ok: [mon1] 2026-08-18 11:59:50.523208 | mon1 | ok: [mon3] 2026-08-18 11:59:50.523456 | mon1 | ok: [mon2] 2026-08-18 11:59:50.523684 | mon1 | 2026-08-18 11:59:50.523968 | mon1 | TASK [Print cluster health status] ********************************************* 2026-08-18 11:59:50.524224 | mon1 | Tuesday 18 August 2026 11:59:50 +0000 (0:00:01.872) 0:00:10.430 ******** 2026-08-18 11:59:50.587329 | mon1 | ok: [mon1] => { 2026-08-18 11:59:50.587527 | mon1 | "_ceph_health": { 2026-08-18 11:59:50.587792 | mon1 | "changed": false, 2026-08-18 11:59:50.588055 | mon1 | "cmd": [ 2026-08-18 11:59:50.588298 | mon1 | "cephadm", 2026-08-18 11:59:50.588572 | mon1 | "shell", 2026-08-18 11:59:50.588814 | mon1 | "--", 2026-08-18 11:59:50.589090 | mon1 | "ceph", 2026-08-18 11:59:50.589334 | mon1 | "health" 2026-08-18 11:59:50.589573 | mon1 | ], 2026-08-18 11:59:50.589823 | mon1 | "delta": "0:00:01.482547", 2026-08-18 11:59:50.590114 | mon1 | "end": "2026-08-18 11:59:50.320861", 2026-08-18 11:59:50.590362 | mon1 | "failed": false, 2026-08-18 11:59:50.590606 | mon1 | "msg": "", 2026-08-18 11:59:50.590846 | mon1 | "rc": 0, 2026-08-18 11:59:50.591127 | mon1 | "start": "2026-08-18 11:59:48.838314", 2026-08-18 11:59:50.591401 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-08-18 11:59:50.591655 | mon1 | "stderr_lines": [ 2026-08-18 11:59:50.591937 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-08-18 11:59:50.592210 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-08-18 11:59:50.592436 | mon1 | ], 2026-08-18 11:59:50.592699 | mon1 | "stdout": "HEALTH_OK", 2026-08-18 11:59:50.592950 | mon1 | "stdout_lines": [ 2026-08-18 11:59:50.593183 | mon1 | "HEALTH_OK" 2026-08-18 11:59:50.593420 | mon1 | ] 2026-08-18 11:59:50.593659 | mon1 | } 2026-08-18 11:59:50.593936 | mon1 | } 2026-08-18 11:59:50.594180 | mon1 | ok: [mon2] => { 2026-08-18 11:59:50.594429 | mon1 | "_ceph_health": { 2026-08-18 11:59:50.594675 | mon1 | "changed": false, 2026-08-18 11:59:50.594944 | mon1 | "cmd": [ 2026-08-18 11:59:50.595191 | mon1 | "cephadm", 2026-08-18 11:59:50.595423 | mon1 | "shell", 2026-08-18 11:59:50.595644 | mon1 | "--", 2026-08-18 11:59:50.595867 | mon1 | "ceph", 2026-08-18 11:59:50.596122 | mon1 | "health" 2026-08-18 11:59:50.596342 | mon1 | ], 2026-08-18 11:59:50.596619 | mon1 | "delta": "0:00:01.609970", 2026-08-18 11:59:50.596855 | mon1 | "end": "2026-08-18 11:59:50.485960", 2026-08-18 11:59:50.597114 | mon1 | "failed": false, 2026-08-18 11:59:50.597290 | mon1 | "msg": "", 2026-08-18 11:59:50.597392 | mon1 | "rc": 0, 2026-08-18 11:59:50.597499 | mon1 | "start": "2026-08-18 11:59:48.875990", 2026-08-18 11:59:50.597610 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon2/config", 2026-08-18 11:59:50.597713 | mon1 | "stderr_lines": [ 2026-08-18 11:59:50.597821 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-08-18 11:59:50.597952 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon2/config" 2026-08-18 11:59:50.598052 | mon1 | ], 2026-08-18 11:59:50.598158 | mon1 | "stdout": "HEALTH_OK", 2026-08-18 11:59:50.598261 | mon1 | "stdout_lines": [ 2026-08-18 11:59:50.598363 | mon1 | "HEALTH_OK" 2026-08-18 11:59:50.598463 | mon1 | ] 2026-08-18 11:59:50.598563 | mon1 | } 2026-08-18 11:59:50.598663 | mon1 | } 2026-08-18 11:59:50.598766 | mon1 | ok: [mon3] => { 2026-08-18 11:59:50.598888 | mon1 | "_ceph_health": { 2026-08-18 11:59:50.598988 | mon1 | "changed": false, 2026-08-18 11:59:50.599109 | mon1 | "cmd": [ 2026-08-18 11:59:50.599191 | mon1 | "cephadm", 2026-08-18 11:59:50.599292 | mon1 | "shell", 2026-08-18 11:59:50.599392 | mon1 | "--", 2026-08-18 11:59:50.599492 | mon1 | "ceph", 2026-08-18 11:59:50.599593 | mon1 | "health" 2026-08-18 11:59:50.599692 | mon1 | ], 2026-08-18 11:59:50.599798 | mon1 | "delta": "0:00:01.525979", 2026-08-18 11:59:50.599919 | mon1 | "end": "2026-08-18 11:59:50.426099", 2026-08-18 11:59:50.600023 | mon1 | "failed": false, 2026-08-18 11:59:50.600123 | mon1 | "msg": "", 2026-08-18 11:59:50.600422 | mon1 | "rc": 0, 2026-08-18 11:59:50.600564 | mon1 | "start": "2026-08-18 11:59:48.900120", 2026-08-18 11:59:50.600675 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon3/config", 2026-08-18 11:59:50.600782 | mon1 | "stderr_lines": [ 2026-08-18 11:59:50.600913 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-08-18 11:59:50.601044 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon3/config" 2026-08-18 11:59:50.601132 | mon1 | ], 2026-08-18 11:59:50.601239 | mon1 | "stdout": "HEALTH_OK", 2026-08-18 11:59:50.601345 | mon1 | "stdout_lines": [ 2026-08-18 11:59:50.601448 | mon1 | "HEALTH_OK" 2026-08-18 11:59:50.601550 | mon1 | ] 2026-08-18 11:59:50.601651 | mon1 | } 2026-08-18 11:59:50.601752 | mon1 | } 2026-08-18 11:59:50.601850 | mon1 | 2026-08-18 11:59:50.601987 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-08-18 11:59:50.602085 | mon1 | Tuesday 18 August 2026 11:59:50 +0000 (0:00:00.064) 0:00:10.495 ******** 2026-08-18 11:59:50.646941 | mon1 | ok: [mon1] => { 2026-08-18 11:59:50.647232 | mon1 | "changed": false, 2026-08-18 11:59:50.647440 | mon1 | "msg": "All assertions passed" 2026-08-18 11:59:50.647667 | mon1 | } 2026-08-18 11:59:50.647925 | mon1 | ok: [mon2] => { 2026-08-18 11:59:50.648172 | mon1 | "changed": false, 2026-08-18 11:59:50.648457 | mon1 | "msg": "All assertions passed" 2026-08-18 11:59:50.648675 | mon1 | } 2026-08-18 11:59:50.648943 | mon1 | ok: [mon3] => { 2026-08-18 11:59:50.649143 | mon1 | "changed": false, 2026-08-18 11:59:50.649381 | mon1 | "msg": "All assertions passed" 2026-08-18 11:59:50.649603 | mon1 | } 2026-08-18 11:59:50.649818 | mon1 | 2026-08-18 11:59:50.650088 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-08-18 11:59:50.650346 | mon1 | Tuesday 18 August 2026 11:59:50 +0000 (0:00:00.059) 0:00:10.555 ******** 2026-08-18 11:59:59.366677 | mon1 | changed: [mon2] 2026-08-18 11:59:59.366833 | mon1 | changed: [mon3] 2026-08-18 11:59:59.367101 | mon1 | changed: [mon1] 2026-08-18 11:59:59.367316 | mon1 | 2026-08-18 11:59:59.367562 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-08-18 11:59:59.367808 | mon1 | Tuesday 18 August 2026 11:59:59 +0000 (0:00:08.719) 0:00:19.274 ******** 2026-08-18 12:00:03.072110 | mon1 | changed: [mon1] 2026-08-18 12:00:03.072369 | mon1 | changed: [mon3] 2026-08-18 12:00:03.072637 | mon1 | changed: [mon2] 2026-08-18 12:00:03.072859 | mon1 | 2026-08-18 12:00:03.073148 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-08-18 12:00:03.073384 | mon1 | Tuesday 18 August 2026 12:00:03 +0000 (0:00:03.705) 0:00:22.979 ******** 2026-08-18 12:00:05.076042 | mon1 | ok: [mon1] 2026-08-18 12:00:05.076107 | mon1 | ok: [mon3] 2026-08-18 12:00:05.076120 | mon1 | ok: [mon2] 2026-08-18 12:00:05.076169 | mon1 | 2026-08-18 12:00:05.076583 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-08-18 12:00:05.076686 | mon1 | Tuesday 18 August 2026 12:00:05 +0000 (0:00:02.003) 0:00:24.983 ******** 2026-08-18 12:00:05.143836 | mon1 | ok: [mon1] => { 2026-08-18 12:00:05.143891 | mon1 | "changed": false, 2026-08-18 12:00:05.143899 | mon1 | "msg": "All assertions passed" 2026-08-18 12:00:05.143904 | mon1 | } 2026-08-18 12:00:05.143909 | mon1 | ok: [mon2] => { 2026-08-18 12:00:05.143914 | mon1 | "changed": false, 2026-08-18 12:00:05.143919 | mon1 | "msg": "All assertions passed" 2026-08-18 12:00:05.143924 | mon1 | } 2026-08-18 12:00:05.143929 | mon1 | ok: [mon3] => { 2026-08-18 12:00:05.143934 | mon1 | "changed": false, 2026-08-18 12:00:05.143939 | mon1 | "msg": "All assertions passed" 2026-08-18 12:00:05.143944 | mon1 | } 2026-08-18 12:00:05.143949 | mon1 | 2026-08-18 12:00:05.143955 | mon1 | TASK [Retrieve info for the test Ceph key using the legacy key module] ********* 2026-08-18 12:00:05.143960 | mon1 | Tuesday 18 August 2026 12:00:05 +0000 (0:00:00.067) 0:00:25.050 ******** 2026-08-18 12:00:05.375392 | mon1 | fatal: [mon1]: FAILED! => {"changed": false, "msg": "value of state must be one of: present, update, absent, fetch_initial_keys, generate_secret, got: info"} 2026-08-18 12:00:05.391499 | mon1 | fatal: [mon2]: FAILED! => {"changed": false, "msg": "value of state must be one of: present, update, absent, fetch_initial_keys, generate_secret, got: info"} 2026-08-18 12:00:05.400947 | mon1 | fatal: [mon3]: FAILED! => {"changed": false, "msg": "value of state must be one of: present, update, absent, fetch_initial_keys, generate_secret, got: info"} 2026-08-18 12:00:05.402852 | mon1 | 2026-08-18 12:00:05.403042 | mon1 | PLAY RECAP ********************************************************************* 2026-08-18 12:00:05.403233 | mon1 | mon1 : ok=11 changed=2 unreachable=0 failed=1 skipped=0 rescued=0 ignored=0 2026-08-18 12:00:05.403406 | mon1 | mon2 : ok=11 changed=2 unreachable=0 failed=1 skipped=0 rescued=0 ignored=0 2026-08-18 12:00:05.403573 | mon1 | mon3 : ok=11 changed=2 unreachable=0 failed=1 skipped=0 rescued=0 ignored=0 2026-08-18 12:00:05.403723 | mon1 | 2026-08-18 12:00:05.403855 | mon1 | 2026-08-18 12:00:05.404960 | mon1 | TASKS RECAP ******************************************************************** 2026-08-18 12:00:05.405011 | mon1 | Tuesday 18 August 2026 12:00:05 +0000 (0:00:00.261) 0:00:25.311 ******** 2026-08-18 12:00:05.405021 | mon1 | =============================================================================== 2026-08-18 12:00:05.405029 | mon1 | Create a test Ceph pool ------------------------------------------------- 8.72s 2026-08-18 12:00:05.405038 | mon1 | List locally deployed Ceph daemons -------------------------------------- 6.21s 2026-08-18 12:00:05.405046 | mon1 | Create a test Ceph key -------------------------------------------------- 3.71s 2026-08-18 12:00:05.405054 | mon1 | Gathering Facts --------------------------------------------------------- 2.22s 2026-08-18 12:00:05.405068 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 2.00s 2026-08-18 12:00:05.405913 | mon1 | Get cluster health status ----------------------------------------------- 1.87s 2026-08-18 12:00:05.405937 | mon1 | Retrieve info for the test Ceph key using the legacy key module --------- 0.26s 2026-08-18 12:00:05.405943 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.07s 2026-08-18 12:00:05.405949 | mon1 | Print cluster health status --------------------------------------------- 0.06s 2026-08-18 12:00:05.405954 | mon1 | Collect deployed Ceph container images ---------------------------------- 0.06s 2026-08-18 12:00:05.406084 | mon1 | Assert that a deployed Ceph container image was found ------------------- 0.06s 2026-08-18 12:00:05.406298 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.06s 2026-08-18 12:00:05.546243 | mon1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/verify.yml 2026-08-18 12:00:05.546520 | mon1 | ERROR [default > verify] Executed: Failed 2026-08-18 12:00:05.546742 | mon1 | ERROR Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/verify.yml 2026-08-18 12:00:15.981226 | mon1 | ERROR 2026-08-18 12:00:15.981506 | mon1 | { 2026-08-18 12:00:15.981561 | mon1 | "delta": "0:19:15.918335", 2026-08-18 12:00:15.981593 | mon1 | "end": "2026-08-18 12:00:05.615797", 2026-08-18 12:00:15.981621 | mon1 | "msg": "non-zero return code", 2026-08-18 12:00:15.981647 | mon1 | "rc": 2, 2026-08-18 12:00:15.981673 | mon1 | "start": "2026-08-18 11:40:49.697462" 2026-08-18 12:00:15.981699 | mon1 | } failure 2026-08-18 12:00:16.018770 | 2026-08-18 12:00:16.018880 | PLAY RECAP 2026-08-18 12:00:16.018968 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-08-18 12:00:16.019017 | 2026-08-18 12:00:16.195934 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-18 12:00:16.203872 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-18 12:00:16.822399 | 2026-08-18 12:00:16.822556 | PLAY [all] 2026-08-18 12:00:16.835293 | 2026-08-18 12:00:16.835373 | TASK [fetch-output : Set log path for multiple nodes] 2026-08-18 12:00:16.884756 | mon1 | ok 2026-08-18 12:00:16.900751 | mon2 | ok 2026-08-18 12:00:16.905266 | mon3 | ok 2026-08-18 12:00:16.923338 | osd1 | ok 2026-08-18 12:00:16.935019 | 2026-08-18 12:00:16.935133 | TASK [fetch-output : Set log path for single node] 2026-08-18 12:00:16.967656 | mon1 | skipping: Conditional result was False 2026-08-18 12:00:16.984936 | mon2 | skipping: Conditional result was False 2026-08-18 12:00:16.996407 | mon3 | skipping: Conditional result was False 2026-08-18 12:00:17.006949 | osd1 | skipping: Conditional result was False 2026-08-18 12:00:17.016401 | 2026-08-18 12:00:17.016497 | LOOP [fetch-output : Ensure local output dirs] 2026-08-18 12:00:17.389825 | mon2 -> localhost | changed: "/var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/work/logs/mon2" 2026-08-18 12:00:17.391192 | osd1 -> localhost | changed: "/var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/work/logs/osd1" 2026-08-18 12:00:17.424608 | mon1 -> localhost | changed: "/var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/work/logs/mon1" 2026-08-18 12:00:17.425723 | mon3 -> localhost | changed: "/var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/work/logs/mon3" 2026-08-18 12:00:17.602017 | mon2 -> localhost | changed: "/var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/work/artifacts" 2026-08-18 12:00:17.608367 | osd1 -> localhost | ok: "/var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/work/artifacts" 2026-08-18 12:00:17.633196 | mon1 -> localhost | ok: "/var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/work/artifacts" 2026-08-18 12:00:17.659574 | mon3 -> localhost | ok: "/var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/work/artifacts" 2026-08-18 12:00:17.803900 | mon2 -> localhost | changed: "/var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/work/docs" 2026-08-18 12:00:17.827934 | osd1 -> localhost | ok: "/var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/work/docs" 2026-08-18 12:00:17.828231 | osd1 -> localhost | changed: All items complete 2026-08-18 12:00:17.828305 | 2026-08-18 12:00:17.847467 | mon1 -> localhost | ok: "/var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/work/docs" 2026-08-18 12:00:17.856171 | mon3 -> localhost | ok: "/var/lib/zuul/builds/7ff0072a72df4252a41fe8fd3fc44262/work/docs" 2026-08-18 12:00:17.856257 | mon3 -> localhost | changed: All items complete 2026-08-18 12:00:17.856298 | 2026-08-18 12:00:17.870841 | 2026-08-18 12:00:17.871001 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-08-18 12:00:18.522356 | mon3 | changed: .d..t...... ./ 2026-08-18 12:00:18.529237 | mon1 | changed: .d..t...... ./ 2026-08-18 12:00:18.534859 | osd1 | changed: .d..t...... ./ 2026-08-18 12:00:18.539601 | mon2 | changed: .d..t...... ./ 2026-08-18 12:00:18.989494 | mon1 | changed: .d..t...... ./ 2026-08-18 12:00:19.009892 | mon3 | ok 2026-08-18 12:00:19.016598 | osd1 | ok 2026-08-18 12:00:19.021803 | mon2 | ok 2026-08-18 12:00:19.479076 | mon3 | changed: .d..t...... ./ 2026-08-18 12:00:19.485762 | mon1 | changed: .d..t...... ./ 2026-08-18 12:00:19.542336 | osd1 | ok 2026-08-18 12:00:19.554484 | mon2 | ok 2026-08-18 12:00:19.554627 | mon2 | changed: All items complete 2026-08-18 12:00:19.554662 | 2026-08-18 12:00:19.589748 | 2026-08-18 12:00:19.589873 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-08-18 12:00:19.952124 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008314 2026-08-18 12:00:19.952397 | mon1 -> localhost | changed: All items complete 2026-08-18 12:00:19.952435 | 2026-08-18 12:00:20.186974 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007663 2026-08-18 12:00:20.223281 | 2026-08-18 12:00:20.223449 | PLAY [all] 2026-08-18 12:00:20.234431 | 2026-08-18 12:00:20.234533 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-08-18 12:00:20.748863 | mon1 | changed 2026-08-18 12:00:20.962906 | mon2 | changed 2026-08-18 12:00:20.968298 | osd1 | changed 2026-08-18 12:00:20.972837 | mon3 | changed 2026-08-18 12:00:20.991585 | 2026-08-18 12:00:20.991647 | PLAY RECAP 2026-08-18 12:00:20.991691 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 12:00:20.991721 | mon2 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 12:00:20.991747 | mon3 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 12:00:20.991770 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 12:00:20.991788 | 2026-08-18 12:00:21.110731 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-18 12:00:21.118098 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-08-18 12:00:21.713615 | 2026-08-18 12:00:21.713736 | PLAY [localhost] 2026-08-18 12:00:21.723706 | 2026-08-18 12:00:21.723779 | TASK [Generate Zuul manifest] 2026-08-18 12:00:21.743550 | localhost | ok 2026-08-18 12:00:21.764283 | 2026-08-18 12:00:21.764390 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-08-18 12:00:22.139002 | localhost | changed 2026-08-18 12:00:22.152692 | 2026-08-18 12:00:22.152773 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-08-18 12:00:22.185096 | localhost | ok 2026-08-18 12:00:22.195250 | 2026-08-18 12:00:22.195337 | TASK [Upload logs] 2026-08-18 12:00:22.215295 | localhost | ok 2026-08-18 12:00:22.273826 | 2026-08-18 12:00:22.273916 | TASK [Set zuul-log-path fact] 2026-08-18 12:00:22.295717 | localhost | ok 2026-08-18 12:00:22.310373 | 2026-08-18 12:00:22.310441 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-18 12:00:22.341906 | localhost | ok 2026-08-18 12:00:22.349722 | 2026-08-18 12:00:22.349789 | TASK [upload-logs : Create log directories] 2026-08-18 12:00:22.746798 | localhost | changed 2026-08-18 12:00:22.795686 | 2026-08-18 12:00:22.795855 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-08-18 12:00:23.148879 | localhost -> localhost | ok: Runtime: 0:00:00.005741 2026-08-18 12:00:23.154454 | 2026-08-18 12:00:23.154520 | TASK [upload-logs : Upload logs to log server] 2026-08-18 12:00:23.590862 | localhost | Output suppressed because no_log was given 2026-08-18 12:00:23.595983 | 2026-08-18 12:00:23.596073 | LOOP [upload-logs : Compress console log and json output] 2026-08-18 12:00:23.645056 | localhost | skipping: Conditional result was False 2026-08-18 12:00:23.661941 | localhost | skipping: Conditional result was False 2026-08-18 12:00:23.672531 | 2026-08-18 12:00:23.672686 | LOOP [upload-logs : Upload compressed console log and json output] 2026-08-18 12:00:23.714233 | localhost | skipping: Conditional result was False 2026-08-18 12:00:23.714650 | 2026-08-18 12:00:23.718171 | localhost | skipping: Conditional result was False 2026-08-18 12:00:23.726514 | 2026-08-18 12:00:23.726617 | LOOP [upload-logs : Upload console log and json output]