2026-07-17 11:59:11.454620 | Job console starting 2026-07-17 11:59:11.476467 | Updating git repos 2026-07-17 11:59:11.508306 | Cloning repos into workspace 2026-07-17 11:59:12.831772 | Restoring repo states 2026-07-17 11:59:12.841655 | Merging changes 2026-07-17 11:59:13.110006 | Checking out repos 2026-07-17 11:59:13.294726 | Preparing playbooks 2026-07-17 11:59:29.633568 | Running Ansible setup 2026-07-17 11:59:34.793160 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-07-17 11:59:35.439962 | 2026-07-17 11:59:35.440116 | PLAY [localhost] 2026-07-17 11:59:35.448308 | 2026-07-17 11:59:35.448402 | TASK [Gathering Facts] 2026-07-17 11:59:36.323038 | localhost | ok 2026-07-17 11:59:36.334378 | 2026-07-17 11:59:36.334494 | TASK [Setup log path fact] 2026-07-17 11:59:36.354249 | localhost | ok 2026-07-17 11:59:36.367261 | 2026-07-17 11:59:36.367341 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-07-17 11:59:36.395553 | localhost | ok 2026-07-17 11:59:36.401181 | 2026-07-17 11:59:36.401253 | TASK [emit-job-header : Print job information] 2026-07-17 11:59:36.440682 | # Job Information 2026-07-17 11:59:36.440853 | Ansible Version: 2.16.18 2026-07-17 11:59:36.440901 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy 2026-07-17 11:59:36.440938 | Pipeline: check 2026-07-17 11:59:36.440994 | Executor: 2d72f0692154 2026-07-17 11:59:36.441029 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/117 2026-07-17 11:59:36.441065 | Event ID: 814f2c30-81d6-11f1-8a77-404fd086dbc5 2026-07-17 11:59:36.446399 | 2026-07-17 11:59:36.446523 | LOOP [emit-job-header : Print node information] 2026-07-17 11:59:36.545732 | localhost | ok: 2026-07-17 11:59:36.545990 | localhost | # Node Information 2026-07-17 11:59:36.546055 | localhost | Inventory Hostname: mon1 2026-07-17 11:59:36.546110 | localhost | Hostname: np0000185776 2026-07-17 11:59:36.546160 | localhost | Username: zuul 2026-07-17 11:59:36.546213 | localhost | Distro: Ubuntu 22.04 2026-07-17 11:59:36.546261 | localhost | Provider: yul1 2026-07-17 11:59:36.546307 | localhost | Region: ca-ymq-1 2026-07-17 11:59:36.546350 | localhost | Label: ubuntu-jammy 2026-07-17 11:59:36.546393 | localhost | Product Name: OpenStack Nova 2026-07-17 11:59:36.546436 | localhost | Interface IP: 199.19.213.175 2026-07-17 11:59:36.592004 | localhost | ok: 2026-07-17 11:59:36.592171 | localhost | # Node Information 2026-07-17 11:59:36.592251 | localhost | Inventory Hostname: osd1 2026-07-17 11:59:36.592317 | localhost | Hostname: np0000185777 2026-07-17 11:59:36.592379 | localhost | Username: zuul 2026-07-17 11:59:36.592437 | localhost | Distro: Ubuntu 22.04 2026-07-17 11:59:36.592497 | localhost | Provider: yul1 2026-07-17 11:59:36.592557 | localhost | Region: ca-ymq-1 2026-07-17 11:59:36.592614 | localhost | Label: ubuntu-jammy 2026-07-17 11:59:36.592672 | localhost | Product Name: OpenStack Nova 2026-07-17 11:59:36.592732 | localhost | Interface IP: 199.19.213.137 2026-07-17 11:59:36.617605 | 2026-07-17 11:59:36.617853 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-07-17 11:59:37.047895 | localhost -> localhost | changed 2026-07-17 11:59:37.056716 | 2026-07-17 11:59:37.057218 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-07-17 11:59:38.039730 | localhost -> localhost | changed 2026-07-17 11:59:38.052244 | 2026-07-17 11:59:38.052346 | PLAY [all] 2026-07-17 11:59:38.061973 | 2026-07-17 11:59:38.062112 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-07-17 11:59:38.309942 | mon1 -> localhost | ok 2026-07-17 11:59:38.320329 | 2026-07-17 11:59:38.320484 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-07-17 11:59:38.353305 | mon1 | ok 2026-07-17 11:59:38.359297 | osd1 | ok 2026-07-17 11:59:38.388723 | mon1 | included: /var/lib/zuul/builds/4d2cd2a346de41d0b1b67ab0789d2be6/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-07-17 11:59:38.388838 | osd1 | included: /var/lib/zuul/builds/4d2cd2a346de41d0b1b67ab0789d2be6/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-07-17 11:59:38.396513 | 2026-07-17 11:59:38.396606 | TASK [add-build-sshkey : Create Temp SSH key] 2026-07-17 11:59:39.597960 | mon1 -> localhost | Generating public/private rsa key pair. 2026-07-17 11:59:39.598134 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/4d2cd2a346de41d0b1b67ab0789d2be6/work/4d2cd2a346de41d0b1b67ab0789d2be6_id_rsa 2026-07-17 11:59:39.598166 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/4d2cd2a346de41d0b1b67ab0789d2be6/work/4d2cd2a346de41d0b1b67ab0789d2be6_id_rsa.pub 2026-07-17 11:59:39.598210 | mon1 -> localhost | The key fingerprint is: 2026-07-17 11:59:39.598252 | mon1 -> localhost | SHA256:l4OSel3B0Gdd4ePMvOmGVaf8hvLlEqUL4h2RmkFA0fI zuul-build-sshkey 2026-07-17 11:59:39.598284 | mon1 -> localhost | The key's randomart image is: 2026-07-17 11:59:39.598316 | mon1 -> localhost | +---[RSA 3072]----+ 2026-07-17 11:59:39.598347 | mon1 -> localhost | | .== . oo| 2026-07-17 11:59:39.598378 | mon1 -> localhost | | .o+ o o | 2026-07-17 11:59:39.598407 | mon1 -> localhost | | +oo . o | 2026-07-17 11:59:39.598448 | mon1 -> localhost | | . .Eoo = =| 2026-07-17 11:59:39.598488 | mon1 -> localhost | | o S =+ o Oo| 2026-07-17 11:59:39.598517 | mon1 -> localhost | | . o o+.o =.o| 2026-07-17 11:59:39.598545 | mon1 -> localhost | | . . .. o ooB.| 2026-07-17 11:59:39.598572 | mon1 -> localhost | | . . o.=+o| 2026-07-17 11:59:39.598598 | mon1 -> localhost | | oo+.| 2026-07-17 11:59:39.598624 | mon1 -> localhost | +----[SHA256]-----+ 2026-07-17 11:59:39.598688 | mon1 -> localhost | ok: Runtime: 0:00:00.781615 2026-07-17 11:59:39.604109 | 2026-07-17 11:59:39.604175 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-07-17 11:59:39.636621 | mon1 | ok 2026-07-17 11:59:39.642538 | osd1 | ok 2026-07-17 11:59:39.656139 | mon1 | included: /var/lib/zuul/builds/4d2cd2a346de41d0b1b67ab0789d2be6/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-07-17 11:59:39.656203 | osd1 | included: /var/lib/zuul/builds/4d2cd2a346de41d0b1b67ab0789d2be6/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-07-17 11:59:39.669612 | 2026-07-17 11:59:39.669708 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-07-17 11:59:39.694217 | mon1 | skipping: Conditional result was False 2026-07-17 11:59:39.705633 | osd1 | skipping: Conditional result was False 2026-07-17 11:59:39.715660 | 2026-07-17 11:59:39.715768 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-07-17 11:59:40.177969 | mon1 | changed 2026-07-17 11:59:40.182449 | osd1 | changed 2026-07-17 11:59:40.187132 | 2026-07-17 11:59:40.187203 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-07-17 11:59:40.387697 | mon1 | ok 2026-07-17 11:59:40.394639 | osd1 | ok 2026-07-17 11:59:40.400946 | 2026-07-17 11:59:40.401066 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-07-17 11:59:40.873577 | mon1 | changed 2026-07-17 11:59:40.922867 | osd1 | changed 2026-07-17 11:59:40.929647 | 2026-07-17 11:59:40.929737 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-07-17 11:59:41.446335 | mon1 | changed 2026-07-17 11:59:41.450744 | osd1 | changed 2026-07-17 11:59:41.455459 | 2026-07-17 11:59:41.455534 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-07-17 11:59:41.480053 | mon1 | skipping: Conditional result was False 2026-07-17 11:59:41.491352 | osd1 | skipping: Conditional result was False 2026-07-17 11:59:41.500608 | 2026-07-17 11:59:41.500717 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-07-17 11:59:41.849448 | mon1 -> localhost | changed 2026-07-17 11:59:41.866663 | 2026-07-17 11:59:41.866748 | TASK [add-build-sshkey : Add back temp key] 2026-07-17 11:59:42.150688 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/4d2cd2a346de41d0b1b67ab0789d2be6/work/4d2cd2a346de41d0b1b67ab0789d2be6_id_rsa (zuul-build-sshkey) 2026-07-17 11:59:42.150913 | mon1 -> localhost | ok: Runtime: 0:00:00.015208 2026-07-17 11:59:42.157584 | 2026-07-17 11:59:42.157671 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-07-17 11:59:42.465887 | osd1 | ok 2026-07-17 11:59:42.477231 | mon1 | ok 2026-07-17 11:59:42.481887 | 2026-07-17 11:59:42.481975 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-07-17 11:59:42.507843 | mon1 | skipping: Conditional result was False 2026-07-17 11:59:42.519298 | osd1 | skipping: Conditional result was False 2026-07-17 11:59:42.539835 | 2026-07-17 11:59:42.539995 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-07-17 11:59:42.832453 | mon1 | ok 2026-07-17 11:59:42.838741 | osd1 | ok 2026-07-17 11:59:42.844457 | 2026-07-17 11:59:42.844562 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-07-17 11:59:43.545323 | mon1 | Output suppressed because no_log was given 2026-07-17 11:59:43.624694 | osd1 | Output suppressed because no_log was given 2026-07-17 11:59:43.640053 | 2026-07-17 11:59:43.640127 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-07-17 11:59:43.836587 | osd1 | ok: "logs" 2026-07-17 11:59:43.836899 | osd1 | ok: All items complete 2026-07-17 11:59:43.836945 | 2026-07-17 11:59:43.849991 | mon1 | ok: "logs" 2026-07-17 11:59:44.002062 | osd1 | ok: "artifacts" 2026-07-17 11:59:44.625659 | mon1 | ok: "artifacts" 2026-07-17 11:59:44.632356 | osd1 | ok: "docs" 2026-07-17 11:59:44.638469 | mon1 | ok: "docs" 2026-07-17 11:59:44.648537 | 2026-07-17 11:59:44.648701 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-07-17 11:59:44.848847 | mon1 | changed: "logs" 2026-07-17 11:59:44.849324 | mon1 | ok: All items complete 2026-07-17 11:59:44.849451 | 2026-07-17 11:59:44.878168 | osd1 | changed: "logs" 2026-07-17 11:59:45.007424 | mon1 | changed: "artifacts" 2026-07-17 11:59:45.045642 | osd1 | changed: "artifacts" 2026-07-17 11:59:45.184344 | mon1 | changed: "docs" 2026-07-17 11:59:45.203764 | osd1 | changed: "docs" 2026-07-17 11:59:45.230545 | 2026-07-17 11:59:45.230638 | PLAY RECAP 2026-07-17 11:59:45.230681 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-07-17 11:59:45.230710 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-07-17 11:59:45.230734 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-07-17 11:59:45.230752 | 2026-07-17 11:59:45.392030 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-07-17 11:59:45.397024 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-07-17 11:59:46.066185 | 2026-07-17 11:59:46.066361 | PLAY [all] 2026-07-17 11:59:46.077696 | 2026-07-17 11:59:46.077815 | TASK [setup-uv : Extract archive] 2026-07-17 11:59:48.314191 | mon1 | changed 2026-07-17 11:59:48.443456 | osd1 | changed 2026-07-17 11:59:48.450368 | 2026-07-17 11:59:48.450495 | TASK [setup-uv : Print version] 2026-07-17 11:59:48.829933 | osd1 | uv 0.8.13 2026-07-17 11:59:48.854557 | mon1 | uv 0.8.13 2026-07-17 11:59:49.007695 | osd1 | ok: Runtime: 0:00:00.012356 2026-07-17 11:59:49.019970 | mon1 | ok: Runtime: 0:00:00.010185 2026-07-17 11:59:49.037654 | 2026-07-17 11:59:49.037797 | TASK [Install Ansible collection siblings] 2026-07-17 11:59:49.414536 | mon1 | ok: 2026-07-17 11:59:49.414736 | mon1 | Skipping community.general: no checked-out sibling 2026-07-17 11:59:49.414776 | mon1 | Skipping ansible.utils: no checked-out sibling 2026-07-17 11:59:49.414807 | mon1 | Skipping vexxhost.containers: no checked-out sibling 2026-07-17 11:59:49.417067 | 2026-07-17 11:59:49.417136 | PLAY RECAP 2026-07-17 11:59:49.417225 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-07-17 11:59:49.417307 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-07-17 11:59:49.417342 | 2026-07-17 11:59:49.540682 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-07-17 11:59:49.546679 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-07-17 11:59:50.154525 | 2026-07-17 11:59:50.154663 | PLAY [all] 2026-07-17 11:59:50.166784 | 2026-07-17 11:59:50.166905 | LOOP [Check inventory directories] 2026-07-17 11:59:50.504402 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph" 2026-07-17 11:59:50.674453 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory" 2026-07-17 11:59:50.839455 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory" 2026-07-17 11:59:50.856098 | 2026-07-17 11:59:50.856283 | LOOP [Copy inventory file for Zuul] 2026-07-17 11:59:51.690716 | mon1 | changed: 2026-07-17 11:59:51.692877 | mon1 | { 2026-07-17 11:59:51.692996 | mon1 | "ansible_loop_var": "item", 2026-07-17 11:59:51.693054 | mon1 | "changed": false, 2026-07-17 11:59:51.693093 | mon1 | "failed": false, 2026-07-17 11:59:51.693136 | mon1 | "invocation": { 2026-07-17 11:59:51.693173 | mon1 | "module_args": { 2026-07-17 11:59:51.693202 | mon1 | "checksum_algorithm": "sha1", 2026-07-17 11:59:51.693244 | mon1 | "follow": true, 2026-07-17 11:59:51.693284 | mon1 | "get_attributes": true, 2026-07-17 11:59:51.693320 | mon1 | "get_checksum": true, 2026-07-17 11:59:51.693353 | mon1 | "get_mime": true, 2026-07-17 11:59:51.693386 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph" 2026-07-17 11:59:51.693419 | mon1 | } 2026-07-17 11:59:51.693451 | mon1 | }, 2026-07-17 11:59:51.693484 | mon1 | "item": "src/github.com/vexxhost/ansible-collection-ceph", 2026-07-17 11:59:51.693517 | mon1 | "stat": { 2026-07-17 11:59:51.693548 | mon1 | "atime": 1784289583.4451046, 2026-07-17 11:59:51.693581 | mon1 | "attr_flags": "e", 2026-07-17 11:59:51.693613 | mon1 | "attributes": [ 2026-07-17 11:59:51.693645 | mon1 | "extents" 2026-07-17 11:59:51.693676 | mon1 | ], 2026-07-17 11:59:51.693707 | mon1 | "block_size": 4096, 2026-07-17 11:59:51.693740 | mon1 | "blocks": 8, 2026-07-17 11:59:51.693775 | mon1 | "charset": "unknown", 2026-07-17 11:59:51.693809 | mon1 | "ctime": 1784289583.4571064, 2026-07-17 11:59:51.693840 | mon1 | "dev": 64513, 2026-07-17 11:59:51.693873 | mon1 | "device_type": 0, 2026-07-17 11:59:51.693905 | mon1 | "executable": true, 2026-07-17 11:59:51.693936 | mon1 | "exists": true, 2026-07-17 11:59:51.693968 | mon1 | "gid": 1000, 2026-07-17 11:59:51.694000 | mon1 | "gr_name": "zuul", 2026-07-17 11:59:51.694032 | mon1 | "inode": 1041949, 2026-07-17 11:59:51.694063 | mon1 | "isblk": false, 2026-07-17 11:59:51.694095 | mon1 | "ischr": false, 2026-07-17 11:59:51.694126 | mon1 | "isdir": true, 2026-07-17 11:59:51.694158 | mon1 | "isfifo": false, 2026-07-17 11:59:51.694190 | mon1 | "isgid": false, 2026-07-17 11:59:51.694221 | mon1 | "islnk": false, 2026-07-17 11:59:51.694252 | mon1 | "isreg": false, 2026-07-17 11:59:51.694282 | mon1 | "issock": false, 2026-07-17 11:59:51.694315 | mon1 | "isuid": false, 2026-07-17 11:59:51.694345 | mon1 | "mimetype": "unknown", 2026-07-17 11:59:51.694376 | mon1 | "mode": "0755", 2026-07-17 11:59:51.694415 | mon1 | "mtime": 1784289553.0708518, 2026-07-17 11:59:51.694459 | mon1 | "nlink": 10, 2026-07-17 11:59:51.694503 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph", 2026-07-17 11:59:51.694547 | mon1 | "pw_name": "zuul", 2026-07-17 11:59:51.694599 | mon1 | "readable": true, 2026-07-17 11:59:51.694647 | mon1 | "rgrp": true, 2026-07-17 11:59:51.694684 | mon1 | "roth": true, 2026-07-17 11:59:51.694741 | mon1 | "rusr": true, 2026-07-17 11:59:51.694776 | mon1 | "size": 4096, 2026-07-17 11:59:51.694903 | mon1 | "uid": 1000, 2026-07-17 11:59:51.694943 | mon1 | "version": "2738520018", 2026-07-17 11:59:51.694971 | mon1 | "wgrp": false, 2026-07-17 11:59:51.695002 | mon1 | "woth": false, 2026-07-17 11:59:51.695030 | mon1 | "writeable": true, 2026-07-17 11:59:51.695058 | mon1 | "wusr": true, 2026-07-17 11:59:51.695084 | mon1 | "xgrp": true, 2026-07-17 11:59:51.695109 | mon1 | "xoth": true, 2026-07-17 11:59:51.695134 | mon1 | "xusr": true 2026-07-17 11:59:51.695159 | mon1 | } 2026-07-17 11:59:51.695185 | mon1 | } 2026-07-17 11:59:51.695243 | mon1 | ok: All items complete 2026-07-17 11:59:51.695275 | 2026-07-17 11:59:51.697629 | mon1 | skipping: Conditional result was False 2026-07-17 11:59:51.698520 | mon1 | skipping: Conditional result was False 2026-07-17 11:59:51.717702 | 2026-07-17 11:59:51.717821 | LOOP [Switch "ansible_host" to private IP] 2026-07-17 11:59:52.096660 | mon1 | changed: 2 replacements made 2026-07-17 11:59:52.100090 | mon1 | skipping: Conditional result was False 2026-07-17 11:59:52.106221 | mon1 | skipping: Conditional result was False 2026-07-17 11:59:52.121873 | 2026-07-17 11:59:52.122009 | TASK [Run Molecule scenario] 2026-07-17 11:59:52.737583 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-07-17 11:59:53.485321 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-07-17 11:59:53.670835 | mon1 | Using CPython 3.13.7 2026-07-17 11:59:53.670947 | mon1 | Creating virtual environment at: .venv 2026-07-17 11:59:53.709618 | mon1 | Downloading netaddr (2.2MiB) 2026-07-17 11:59:53.709829 | mon1 | Downloading ansible-core (2.3MiB) 2026-07-17 11:59:53.710063 | mon1 | Downloading pygments (1.2MiB) 2026-07-17 11:59:53.710586 | mon1 | Downloading cryptography (4.3MiB) 2026-07-17 11:59:53.901679 | mon1 | Downloading netaddr 2026-07-17 11:59:53.914394 | mon1 | Downloading cryptography 2026-07-17 11:59:53.957235 | mon1 | Downloading pygments 2026-07-17 11:59:54.134589 | mon1 | Downloading ansible-core 2026-07-17 11:59:54.166359 | mon1 | Installed 36 packages in 30ms 2026-07-17 11:59:55.401885 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-07-17 11:59:55.401973 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-07-17 11:59:56.411183 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-07-17 11:59:56.411276 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-07-17 12:00:15.554340 | mon1 | INFO [default > dependency] Executing 2026-07-17 12:00:15.554796 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-07-17 12:00:15.555402 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-07-17 12:00:15.555642 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-07-17 12:00:15.561525 | mon1 | INFO [default > cleanup] Executing 2026-07-17 12:00:15.561815 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-07-17 12:00:15.567180 | mon1 | INFO [default > destroy] Executing 2026-07-17 12:00:15.567250 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-07-17 12:00:15.567385 | mon1 | INFO [default > destroy] Executed: Successful 2026-07-17 12:00:15.572762 | mon1 | INFO [default > syntax] Executing 2026-07-17 12:00:17.001287 | mon1 | 2026-07-17 12:00:17.001469 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-07-17 12:00:17.126314 | mon1 | INFO [default > syntax] Executed: Successful 2026-07-17 12:00:17.135924 | mon1 | INFO [default > create] Executing 2026-07-17 12:00:17.137971 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-07-17 12:00:17.143031 | mon1 | INFO [default > prepare] Executing 2026-07-17 12:00:18.195014 | mon1 | 2026-07-17 12:00:18.195371 | mon1 | PLAY [Prepare] ***************************************************************** 2026-07-17 12:00:18.195643 | mon1 | 2026-07-17 12:00:18.195976 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-07-17 12:00:18.196213 | mon1 | Friday 17 July 2026 12:00:18 +0000 (0:00:00.033) 0:00:00.033 *********** 2026-07-17 12:00:19.401793 | mon1 | [WARNING]: Host 'mon1' is using the discovered Python interpreter at '/usr/bin/python3.10', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.21/reference_appendices/interpreter_discovery.html for more information. 2026-07-17 12:00:19.405792 | mon1 | [WARNING]: Host 'osd1' is using the discovered Python interpreter at '/usr/bin/python3.10', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.21/reference_appendices/interpreter_discovery.html for more information. 2026-07-17 12:00:19.409850 | mon1 | ok: [mon1] 2026-07-17 12:00:19.410151 | mon1 | ok: [osd1] 2026-07-17 12:00:19.410635 | mon1 | 2026-07-17 12:00:19.411126 | mon1 | TASK [Configure short hostname] ************************************************ 2026-07-17 12:00:19.411547 | mon1 | Friday 17 July 2026 12:00:19 +0000 (0:00:01.215) 0:00:01.249 *********** 2026-07-17 12:00:20.237794 | mon1 | changed: [mon1] 2026-07-17 12:00:20.238077 | mon1 | changed: [osd1] 2026-07-17 12:00:20.238469 | mon1 | 2026-07-17 12:00:20.238833 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-07-17 12:00:20.239104 | mon1 | Friday 17 July 2026 12:00:20 +0000 (0:00:00.827) 0:00:02.076 *********** 2026-07-17 12:00:20.601868 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually 2026-07-17 12:00:20.618785 | mon1 | changed: [mon1] 2026-07-17 12:00:20.618902 | mon1 | changed: [osd1] 2026-07-17 12:00:20.619128 | mon1 | 2026-07-17 12:00:20.619437 | mon1 | TASK [Update apt cache] ******************************************************** 2026-07-17 12:00:20.619640 | mon1 | Friday 17 July 2026 12:00:20 +0000 (0:00:00.381) 0:00:02.457 *********** 2026-07-17 12:00:57.855995 | mon1 | changed: [mon1] 2026-07-17 12:00:57.856098 | mon1 | changed: [osd1] 2026-07-17 12:00:57.856214 | mon1 | 2026-07-17 12:00:57.856361 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-07-17 12:00:57.856488 | mon1 | 2026-07-17 12:00:57.856685 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-07-17 12:00:57.856843 | mon1 | Friday 17 July 2026 12:00:57 +0000 (0:00:37.237) 0:00:39.695 *********** 2026-07-17 12:00:58.693660 | mon1 | ok: [osd1] 2026-07-17 12:00:58.693749 | mon1 | 2026-07-17 12:00:58.693893 | mon1 | TASK [Install depedencies] ***************************************************** 2026-07-17 12:00:58.694032 | mon1 | Friday 17 July 2026 12:00:58 +0000 (0:00:00.837) 0:00:40.533 *********** 2026-07-17 12:01:26.474382 | mon1 | changed: [osd1] 2026-07-17 12:01:26.474480 | mon1 | 2026-07-17 12:01:26.474564 | mon1 | TASK [Start up service] ******************************************************** 2026-07-17 12:01:26.474668 | mon1 | Friday 17 July 2026 12:01:26 +0000 (0:00:27.780) 0:01:08.313 *********** 2026-07-17 12:01:27.160656 | mon1 | ok: [osd1] 2026-07-17 12:01:27.160764 | mon1 | 2026-07-17 12:01:27.160918 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-07-17 12:01:27.161064 | mon1 | Friday 17 July 2026 12:01:27 +0000 (0:00:00.686) 0:01:08.999 *********** 2026-07-17 12:01:27.568626 | mon1 | ok: [osd1] 2026-07-17 12:01:27.568709 | mon1 | 2026-07-17 12:01:27.568782 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-07-17 12:01:27.568893 | mon1 | Friday 17 July 2026 12:01:27 +0000 (0:00:00.408) 0:01:09.407 *********** 2026-07-17 12:01:28.429089 | mon1 | changed: [osd1] 2026-07-17 12:01:28.429157 | mon1 | 2026-07-17 12:01:28.429315 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-07-17 12:01:28.429448 | mon1 | Friday 17 July 2026 12:01:28 +0000 (0:00:00.860) 0:01:10.268 *********** 2026-07-17 12:01:28.705719 | mon1 | ok: [osd1] 2026-07-17 12:01:28.705898 | mon1 | 2026-07-17 12:01:28.706126 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-07-17 12:01:28.706324 | mon1 | Friday 17 July 2026 12:01:28 +0000 (0:00:00.276) 0:01:10.544 *********** 2026-07-17 12:01:28.732291 | mon1 | skipping: [osd1] 2026-07-17 12:01:28.732392 | mon1 | 2026-07-17 12:01:28.732541 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-07-17 12:01:28.732684 | mon1 | Friday 17 July 2026 12:01:28 +0000 (0:00:00.026) 0:01:10.571 *********** 2026-07-17 12:01:29.493983 | mon1 | changed: [osd1] => (item=osd0) 2026-07-17 12:01:29.494194 | mon1 | changed: [osd1] => (item=osd1) 2026-07-17 12:01:29.494404 | mon1 | changed: [osd1] => (item=osd2) 2026-07-17 12:01:29.494598 | mon1 | 2026-07-17 12:01:29.494812 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-07-17 12:01:29.495015 | mon1 | Friday 17 July 2026 12:01:29 +0000 (0:00:00.761) 0:01:11.332 *********** 2026-07-17 12:01:30.416830 | mon1 | changed: [osd1] => (item=osd0) 2026-07-17 12:01:30.416927 | mon1 | changed: [osd1] => (item=osd1) 2026-07-17 12:01:30.417158 | mon1 | changed: [osd1] => (item=osd2) 2026-07-17 12:01:30.417276 | mon1 | 2026-07-17 12:01:30.417442 | mon1 | TASK [Start loop devices] ****************************************************** 2026-07-17 12:01:30.417604 | mon1 | Friday 17 July 2026 12:01:30 +0000 (0:00:00.923) 0:01:12.256 *********** 2026-07-17 12:01:31.338732 | mon1 | changed: [osd1] => (item=osd0) 2026-07-17 12:01:31.338880 | mon1 | changed: [osd1] => (item=osd1) 2026-07-17 12:01:31.339093 | mon1 | changed: [osd1] => (item=osd2) 2026-07-17 12:01:31.339340 | mon1 | 2026-07-17 12:01:31.339558 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-07-17 12:01:31.339775 | mon1 | Friday 17 July 2026 12:01:31 +0000 (0:00:00.920) 0:01:13.177 *********** 2026-07-17 12:01:34.707216 | mon1 | changed: [osd1] => (item=osd0) 2026-07-17 12:01:34.707348 | mon1 | changed: [osd1] => (item=osd1) 2026-07-17 12:01:34.707356 | mon1 | changed: [osd1] => (item=osd2) 2026-07-17 12:01:34.707364 | mon1 | 2026-07-17 12:01:34.707371 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-07-17 12:01:34.707377 | mon1 | Friday 17 July 2026 12:01:34 +0000 (0:00:03.368) 0:01:16.545 *********** 2026-07-17 12:01:36.847296 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-07-17 12:01:36.847426 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-07-17 12:01:36.848098 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-07-17 12:01:36.848125 | mon1 | 2026-07-17 12:01:36.848136 | mon1 | PLAY RECAP ********************************************************************* 2026-07-17 12:01:36.848151 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-07-17 12:01:36.850145 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-07-17 12:01:36.850248 | mon1 | 2026-07-17 12:01:36.850260 | mon1 | 2026-07-17 12:01:36.850271 | mon1 | TASKS RECAP ******************************************************************** 2026-07-17 12:01:36.850281 | mon1 | Friday 17 July 2026 12:01:36 +0000 (0:00:02.141) 0:01:18.687 *********** 2026-07-17 12:01:36.850291 | mon1 | =============================================================================== 2026-07-17 12:01:36.850300 | mon1 | Update apt cache ------------------------------------------------------- 37.24s 2026-07-17 12:01:36.850309 | mon1 | Install depedencies ---------------------------------------------------- 27.78s 2026-07-17 12:01:36.850319 | mon1 | Create a volume group for each loop device ------------------------------ 3.37s 2026-07-17 12:01:36.850328 | mon1 | Create a logical volume for each loop device ---------------------------- 2.14s 2026-07-17 12:01:36.850337 | mon1 | Gathering Facts --------------------------------------------------------- 1.22s 2026-07-17 12:01:36.850346 | mon1 | Set permissions on loopback devices ------------------------------------- 0.92s 2026-07-17 12:01:36.850355 | mon1 | Start loop devices ------------------------------------------------------ 0.92s 2026-07-17 12:01:36.850365 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.86s 2026-07-17 12:01:36.850386 | mon1 | Gathering Facts --------------------------------------------------------- 0.84s 2026-07-17 12:01:36.850396 | mon1 | Configure short hostname ------------------------------------------------ 0.83s 2026-07-17 12:01:36.851189 | mon1 | Create devices for Ceph ------------------------------------------------- 0.76s 2026-07-17 12:01:36.851304 | mon1 | Start up service -------------------------------------------------------- 0.69s 2026-07-17 12:01:36.851315 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.41s 2026-07-17 12:01:36.851321 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.38s 2026-07-17 12:01:36.851328 | mon1 | Get list of all loopback devices ---------------------------------------- 0.28s 2026-07-17 12:01:36.851334 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-07-17 12:01:36.967635 | mon1 | INFO [default > prepare] Executed: Successful 2026-07-17 12:01:36.974802 | mon1 | INFO [default > converge] Executing 2026-07-17 12:01:38.294196 | mon1 | 2026-07-17 12:01:38.294480 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-07-17 12:01:38.294690 | mon1 | 2026-07-17 12:01:38.294885 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-07-17 12:01:38.295137 | mon1 | Friday 17 July 2026 12:01:38 +0000 (0:00:00.067) 0:00:00.067 *********** 2026-07-17 12:01:39.477073 | mon1 | [WARNING]: Host 'mon1' is using the discovered Python interpreter at '/usr/bin/python3.10', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.21/reference_appendices/interpreter_discovery.html for more information. 2026-07-17 12:01:39.488145 | mon1 | ok: [mon1] 2026-07-17 12:01:39.488165 | mon1 | 2026-07-17 12:01:39.488171 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-17 12:01:39.488176 | mon1 | Friday 17 July 2026 12:01:39 +0000 (0:00:01.194) 0:00:01.261 *********** 2026-07-17 12:01:40.024414 | mon1 | ok: [mon1] 2026-07-17 12:01:40.024468 | mon1 | 2026-07-17 12:01:40.024477 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-17 12:01:40.024682 | mon1 | Friday 17 July 2026 12:01:40 +0000 (0:00:00.535) 0:00:01.797 *********** 2026-07-17 12:01:40.068240 | mon1 | skipping: [mon1] 2026-07-17 12:01:40.068279 | mon1 | 2026-07-17 12:01:40.068287 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-07-17 12:01:40.068294 | mon1 | Friday 17 July 2026 12:01:40 +0000 (0:00:00.043) 0:00:01.841 *********** 2026-07-17 12:01:40.565162 | mon1 | changed: [mon1] 2026-07-17 12:01:40.565229 | mon1 | 2026-07-17 12:01:40.565241 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-17 12:01:40.565251 | mon1 | Friday 17 July 2026 12:01:40 +0000 (0:00:00.496) 0:00:02.338 *********** 2026-07-17 12:01:40.665250 | mon1 | ok: [mon1] => { 2026-07-17 12:01:40.665326 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-07-17 12:01:40.665397 | mon1 | } 2026-07-17 12:01:40.665797 | mon1 | 2026-07-17 12:01:40.665850 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-17 12:01:40.665858 | mon1 | Friday 17 July 2026 12:01:40 +0000 (0:00:00.100) 0:00:02.438 *********** 2026-07-17 12:01:41.527408 | mon1 | changed: [mon1] 2026-07-17 12:01:41.527743 | mon1 | 2026-07-17 12:01:41.528036 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-17 12:01:41.528319 | mon1 | Friday 17 July 2026 12:01:41 +0000 (0:00:00.861) 0:00:03.299 *********** 2026-07-17 12:01:41.575592 | mon1 | skipping: [mon1] 2026-07-17 12:01:41.575703 | mon1 | 2026-07-17 12:01:41.575711 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-17 12:01:41.575825 | mon1 | Friday 17 July 2026 12:01:41 +0000 (0:00:00.049) 0:00:03.349 *********** 2026-07-17 12:01:41.624367 | mon1 | skipping: [mon1] 2026-07-17 12:01:41.624450 | mon1 | 2026-07-17 12:01:41.624595 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-17 12:01:41.624827 | mon1 | Friday 17 July 2026 12:01:41 +0000 (0:00:00.047) 0:00:03.397 *********** 2026-07-17 12:01:41.907370 | mon1 | ok: [mon1] 2026-07-17 12:01:41.907480 | mon1 | 2026-07-17 12:01:41.907488 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-17 12:01:41.907589 | mon1 | Friday 17 July 2026 12:01:41 +0000 (0:00:00.283) 0:00:03.680 *********** 2026-07-17 12:01:43.275847 | mon1 | ok: [mon1] 2026-07-17 12:01:43.276353 | mon1 | 2026-07-17 12:01:43.276678 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-17 12:01:43.277009 | mon1 | Friday 17 July 2026 12:01:43 +0000 (0:00:01.365) 0:00:05.046 *********** 2026-07-17 12:01:43.355746 | mon1 | ok: [mon1] => { 2026-07-17 12:01:43.355821 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-07-17 12:01:43.355989 | mon1 | } 2026-07-17 12:01:43.356261 | mon1 | 2026-07-17 12:01:43.356453 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-17 12:01:43.356640 | mon1 | Friday 17 July 2026 12:01:43 +0000 (0:00:00.080) 0:00:05.127 *********** 2026-07-17 12:01:44.447672 | mon1 | changed: [mon1] 2026-07-17 12:01:44.447897 | mon1 | 2026-07-17 12:01:44.448088 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-17 12:01:44.448270 | mon1 | Friday 17 July 2026 12:01:44 +0000 (0:00:01.092) 0:00:06.219 *********** 2026-07-17 12:01:47.468694 | mon1 | changed: [mon1] 2026-07-17 12:01:47.468774 | mon1 | 2026-07-17 12:01:47.468996 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-07-17 12:01:47.469155 | mon1 | Friday 17 July 2026 12:01:47 +0000 (0:00:03.022) 0:00:09.242 *********** 2026-07-17 12:01:47.498458 | mon1 | skipping: [mon1] 2026-07-17 12:01:47.498504 | mon1 | 2026-07-17 12:01:47.498511 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-07-17 12:01:47.498516 | mon1 | Friday 17 July 2026 12:01:47 +0000 (0:00:00.029) 0:00:09.271 *********** 2026-07-17 12:01:47.526685 | mon1 | skipping: [mon1] 2026-07-17 12:01:47.526736 | mon1 | 2026-07-17 12:01:47.526744 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-07-17 12:01:47.526750 | mon1 | Friday 17 July 2026 12:01:47 +0000 (0:00:00.027) 0:00:09.299 *********** 2026-07-17 12:01:47.551940 | mon1 | skipping: [mon1] 2026-07-17 12:01:47.552010 | mon1 | 2026-07-17 12:01:47.552249 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-07-17 12:01:47.552318 | mon1 | Friday 17 July 2026 12:01:47 +0000 (0:00:00.026) 0:00:09.325 *********** 2026-07-17 12:01:57.564833 | mon1 | changed: [mon1] 2026-07-17 12:01:57.564870 | mon1 | 2026-07-17 12:01:57.564878 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-07-17 12:01:57.564893 | mon1 | Friday 17 July 2026 12:01:57 +0000 (0:00:10.012) 0:00:19.338 *********** 2026-07-17 12:01:58.278804 | mon1 | changed: [mon1] 2026-07-17 12:01:58.278884 | mon1 | 2026-07-17 12:01:58.279137 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-07-17 12:01:58.279193 | mon1 | Friday 17 July 2026 12:01:58 +0000 (0:00:00.714) 0:00:20.052 *********** 2026-07-17 12:01:59.493204 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-07-17 12:01:59.493280 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-07-17 12:01:59.493932 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-07-17 12:01:59.493980 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-07-17 12:01:59.493987 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-07-17 12:01:59.493993 | mon1 | 2026-07-17 12:01:59.493999 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-07-17 12:01:59.494004 | mon1 | Friday 17 July 2026 12:01:59 +0000 (0:00:01.214) 0:00:21.266 *********** 2026-07-17 12:02:00.202831 | mon1 | changed: [mon1] 2026-07-17 12:02:00.202889 | mon1 | 2026-07-17 12:02:00.202987 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-07-17 12:02:00.203358 | mon1 | Friday 17 July 2026 12:02:00 +0000 (0:00:00.703) 0:00:21.969 *********** 2026-07-17 12:02:00.203687 | mon1 | 2026-07-17 12:02:00.203707 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-07-17 12:02:00.203713 | mon1 | Friday 17 July 2026 12:02:00 +0000 (0:00:00.007) 0:00:21.976 *********** 2026-07-17 12:02:01.139767 | mon1 | ok: [mon1] 2026-07-17 12:02:01.140178 | mon1 | 2026-07-17 12:02:01.140196 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-07-17 12:02:01.140203 | mon1 | Friday 17 July 2026 12:02:01 +0000 (0:00:00.936) 0:00:22.913 *********** 2026-07-17 12:02:01.661880 | mon1 | changed: [mon1] 2026-07-17 12:02:01.661971 | mon1 | 2026-07-17 12:02:01.662414 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-07-17 12:02:01.662461 | mon1 | Friday 17 July 2026 12:02:01 +0000 (0:00:00.522) 0:00:23.435 *********** 2026-07-17 12:02:02.234659 | mon1 | changed: [mon1] 2026-07-17 12:02:02.234757 | mon1 | 2026-07-17 12:02:02.234791 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-17 12:02:02.235135 | mon1 | Friday 17 July 2026 12:02:02 +0000 (0:00:00.573) 0:00:24.008 *********** 2026-07-17 12:02:02.532757 | mon1 | ok: [mon1] 2026-07-17 12:02:02.532846 | mon1 | 2026-07-17 12:02:02.533077 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-17 12:02:02.533125 | mon1 | Friday 17 July 2026 12:02:02 +0000 (0:00:00.297) 0:00:24.306 *********** 2026-07-17 12:02:02.616130 | mon1 | ok: [mon1] => { 2026-07-17 12:02:02.616196 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-07-17 12:02:02.616827 | mon1 | } 2026-07-17 12:02:02.617078 | mon1 | 2026-07-17 12:02:02.617094 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-17 12:02:02.617104 | mon1 | Friday 17 July 2026 12:02:02 +0000 (0:00:00.083) 0:00:24.389 *********** 2026-07-17 12:02:03.577579 | mon1 | changed: [mon1] 2026-07-17 12:02:03.577693 | mon1 | 2026-07-17 12:02:03.577703 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-17 12:02:03.577814 | mon1 | Friday 17 July 2026 12:02:03 +0000 (0:00:00.961) 0:00:25.351 *********** 2026-07-17 12:02:09.238026 | mon1 | changed: [mon1] 2026-07-17 12:02:09.238120 | mon1 | 2026-07-17 12:02:09.238386 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-07-17 12:02:09.238438 | mon1 | Friday 17 July 2026 12:02:09 +0000 (0:00:05.660) 0:00:31.011 *********** 2026-07-17 12:02:10.535731 | mon1 | ok: [mon1] 2026-07-17 12:02:10.535811 | mon1 | 2026-07-17 12:02:10.536169 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-07-17 12:02:10.536221 | mon1 | Friday 17 July 2026 12:02:10 +0000 (0:00:01.297) 0:00:32.309 *********** 2026-07-17 12:02:11.004997 | mon1 | changed: [mon1] 2026-07-17 12:02:11.005072 | mon1 | 2026-07-17 12:02:11.005265 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-07-17 12:02:11.005308 | mon1 | Friday 17 July 2026 12:02:11 +0000 (0:00:00.469) 0:00:32.778 *********** 2026-07-17 12:02:11.643161 | mon1 | changed: [mon1] 2026-07-17 12:02:11.643302 | mon1 | 2026-07-17 12:02:11.643677 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-07-17 12:02:11.643736 | mon1 | Friday 17 July 2026 12:02:11 +0000 (0:00:00.637) 0:00:33.416 *********** 2026-07-17 12:02:12.464013 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-07-17 12:02:12.464124 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-07-17 12:02:12.464533 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-07-17 12:02:12.464590 | mon1 | 2026-07-17 12:02:12.464596 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-07-17 12:02:12.464602 | mon1 | Friday 17 July 2026 12:02:12 +0000 (0:00:00.821) 0:00:34.237 *********** 2026-07-17 12:02:13.093247 | mon1 | changed: [mon1] 2026-07-17 12:02:13.093387 | mon1 | 2026-07-17 12:02:13.093735 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-07-17 12:02:13.093757 | mon1 | Friday 17 July 2026 12:02:13 +0000 (0:00:00.629) 0:00:34.866 *********** 2026-07-17 12:02:13.705989 | mon1 | changed: [mon1] 2026-07-17 12:02:13.706077 | mon1 | 2026-07-17 12:02:13.706702 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-07-17 12:02:13.706756 | mon1 | Friday 17 July 2026 12:02:13 +0000 (0:00:00.604) 0:00:35.471 *********** 2026-07-17 12:02:13.706763 | mon1 | 2026-07-17 12:02:13.706769 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-07-17 12:02:13.706774 | mon1 | Friday 17 July 2026 12:02:13 +0000 (0:00:00.008) 0:00:35.479 *********** 2026-07-17 12:02:14.465114 | mon1 | ok: [mon1] 2026-07-17 12:02:14.465232 | mon1 | 2026-07-17 12:02:14.465589 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-07-17 12:02:14.465640 | mon1 | Friday 17 July 2026 12:02:14 +0000 (0:00:00.758) 0:00:36.238 *********** 2026-07-17 12:02:15.530572 | mon1 | changed: [mon1] 2026-07-17 12:02:15.530660 | mon1 | 2026-07-17 12:02:15.530858 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-07-17 12:02:15.530905 | mon1 | Friday 17 July 2026 12:02:15 +0000 (0:00:01.065) 0:00:37.304 *********** 2026-07-17 12:02:16.142709 | mon1 | changed: [mon1] 2026-07-17 12:02:16.142998 | mon1 | 2026-07-17 12:02:16.143012 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-07-17 12:02:16.143022 | mon1 | Friday 17 July 2026 12:02:16 +0000 (0:00:00.612) 0:00:37.916 *********** 2026-07-17 12:02:16.195694 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-07-17 12:02:16.195738 | mon1 | 2026-07-17 12:02:16.195744 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-07-17 12:02:16.195749 | mon1 | Friday 17 July 2026 12:02:16 +0000 (0:00:00.052) 0:00:37.969 *********** 2026-07-17 12:02:43.014646 | mon1 | changed: [mon1] 2026-07-17 12:02:43.015324 | mon1 | 2026-07-17 12:02:43.015387 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-07-17 12:02:43.015420 | mon1 | Friday 17 July 2026 12:02:43 +0000 (0:00:26.817) 0:01:04.786 *********** 2026-07-17 12:02:43.798207 | mon1 | ok: [mon1] => (item=chronyd) 2026-07-17 12:02:43.798265 | mon1 | ok: [mon1] => (item=sshd) 2026-07-17 12:02:43.798272 | mon1 | 2026-07-17 12:02:43.798279 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-07-17 12:02:43.798285 | mon1 | Friday 17 July 2026 12:02:43 +0000 (0:00:00.784) 0:01:05.570 *********** 2026-07-17 12:02:44.558800 | mon1 | changed: [mon1] 2026-07-17 12:02:44.558874 | mon1 | 2026-07-17 12:02:44.559157 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-07-17 12:02:44.559233 | mon1 | Friday 17 July 2026 12:02:44 +0000 (0:00:00.761) 0:01:06.332 *********** 2026-07-17 12:02:44.869257 | mon1 | ok: [mon1] 2026-07-17 12:02:44.869316 | mon1 | 2026-07-17 12:02:44.869576 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-07-17 12:02:44.869594 | mon1 | Friday 17 July 2026 12:02:44 +0000 (0:00:00.310) 0:01:06.642 *********** 2026-07-17 12:02:45.738879 | mon1 | changed: [mon1] 2026-07-17 12:02:45.738974 | mon1 | 2026-07-17 12:02:45.739053 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-07-17 12:02:45.739160 | mon1 | Friday 17 July 2026 12:02:45 +0000 (0:00:00.869) 0:01:07.512 *********** 2026-07-17 12:02:46.159657 | mon1 | changed: [mon1] 2026-07-17 12:02:46.159763 | mon1 | 2026-07-17 12:02:46.159775 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-07-17 12:02:46.159923 | mon1 | Friday 17 July 2026 12:02:46 +0000 (0:00:00.420) 0:01:07.933 *********** 2026-07-17 12:02:46.454431 | mon1 | ok: [mon1] 2026-07-17 12:02:46.454522 | mon1 | 2026-07-17 12:02:46.454536 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-07-17 12:02:46.454642 | mon1 | Friday 17 July 2026 12:02:46 +0000 (0:00:00.294) 0:01:08.227 *********** 2026-07-17 12:02:46.760186 | mon1 | ok: [mon1] => (item=mon1) 2026-07-17 12:02:46.760259 | mon1 | 2026-07-17 12:02:46.760430 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-07-17 12:02:46.760551 | mon1 | Friday 17 July 2026 12:02:46 +0000 (0:00:00.306) 0:01:08.534 *********** 2026-07-17 12:02:46.804761 | mon1 | ok: [mon1] 2026-07-17 12:02:46.804846 | mon1 | 2026-07-17 12:02:46.804922 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-07-17 12:02:46.805045 | mon1 | Friday 17 July 2026 12:02:46 +0000 (0:00:00.044) 0:01:08.578 *********** 2026-07-17 12:02:46.876764 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-07-17 12:02:46.876859 | mon1 | 2026-07-17 12:02:46.877080 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-07-17 12:02:46.877130 | mon1 | Friday 17 July 2026 12:02:46 +0000 (0:00:00.071) 0:01:08.650 *********** 2026-07-17 12:02:47.260326 | mon1 | changed: [mon1] 2026-07-17 12:02:47.260395 | mon1 | 2026-07-17 12:02:47.260609 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-07-17 12:02:47.260661 | mon1 | Friday 17 July 2026 12:02:47 +0000 (0:00:00.383) 0:01:09.034 *********** 2026-07-17 12:02:48.183737 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-07-17 12:02:48.183829 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-07-17 12:02:48.184439 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-07-17 12:02:48.184496 | mon1 | 2026-07-17 12:02:48.184504 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-07-17 12:02:48.184511 | mon1 | Friday 17 July 2026 12:02:48 +0000 (0:00:00.922) 0:01:09.956 *********** 2026-07-17 12:04:20.376559 | mon1 | ok: [mon1] 2026-07-17 12:04:20.376642 | mon1 | 2026-07-17 12:04:20.376906 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-07-17 12:04:20.377231 | mon1 | Friday 17 July 2026 12:04:20 +0000 (0:01:32.193) 0:02:42.150 *********** 2026-07-17 12:04:20.670487 | mon1 | changed: [mon1] 2026-07-17 12:04:20.670599 | mon1 | 2026-07-17 12:04:20.670607 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-07-17 12:04:20.670674 | mon1 | Friday 17 July 2026 12:04:20 +0000 (0:00:00.293) 0:02:42.443 *********** 2026-07-17 12:04:20.714160 | mon1 | ok: [mon1] 2026-07-17 12:04:20.714240 | mon1 | 2026-07-17 12:04:20.714248 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-07-17 12:04:20.714255 | mon1 | Friday 17 July 2026 12:04:20 +0000 (0:00:00.042) 0:02:42.486 *********** 2026-07-17 12:04:20.810747 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-07-17 12:04:20.810828 | mon1 | 2026-07-17 12:04:20.810837 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-07-17 12:04:20.810844 | mon1 | Friday 17 July 2026 12:04:20 +0000 (0:00:00.096) 0:02:42.583 *********** 2026-07-17 12:04:26.468590 | mon1 | ok: [mon1] 2026-07-17 12:04:26.468693 | mon1 | 2026-07-17 12:04:26.468986 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-07-17 12:04:26.469052 | mon1 | Friday 17 July 2026 12:04:26 +0000 (0:00:05.658) 0:02:48.242 *********** 2026-07-17 12:04:26.539760 | mon1 | ok: [mon1] => (item=mon1) 2026-07-17 12:04:26.539845 | mon1 | 2026-07-17 12:04:26.539851 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-07-17 12:04:26.539856 | mon1 | Friday 17 July 2026 12:04:26 +0000 (0:00:00.070) 0:02:48.312 *********** 2026-07-17 12:04:27.014385 | mon1 | ok: [mon1] 2026-07-17 12:04:27.014455 | mon1 | 2026-07-17 12:04:27.014462 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-07-17 12:04:27.014468 | mon1 | Friday 17 July 2026 12:04:27 +0000 (0:00:00.474) 0:02:48.787 *********** 2026-07-17 12:04:34.653358 | mon1 | ok: [mon1] 2026-07-17 12:04:34.653447 | mon1 | 2026-07-17 12:04:34.653520 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-07-17 12:04:34.653635 | mon1 | Friday 17 July 2026 12:04:34 +0000 (0:00:07.640) 0:02:56.427 *********** 2026-07-17 12:04:47.265046 | mon1 | changed: [mon1] 2026-07-17 12:04:47.265495 | mon1 | 2026-07-17 12:04:47.265545 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-07-17 12:04:47.265554 | mon1 | Friday 17 July 2026 12:04:47 +0000 (0:00:12.611) 0:03:09.038 *********** 2026-07-17 12:05:01.452747 | mon1 | ok: [mon1] 2026-07-17 12:05:01.452853 | mon1 | 2026-07-17 12:05:01.452981 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-07-17 12:05:01.453133 | mon1 | Friday 17 July 2026 12:05:01 +0000 (0:00:14.188) 0:03:23.226 *********** 2026-07-17 12:05:01.523808 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-07-17 12:05:01.523876 | mon1 | 2026-07-17 12:05:01.524074 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-07-17 12:05:01.524129 | mon1 | Friday 17 July 2026 12:05:01 +0000 (0:00:00.071) 0:03:23.297 *********** 2026-07-17 12:05:01.570014 | mon1 | skipping: [mon1] 2026-07-17 12:05:01.570099 | mon1 | 2026-07-17 12:05:01.570177 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-07-17 12:05:01.570299 | mon1 | Friday 17 July 2026 12:05:01 +0000 (0:00:00.045) 0:03:23.343 *********** 2026-07-17 12:05:01.616319 | mon1 | skipping: [mon1] => (item=mon1) 2026-07-17 12:05:01.616395 | mon1 | skipping: [mon1] 2026-07-17 12:05:01.616454 | mon1 | 2026-07-17 12:05:01.616676 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-07-17 12:05:01.616721 | mon1 | Friday 17 July 2026 12:05:01 +0000 (0:00:00.046) 0:03:23.389 *********** 2026-07-17 12:05:01.924915 | mon1 | ok: [mon1] 2026-07-17 12:05:01.924983 | mon1 | 2026-07-17 12:05:01.925053 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-07-17 12:05:01.925195 | mon1 | Friday 17 July 2026 12:05:01 +0000 (0:00:00.308) 0:03:23.698 *********** 2026-07-17 12:05:08.700268 | mon1 | ok: [mon1] 2026-07-17 12:05:08.700381 | mon1 | 2026-07-17 12:05:08.700688 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-07-17 12:05:08.700710 | mon1 | Friday 17 July 2026 12:05:08 +0000 (0:00:06.775) 0:03:30.473 *********** 2026-07-17 12:05:20.793517 | mon1 | changed: [mon1] 2026-07-17 12:05:20.793598 | mon1 | 2026-07-17 12:05:20.793671 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-07-17 12:05:20.793770 | mon1 | Friday 17 July 2026 12:05:20 +0000 (0:00:12.093) 0:03:42.567 *********** 2026-07-17 12:05:26.921475 | mon1 | ok: [mon1] 2026-07-17 12:05:26.921559 | mon1 | 2026-07-17 12:05:26.921907 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-07-17 12:05:26.921953 | mon1 | Friday 17 July 2026 12:05:26 +0000 (0:00:06.127) 0:03:48.695 *********** 2026-07-17 12:05:34.148300 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-07-17 12:05:34.148353 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-07-17 12:05:34.149084 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-07-17 12:05:34.149100 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-07-17 12:05:34.149106 | mon1 | 2026-07-17 12:05:34.149111 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-07-17 12:05:34.149115 | mon1 | 2026-07-17 12:05:34.149119 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-07-17 12:05:34.149124 | mon1 | Friday 17 July 2026 12:05:34 +0000 (0:00:07.227) 0:03:55.922 *********** 2026-07-17 12:05:35.334108 | mon1 | [WARNING]: Host 'osd1' is using the discovered Python interpreter at '/usr/bin/python3.10', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.21/reference_appendices/interpreter_discovery.html for more information. 2026-07-17 12:05:35.343362 | mon1 | ok: [osd1] 2026-07-17 12:05:35.343497 | mon1 | 2026-07-17 12:05:35.343648 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-17 12:05:35.343799 | mon1 | Friday 17 July 2026 12:05:35 +0000 (0:00:01.194) 0:03:57.117 *********** 2026-07-17 12:05:35.618908 | mon1 | ok: [osd1] 2026-07-17 12:05:35.618998 | mon1 | 2026-07-17 12:05:35.619088 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-17 12:05:35.619190 | mon1 | Friday 17 July 2026 12:05:35 +0000 (0:00:00.275) 0:03:57.392 *********** 2026-07-17 12:05:35.659336 | mon1 | skipping: [osd1] 2026-07-17 12:05:35.659412 | mon1 | 2026-07-17 12:05:35.659491 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-07-17 12:05:35.659590 | mon1 | Friday 17 July 2026 12:05:35 +0000 (0:00:00.040) 0:03:57.433 *********** 2026-07-17 12:05:35.929821 | mon1 | changed: [osd1] 2026-07-17 12:05:35.929897 | mon1 | 2026-07-17 12:05:35.930024 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-17 12:05:35.930157 | mon1 | Friday 17 July 2026 12:05:35 +0000 (0:00:00.270) 0:03:57.703 *********** 2026-07-17 12:05:35.994593 | mon1 | ok: [osd1] => { 2026-07-17 12:05:35.994710 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-07-17 12:05:35.994793 | mon1 | } 2026-07-17 12:05:35.994931 | mon1 | 2026-07-17 12:05:35.995075 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-17 12:05:35.995308 | mon1 | Friday 17 July 2026 12:05:35 +0000 (0:00:00.064) 0:03:57.768 *********** 2026-07-17 12:05:36.647584 | mon1 | changed: [osd1] 2026-07-17 12:05:36.647697 | mon1 | 2026-07-17 12:05:36.647740 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-17 12:05:36.647922 | mon1 | Friday 17 July 2026 12:05:36 +0000 (0:00:00.652) 0:03:58.420 *********** 2026-07-17 12:05:36.688994 | mon1 | skipping: [osd1] 2026-07-17 12:05:36.689062 | mon1 | 2026-07-17 12:05:36.689239 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-17 12:05:36.689401 | mon1 | Friday 17 July 2026 12:05:36 +0000 (0:00:00.041) 0:03:58.462 *********** 2026-07-17 12:05:36.729730 | mon1 | skipping: [osd1] 2026-07-17 12:05:36.729840 | mon1 | 2026-07-17 12:05:36.730065 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-17 12:05:36.730202 | mon1 | Friday 17 July 2026 12:05:36 +0000 (0:00:00.040) 0:03:58.503 *********** 2026-07-17 12:05:37.005703 | mon1 | ok: [osd1] 2026-07-17 12:05:37.005846 | mon1 | 2026-07-17 12:05:37.005887 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-17 12:05:37.005957 | mon1 | Friday 17 July 2026 12:05:37 +0000 (0:00:00.276) 0:03:58.779 *********** 2026-07-17 12:05:38.306053 | mon1 | ok: [osd1] 2026-07-17 12:05:38.306175 | mon1 | 2026-07-17 12:05:38.306193 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-17 12:05:38.306378 | mon1 | Friday 17 July 2026 12:05:38 +0000 (0:00:01.300) 0:04:00.079 *********** 2026-07-17 12:05:38.379769 | mon1 | ok: [osd1] => { 2026-07-17 12:05:38.379887 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-07-17 12:05:38.379965 | mon1 | } 2026-07-17 12:05:38.380106 | mon1 | 2026-07-17 12:05:38.380270 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-17 12:05:38.380424 | mon1 | Friday 17 July 2026 12:05:38 +0000 (0:00:00.073) 0:04:00.153 *********** 2026-07-17 12:05:39.155586 | mon1 | changed: [osd1] 2026-07-17 12:05:39.155738 | mon1 | 2026-07-17 12:05:39.155751 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-17 12:05:39.155764 | mon1 | Friday 17 July 2026 12:05:39 +0000 (0:00:00.775) 0:04:00.929 *********** 2026-07-17 12:05:42.020539 | mon1 | changed: [osd1] 2026-07-17 12:05:42.020668 | mon1 | 2026-07-17 12:05:42.020682 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-07-17 12:05:42.020737 | mon1 | Friday 17 July 2026 12:05:42 +0000 (0:00:02.864) 0:04:03.793 *********** 2026-07-17 12:05:42.057268 | mon1 | skipping: [osd1] 2026-07-17 12:05:42.057374 | mon1 | 2026-07-17 12:05:42.057385 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-07-17 12:05:42.057513 | mon1 | Friday 17 July 2026 12:05:42 +0000 (0:00:00.036) 0:04:03.830 *********** 2026-07-17 12:05:42.084122 | mon1 | skipping: [osd1] 2026-07-17 12:05:42.084234 | mon1 | 2026-07-17 12:05:42.084303 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-07-17 12:05:42.084433 | mon1 | Friday 17 July 2026 12:05:42 +0000 (0:00:00.026) 0:04:03.857 *********** 2026-07-17 12:05:42.113656 | mon1 | skipping: [osd1] 2026-07-17 12:05:42.113779 | mon1 | 2026-07-17 12:05:42.113794 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-07-17 12:05:42.113831 | mon1 | Friday 17 July 2026 12:05:42 +0000 (0:00:00.029) 0:04:03.887 *********** 2026-07-17 12:05:48.377175 | mon1 | changed: [osd1] 2026-07-17 12:05:48.377263 | mon1 | 2026-07-17 12:05:48.377271 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-07-17 12:05:48.377297 | mon1 | Friday 17 July 2026 12:05:48 +0000 (0:00:06.262) 0:04:10.149 *********** 2026-07-17 12:05:48.976597 | mon1 | changed: [osd1] 2026-07-17 12:05:48.977141 | mon1 | 2026-07-17 12:05:48.977170 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-07-17 12:05:48.977180 | mon1 | Friday 17 July 2026 12:05:48 +0000 (0:00:00.600) 0:04:10.750 *********** 2026-07-17 12:05:50.213059 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-07-17 12:05:50.213137 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-07-17 12:05:50.214026 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-07-17 12:05:50.214074 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-07-17 12:05:50.214082 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-07-17 12:05:50.214090 | mon1 | 2026-07-17 12:05:50.214097 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-07-17 12:05:50.214103 | mon1 | Friday 17 July 2026 12:05:50 +0000 (0:00:01.236) 0:04:11.986 *********** 2026-07-17 12:05:50.896298 | mon1 | changed: [osd1] 2026-07-17 12:05:50.896374 | mon1 | 2026-07-17 12:05:50.896380 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-07-17 12:05:50.896385 | mon1 | Friday 17 July 2026 12:05:50 +0000 (0:00:00.673) 0:04:12.660 *********** 2026-07-17 12:05:50.896389 | mon1 | 2026-07-17 12:05:50.896394 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-07-17 12:05:50.896398 | mon1 | Friday 17 July 2026 12:05:50 +0000 (0:00:00.009) 0:04:12.669 *********** 2026-07-17 12:05:51.654236 | mon1 | ok: [osd1] 2026-07-17 12:05:51.654280 | mon1 | 2026-07-17 12:05:51.654286 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-07-17 12:05:51.654296 | mon1 | Friday 17 July 2026 12:05:51 +0000 (0:00:00.758) 0:04:13.427 *********** 2026-07-17 12:05:52.169868 | mon1 | changed: [osd1] 2026-07-17 12:05:52.169916 | mon1 | 2026-07-17 12:05:52.169924 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-07-17 12:05:52.169931 | mon1 | Friday 17 July 2026 12:05:52 +0000 (0:00:00.515) 0:04:13.942 *********** 2026-07-17 12:05:52.800224 | mon1 | changed: [osd1] 2026-07-17 12:05:52.800291 | mon1 | 2026-07-17 12:05:52.800583 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-17 12:05:52.800634 | mon1 | Friday 17 July 2026 12:05:52 +0000 (0:00:00.631) 0:04:14.573 *********** 2026-07-17 12:05:53.084926 | mon1 | ok: [osd1] 2026-07-17 12:05:53.085004 | mon1 | 2026-07-17 12:05:53.085070 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-17 12:05:53.085192 | mon1 | Friday 17 July 2026 12:05:53 +0000 (0:00:00.284) 0:04:14.858 *********** 2026-07-17 12:05:53.138942 | mon1 | ok: [osd1] => { 2026-07-17 12:05:53.139023 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-07-17 12:05:53.139086 | mon1 | } 2026-07-17 12:05:53.139350 | mon1 | 2026-07-17 12:05:53.139408 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-17 12:05:53.139424 | mon1 | Friday 17 July 2026 12:05:53 +0000 (0:00:00.054) 0:04:14.912 *********** 2026-07-17 12:05:54.079669 | mon1 | changed: [osd1] 2026-07-17 12:05:54.079742 | mon1 | 2026-07-17 12:05:54.079793 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-17 12:05:54.079919 | mon1 | Friday 17 July 2026 12:05:54 +0000 (0:00:00.940) 0:04:15.853 *********** 2026-07-17 12:05:58.553253 | mon1 | changed: [osd1] 2026-07-17 12:05:58.553332 | mon1 | 2026-07-17 12:05:58.553569 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-07-17 12:05:58.553648 | mon1 | Friday 17 July 2026 12:05:58 +0000 (0:00:04.473) 0:04:20.326 *********** 2026-07-17 12:05:59.676627 | mon1 | ok: [osd1] 2026-07-17 12:05:59.676699 | mon1 | 2026-07-17 12:05:59.676784 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-07-17 12:05:59.676918 | mon1 | Friday 17 July 2026 12:05:59 +0000 (0:00:01.123) 0:04:21.450 *********** 2026-07-17 12:05:59.977136 | mon1 | changed: [osd1] 2026-07-17 12:05:59.977213 | mon1 | 2026-07-17 12:05:59.977427 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-07-17 12:05:59.977475 | mon1 | Friday 17 July 2026 12:05:59 +0000 (0:00:00.300) 0:04:21.750 *********** 2026-07-17 12:06:00.596691 | mon1 | changed: [osd1] 2026-07-17 12:06:00.596940 | mon1 | 2026-07-17 12:06:00.596969 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-07-17 12:06:00.596986 | mon1 | Friday 17 July 2026 12:06:00 +0000 (0:00:00.616) 0:04:22.366 *********** 2026-07-17 12:06:01.410310 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-07-17 12:06:01.410407 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-07-17 12:06:01.410476 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-07-17 12:06:01.410574 | mon1 | 2026-07-17 12:06:01.410692 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-07-17 12:06:01.410806 | mon1 | Friday 17 July 2026 12:06:01 +0000 (0:00:00.816) 0:04:23.183 *********** 2026-07-17 12:06:01.993562 | mon1 | changed: [osd1] 2026-07-17 12:06:01.993757 | mon1 | 2026-07-17 12:06:01.993881 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-07-17 12:06:01.994065 | mon1 | Friday 17 July 2026 12:06:01 +0000 (0:00:00.572) 0:04:23.755 *********** 2026-07-17 12:06:02.567267 | mon1 | changed: [osd1] 2026-07-17 12:06:02.567372 | mon1 | 2026-07-17 12:06:02.568484 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-07-17 12:06:02.568584 | mon1 | Friday 17 July 2026 12:06:02 +0000 (0:00:00.578) 0:04:24.333 *********** 2026-07-17 12:06:02.568598 | mon1 | 2026-07-17 12:06:02.568609 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-07-17 12:06:02.568618 | mon1 | Friday 17 July 2026 12:06:02 +0000 (0:00:00.006) 0:04:24.340 *********** 2026-07-17 12:06:03.383474 | mon1 | ok: [osd1] 2026-07-17 12:06:03.383595 | mon1 | 2026-07-17 12:06:03.383607 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-07-17 12:06:03.383761 | mon1 | Friday 17 July 2026 12:06:03 +0000 (0:00:00.816) 0:04:25.156 *********** 2026-07-17 12:06:04.310255 | mon1 | changed: [osd1] 2026-07-17 12:06:04.310335 | mon1 | 2026-07-17 12:06:04.310341 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-07-17 12:06:04.310347 | mon1 | Friday 17 July 2026 12:06:04 +0000 (0:00:00.926) 0:04:26.082 *********** 2026-07-17 12:06:04.964421 | mon1 | changed: [osd1] 2026-07-17 12:06:04.964552 | mon1 | 2026-07-17 12:06:04.964569 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-07-17 12:06:04.964652 | mon1 | Friday 17 July 2026 12:06:04 +0000 (0:00:00.655) 0:04:26.738 *********** 2026-07-17 12:06:05.024680 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-07-17 12:06:05.024757 | mon1 | 2026-07-17 12:06:05.024766 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-07-17 12:06:05.024773 | mon1 | Friday 17 July 2026 12:06:05 +0000 (0:00:00.059) 0:04:26.797 *********** 2026-07-17 12:06:10.567350 | mon1 | changed: [osd1] 2026-07-17 12:06:10.567434 | mon1 | 2026-07-17 12:06:10.567703 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-07-17 12:06:10.567783 | mon1 | Friday 17 July 2026 12:06:10 +0000 (0:00:05.543) 0:04:32.340 *********** 2026-07-17 12:06:11.352341 | mon1 | ok: [osd1] => (item=chronyd) 2026-07-17 12:06:11.352441 | mon1 | ok: [osd1] => (item=sshd) 2026-07-17 12:06:11.352858 | mon1 | 2026-07-17 12:06:11.352922 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-07-17 12:06:11.352930 | mon1 | Friday 17 July 2026 12:06:11 +0000 (0:00:00.784) 0:04:33.125 *********** 2026-07-17 12:06:12.183738 | mon1 | changed: [osd1] 2026-07-17 12:06:12.183826 | mon1 | 2026-07-17 12:06:12.183932 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-07-17 12:06:12.184116 | mon1 | Friday 17 July 2026 12:06:12 +0000 (0:00:00.831) 0:04:33.956 *********** 2026-07-17 12:06:12.440186 | mon1 | ok: [osd1] 2026-07-17 12:06:12.440323 | mon1 | 2026-07-17 12:06:12.440343 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-07-17 12:06:12.440502 | mon1 | Friday 17 July 2026 12:06:12 +0000 (0:00:00.256) 0:04:34.213 *********** 2026-07-17 12:06:12.823406 | mon1 | changed: [osd1] 2026-07-17 12:06:12.823478 | mon1 | 2026-07-17 12:06:12.823591 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-07-17 12:06:12.823717 | mon1 | Friday 17 July 2026 12:06:12 +0000 (0:00:00.383) 0:04:34.596 *********** 2026-07-17 12:06:13.101915 | mon1 | changed: [osd1] 2026-07-17 12:06:13.102134 | mon1 | 2026-07-17 12:06:13.102361 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-07-17 12:06:13.102698 | mon1 | Friday 17 July 2026 12:06:13 +0000 (0:00:00.278) 0:04:34.875 *********** 2026-07-17 12:06:13.402037 | mon1 | ok: [osd1 -> mon1(199.19.213.175)] => (item=mon1) 2026-07-17 12:06:13.402230 | mon1 | 2026-07-17 12:06:13.402521 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-07-17 12:06:13.402743 | mon1 | Friday 17 July 2026 12:06:13 +0000 (0:00:00.299) 0:04:35.174 *********** 2026-07-17 12:06:13.455517 | mon1 | ok: [osd1] 2026-07-17 12:06:13.455689 | mon1 | 2026-07-17 12:06:13.455918 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-07-17 12:06:13.456134 | mon1 | Friday 17 July 2026 12:06:13 +0000 (0:00:00.053) 0:04:35.228 *********** 2026-07-17 12:06:13.525616 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-07-17 12:06:13.525728 | mon1 | 2026-07-17 12:06:13.525843 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-07-17 12:06:13.526036 | mon1 | Friday 17 July 2026 12:06:13 +0000 (0:00:00.070) 0:04:35.298 *********** 2026-07-17 12:06:19.648919 | mon1 | ok: [osd1 -> mon1(199.19.213.175)] 2026-07-17 12:06:19.648988 | mon1 | 2026-07-17 12:06:19.649003 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-07-17 12:06:19.649014 | mon1 | Friday 17 July 2026 12:06:19 +0000 (0:00:06.122) 0:04:41.421 *********** 2026-07-17 12:06:19.694347 | mon1 | ok: [osd1] => (item=osd1) 2026-07-17 12:06:19.694433 | mon1 | 2026-07-17 12:06:19.694681 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-07-17 12:06:19.694738 | mon1 | Friday 17 July 2026 12:06:19 +0000 (0:00:00.046) 0:04:41.467 *********** 2026-07-17 12:06:20.053318 | mon1 | changed: [osd1] 2026-07-17 12:06:20.053411 | mon1 | 2026-07-17 12:06:20.053812 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-07-17 12:06:20.053864 | mon1 | Friday 17 July 2026 12:06:20 +0000 (0:00:00.359) 0:04:41.826 *********** 2026-07-17 12:06:29.027877 | mon1 | ok: [osd1 -> mon1(199.19.213.175)] 2026-07-17 12:06:29.027925 | mon1 | 2026-07-17 12:06:29.027931 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-07-17 12:06:29.027936 | mon1 | Friday 17 July 2026 12:06:29 +0000 (0:00:08.974) 0:04:50.801 *********** 2026-07-17 12:06:30.651124 | mon1 | ok: [osd1] 2026-07-17 12:06:30.651231 | mon1 | 2026-07-17 12:06:30.651475 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-07-17 12:06:30.651529 | mon1 | Friday 17 July 2026 12:06:30 +0000 (0:00:01.623) 0:04:52.424 *********** 2026-07-17 12:07:12.145138 | mon1 | ok: [osd1] 2026-07-17 12:07:12.145197 | mon1 | 2026-07-17 12:07:12.145203 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-07-17 12:07:12.145208 | mon1 | Friday 17 July 2026 12:07:12 +0000 (0:00:41.493) 0:05:33.918 *********** 2026-07-17 12:08:46.713755 | mon1 | ok: [osd1 -> mon1(199.19.213.175)] => (item=/dev/ceph-osd1-osd0/data) 2026-07-17 12:08:46.713821 | mon1 | ok: [osd1 -> mon1(199.19.213.175)] => (item=/dev/ceph-osd1-osd1/data) 2026-07-17 12:08:46.713829 | mon1 | ok: [osd1 -> mon1(199.19.213.175)] => (item=/dev/ceph-osd1-osd2/data) 2026-07-17 12:08:46.713847 | mon1 | 2026-07-17 12:08:46.713853 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-07-17 12:08:46.713859 | mon1 | Friday 17 July 2026 12:08:46 +0000 (0:01:34.566) 0:07:08.484 *********** 2026-07-17 12:08:53.024873 | mon1 | ok: [osd1 -> mon1(199.19.213.175)] 2026-07-17 12:08:53.024953 | mon1 | 2026-07-17 12:08:53.025314 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-07-17 12:08:53.025366 | mon1 | Friday 17 July 2026 12:08:53 +0000 (0:00:06.313) 0:07:14.798 *********** 2026-07-17 12:08:59.147729 | mon1 | ok: [osd1 -> mon1(199.19.213.175)] 2026-07-17 12:08:59.147856 | mon1 | 2026-07-17 12:08:59.147864 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-07-17 12:08:59.148023 | mon1 | Friday 17 July 2026 12:08:59 +0000 (0:00:06.122) 0:07:20.921 *********** 2026-07-17 12:08:59.209780 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-07-17 12:08:59.209849 | mon1 | 2026-07-17 12:08:59.210094 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-07-17 12:08:59.210141 | mon1 | Friday 17 July 2026 12:08:59 +0000 (0:00:00.062) 0:07:20.983 *********** 2026-07-17 12:08:59.256157 | mon1 | ok: [osd1] 2026-07-17 12:08:59.256231 | mon1 | 2026-07-17 12:08:59.256478 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-07-17 12:08:59.256596 | mon1 | Friday 17 July 2026 12:08:59 +0000 (0:00:00.046) 0:07:21.029 *********** 2026-07-17 12:09:05.595256 | mon1 | ok: [osd1 -> mon1(199.19.213.175)] 2026-07-17 12:09:05.595338 | mon1 | 2026-07-17 12:09:05.595633 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-07-17 12:09:05.595913 | mon1 | Friday 17 July 2026 12:09:05 +0000 (0:00:06.338) 0:07:27.367 *********** 2026-07-17 12:09:05.638526 | mon1 | ok: [osd1] 2026-07-17 12:09:05.638627 | mon1 | 2026-07-17 12:09:05.638682 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-07-17 12:09:05.638833 | mon1 | Friday 17 July 2026 12:09:05 +0000 (0:00:00.044) 0:07:27.412 *********** 2026-07-17 12:09:05.683262 | mon1 | skipping: [osd1] => (item=1) 2026-07-17 12:09:05.683359 | mon1 | skipping: [osd1] => (item=1) 2026-07-17 12:09:05.683827 | mon1 | skipping: [osd1] => (item=1) 2026-07-17 12:09:05.683879 | mon1 | skipping: [osd1] 2026-07-17 12:09:05.683888 | mon1 | 2026-07-17 12:09:05.683894 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-07-17 12:09:05.683901 | mon1 | Friday 17 July 2026 12:09:05 +0000 (0:00:00.044) 0:07:27.456 *********** 2026-07-17 12:09:05.742053 | mon1 | skipping: [osd1] 2026-07-17 12:09:05.742144 | mon1 | 2026-07-17 12:09:05.742210 | mon1 | PLAY [Deploy Ceph exporters] *************************************************** 2026-07-17 12:09:05.742509 | mon1 | 2026-07-17 12:09:05.742561 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-07-17 12:09:05.742569 | mon1 | Friday 17 July 2026 12:09:05 +0000 (0:00:00.059) 0:07:27.516 *********** 2026-07-17 12:09:06.696158 | mon1 | ok: [mon1] 2026-07-17 12:09:06.696236 | mon1 | 2026-07-17 12:09:06.696587 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-17 12:09:06.696635 | mon1 | Friday 17 July 2026 12:09:06 +0000 (0:00:00.953) 0:07:28.469 *********** 2026-07-17 12:09:06.994318 | mon1 | ok: [mon1] 2026-07-17 12:09:06.994443 | mon1 | 2026-07-17 12:09:06.994735 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-17 12:09:06.994791 | mon1 | Friday 17 July 2026 12:09:06 +0000 (0:00:00.298) 0:07:28.767 *********** 2026-07-17 12:09:07.026855 | mon1 | skipping: [mon1] 2026-07-17 12:09:07.026923 | mon1 | 2026-07-17 12:09:07.027178 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-07-17 12:09:07.027276 | mon1 | Friday 17 July 2026 12:09:07 +0000 (0:00:00.032) 0:07:28.800 *********** 2026-07-17 12:09:07.297694 | mon1 | ok: [mon1] 2026-07-17 12:09:07.297810 | mon1 | 2026-07-17 12:09:07.297853 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-17 12:09:07.297988 | mon1 | Friday 17 July 2026 12:09:07 +0000 (0:00:00.270) 0:07:29.071 *********** 2026-07-17 12:09:07.356826 | mon1 | ok: [mon1] => { 2026-07-17 12:09:07.356902 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-07-17 12:09:07.357450 | mon1 | } 2026-07-17 12:09:07.357502 | mon1 | 2026-07-17 12:09:07.357510 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-17 12:09:07.357517 | mon1 | Friday 17 July 2026 12:09:07 +0000 (0:00:00.058) 0:07:29.130 *********** 2026-07-17 12:09:07.758459 | mon1 | ok: [mon1] 2026-07-17 12:09:07.758554 | mon1 | 2026-07-17 12:09:07.758865 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-17 12:09:07.758920 | mon1 | Friday 17 July 2026 12:09:07 +0000 (0:00:00.401) 0:07:29.531 *********** 2026-07-17 12:09:07.794489 | mon1 | skipping: [mon1] 2026-07-17 12:09:07.794568 | mon1 | 2026-07-17 12:09:07.794862 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-17 12:09:07.794912 | mon1 | Friday 17 July 2026 12:09:07 +0000 (0:00:00.036) 0:07:29.568 *********** 2026-07-17 12:09:07.829358 | mon1 | skipping: [mon1] 2026-07-17 12:09:07.829419 | mon1 | 2026-07-17 12:09:07.829716 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-17 12:09:07.829767 | mon1 | Friday 17 July 2026 12:09:07 +0000 (0:00:00.034) 0:07:29.602 *********** 2026-07-17 12:09:08.077199 | mon1 | ok: [mon1] 2026-07-17 12:09:08.077285 | mon1 | 2026-07-17 12:09:08.077538 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-17 12:09:08.077598 | mon1 | Friday 17 July 2026 12:09:08 +0000 (0:00:00.248) 0:07:29.850 *********** 2026-07-17 12:09:09.397716 | mon1 | ok: [mon1] 2026-07-17 12:09:09.397794 | mon1 | 2026-07-17 12:09:09.397860 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-17 12:09:09.398024 | mon1 | Friday 17 July 2026 12:09:09 +0000 (0:00:01.319) 0:07:31.170 *********** 2026-07-17 12:09:09.477187 | mon1 | ok: [mon1] => { 2026-07-17 12:09:09.477315 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-07-17 12:09:09.477382 | mon1 | } 2026-07-17 12:09:09.477926 | mon1 | 2026-07-17 12:09:09.477991 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-17 12:09:09.478001 | mon1 | Friday 17 July 2026 12:09:09 +0000 (0:00:00.079) 0:07:31.250 *********** 2026-07-17 12:09:09.998009 | mon1 | ok: [mon1] 2026-07-17 12:09:09.998160 | mon1 | 2026-07-17 12:09:09.998577 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-17 12:09:09.998636 | mon1 | Friday 17 July 2026 12:09:09 +0000 (0:00:00.520) 0:07:31.771 *********** 2026-07-17 12:09:12.088800 | mon1 | ok: [mon1] 2026-07-17 12:09:12.088881 | mon1 | 2026-07-17 12:09:12.089094 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-07-17 12:09:12.089139 | mon1 | Friday 17 July 2026 12:09:12 +0000 (0:00:02.091) 0:07:33.862 *********** 2026-07-17 12:09:12.112914 | mon1 | skipping: [mon1] 2026-07-17 12:09:12.113002 | mon1 | 2026-07-17 12:09:12.113307 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-07-17 12:09:12.113356 | mon1 | Friday 17 July 2026 12:09:12 +0000 (0:00:00.023) 0:07:33.886 *********** 2026-07-17 12:09:12.139854 | mon1 | skipping: [mon1] 2026-07-17 12:09:12.139926 | mon1 | 2026-07-17 12:09:12.140150 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-07-17 12:09:12.140191 | mon1 | Friday 17 July 2026 12:09:12 +0000 (0:00:00.026) 0:07:33.913 *********** 2026-07-17 12:09:12.169219 | mon1 | skipping: [mon1] 2026-07-17 12:09:12.169283 | mon1 | 2026-07-17 12:09:12.169611 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-07-17 12:09:12.169663 | mon1 | Friday 17 July 2026 12:09:12 +0000 (0:00:00.029) 0:07:33.942 *********** 2026-07-17 12:09:13.435678 | mon1 | ok: [mon1] 2026-07-17 12:09:13.435798 | mon1 | 2026-07-17 12:09:13.436183 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-07-17 12:09:13.436234 | mon1 | Friday 17 July 2026 12:09:13 +0000 (0:00:01.266) 0:07:35.209 *********** 2026-07-17 12:09:14.000657 | mon1 | ok: [mon1] 2026-07-17 12:09:14.001193 | mon1 | 2026-07-17 12:09:14.001238 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-07-17 12:09:14.001246 | mon1 | Friday 17 July 2026 12:09:13 +0000 (0:00:00.565) 0:07:35.774 *********** 2026-07-17 12:09:15.227339 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-07-17 12:09:15.227454 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-07-17 12:09:15.228588 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-07-17 12:09:15.228644 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-07-17 12:09:15.228653 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-07-17 12:09:15.228661 | mon1 | 2026-07-17 12:09:15.228675 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-07-17 12:09:15.228696 | mon1 | Friday 17 July 2026 12:09:15 +0000 (0:00:01.226) 0:07:37.000 *********** 2026-07-17 12:09:15.890243 | mon1 | ok: [mon1] 2026-07-17 12:09:15.890342 | mon1 | 2026-07-17 12:09:15.890376 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-07-17 12:09:15.890873 | mon1 | Friday 17 July 2026 12:09:15 +0000 (0:00:00.654) 0:07:37.655 *********** 2026-07-17 12:09:15.890926 | mon1 | 2026-07-17 12:09:15.890933 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-07-17 12:09:15.890938 | mon1 | Friday 17 July 2026 12:09:15 +0000 (0:00:00.008) 0:07:37.663 *********** 2026-07-17 12:09:16.324513 | mon1 | ok: [mon1] 2026-07-17 12:09:16.324588 | mon1 | 2026-07-17 12:09:16.324852 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-17 12:09:16.324903 | mon1 | Friday 17 July 2026 12:09:16 +0000 (0:00:00.434) 0:07:38.098 *********** 2026-07-17 12:09:16.585831 | mon1 | ok: [mon1] 2026-07-17 12:09:16.585911 | mon1 | 2026-07-17 12:09:16.586211 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-17 12:09:16.586298 | mon1 | Friday 17 July 2026 12:09:16 +0000 (0:00:00.260) 0:07:38.358 *********** 2026-07-17 12:09:16.656625 | mon1 | ok: [mon1] => { 2026-07-17 12:09:16.656744 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-07-17 12:09:16.657269 | mon1 | } 2026-07-17 12:09:16.657334 | mon1 | 2026-07-17 12:09:16.657343 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-17 12:09:16.657350 | mon1 | Friday 17 July 2026 12:09:16 +0000 (0:00:00.071) 0:07:38.430 *********** 2026-07-17 12:09:17.101020 | mon1 | ok: [mon1] 2026-07-17 12:09:17.101562 | mon1 | 2026-07-17 12:09:17.101622 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-17 12:09:17.101631 | mon1 | Friday 17 July 2026 12:09:17 +0000 (0:00:00.444) 0:07:38.874 *********** 2026-07-17 12:09:20.318864 | mon1 | ok: [mon1] 2026-07-17 12:09:20.318959 | mon1 | 2026-07-17 12:09:20.319340 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-07-17 12:09:20.319400 | mon1 | Friday 17 July 2026 12:09:20 +0000 (0:00:03.218) 0:07:42.092 *********** 2026-07-17 12:09:21.469947 | mon1 | ok: [mon1] 2026-07-17 12:09:21.470013 | mon1 | 2026-07-17 12:09:21.470326 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-07-17 12:09:21.470380 | mon1 | Friday 17 July 2026 12:09:21 +0000 (0:00:01.151) 0:07:43.243 *********** 2026-07-17 12:09:21.739840 | mon1 | ok: [mon1] 2026-07-17 12:09:21.739916 | mon1 | 2026-07-17 12:09:21.739978 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-07-17 12:09:21.740113 | mon1 | Friday 17 July 2026 12:09:21 +0000 (0:00:00.270) 0:07:43.513 *********** 2026-07-17 12:09:22.294049 | mon1 | ok: [mon1] 2026-07-17 12:09:22.294123 | mon1 | 2026-07-17 12:09:22.294474 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-07-17 12:09:22.294580 | mon1 | Friday 17 July 2026 12:09:22 +0000 (0:00:00.553) 0:07:44.067 *********** 2026-07-17 12:09:23.054216 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-07-17 12:09:23.054336 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-07-17 12:09:23.054920 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-07-17 12:09:23.054944 | mon1 | 2026-07-17 12:09:23.054952 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-07-17 12:09:23.054958 | mon1 | Friday 17 July 2026 12:09:23 +0000 (0:00:00.760) 0:07:44.827 *********** 2026-07-17 12:09:23.590987 | mon1 | ok: [mon1] 2026-07-17 12:09:23.591094 | mon1 | 2026-07-17 12:09:23.591354 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-07-17 12:09:23.591428 | mon1 | Friday 17 July 2026 12:09:23 +0000 (0:00:00.536) 0:07:45.364 *********** 2026-07-17 12:09:24.181549 | mon1 | ok: [mon1] 2026-07-17 12:09:24.181621 | mon1 | 2026-07-17 12:09:24.182119 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-07-17 12:09:24.182163 | mon1 | Friday 17 July 2026 12:09:24 +0000 (0:00:00.582) 0:07:45.947 *********** 2026-07-17 12:09:24.182168 | mon1 | 2026-07-17 12:09:24.182173 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-07-17 12:09:24.182177 | mon1 | Friday 17 July 2026 12:09:24 +0000 (0:00:00.008) 0:07:45.955 *********** 2026-07-17 12:09:24.611403 | mon1 | ok: [mon1] 2026-07-17 12:09:24.611487 | mon1 | 2026-07-17 12:09:24.611747 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-07-17 12:09:24.611810 | mon1 | Friday 17 July 2026 12:09:24 +0000 (0:00:00.429) 0:07:46.385 *********** 2026-07-17 12:09:24.656715 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-07-17 12:09:24.656804 | mon1 | 2026-07-17 12:09:24.656888 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-07-17 12:09:24.657015 | mon1 | Friday 17 July 2026 12:09:24 +0000 (0:00:00.045) 0:07:46.430 *********** 2026-07-17 12:09:25.752020 | mon1 | ok: [mon1] 2026-07-17 12:09:25.752219 | mon1 | 2026-07-17 12:09:25.752233 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-07-17 12:09:25.752387 | mon1 | Friday 17 July 2026 12:09:25 +0000 (0:00:01.095) 0:07:47.525 *********** 2026-07-17 12:09:26.514187 | mon1 | ok: [mon1] => (item=chronyd) 2026-07-17 12:09:26.514259 | mon1 | ok: [mon1] => (item=sshd) 2026-07-17 12:09:26.514628 | mon1 | 2026-07-17 12:09:26.514679 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-07-17 12:09:26.514686 | mon1 | Friday 17 July 2026 12:09:26 +0000 (0:00:00.762) 0:07:48.287 *********** 2026-07-17 12:09:27.202533 | mon1 | ok: [mon1] 2026-07-17 12:09:27.202608 | mon1 | 2026-07-17 12:09:27.202812 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-07-17 12:09:27.202856 | mon1 | Friday 17 July 2026 12:09:27 +0000 (0:00:00.688) 0:07:48.976 *********** 2026-07-17 12:09:27.460288 | mon1 | ok: [mon1] 2026-07-17 12:09:27.460401 | mon1 | 2026-07-17 12:09:27.460729 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-07-17 12:09:27.460782 | mon1 | Friday 17 July 2026 12:09:27 +0000 (0:00:00.257) 0:07:49.233 *********** 2026-07-17 12:09:27.760551 | mon1 | ok: [mon1] 2026-07-17 12:09:27.760621 | mon1 | 2026-07-17 12:09:27.760854 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-07-17 12:09:27.760897 | mon1 | Friday 17 July 2026 12:09:27 +0000 (0:00:00.300) 0:07:49.534 *********** 2026-07-17 12:09:28.034524 | mon1 | ok: [mon1] 2026-07-17 12:09:28.034664 | mon1 | 2026-07-17 12:09:28.034932 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] *********** 2026-07-17 12:09:28.034991 | mon1 | Friday 17 July 2026 12:09:28 +0000 (0:00:00.273) 0:07:49.808 *********** 2026-07-17 12:09:39.937565 | mon1 | changed: [mon1] 2026-07-17 12:09:39.937625 | mon1 | 2026-07-17 12:09:39.940203 | mon1 | PLAY RECAP ********************************************************************* 2026-07-17 12:09:39.940266 | mon1 | mon1 : ok=93 changed=30 unreachable=0 failed=0 skipped=14 rescued=0 ignored=0 2026-07-17 12:09:39.940277 | mon1 | osd1 : ok=53 changed=24 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-07-17 12:09:39.940282 | mon1 | 2026-07-17 12:09:39.940286 | mon1 | 2026-07-17 12:09:39.940290 | mon1 | TASKS RECAP ******************************************************************** 2026-07-17 12:09:39.940295 | mon1 | Friday 17 July 2026 12:09:39 +0000 (0:00:11.903) 0:08:01.711 *********** 2026-07-17 12:09:39.940299 | mon1 | =============================================================================== 2026-07-17 12:09:39.940303 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 94.57s 2026-07-17 12:09:39.940307 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 92.19s 2026-07-17 12:09:39.940311 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 41.49s 2026-07-17 12:09:39.940315 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 26.82s 2026-07-17 12:09:39.940319 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.19s 2026-07-17 12:09:39.940323 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 12.61s 2026-07-17 12:09:39.940327 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.09s 2026-07-17 12:09:39.940331 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ---------- 11.90s 2026-07-17 12:09:39.940335 | mon1 | vexxhost.containers.containerd : Install AppArmor packages ------------- 10.01s 2026-07-17 12:09:39.940339 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 8.97s 2026-07-17 12:09:39.940343 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.64s 2026-07-17 12:09:39.940347 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.23s 2026-07-17 12:09:39.940352 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.78s 2026-07-17 12:09:39.940356 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.34s 2026-07-17 12:09:39.940360 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.31s 2026-07-17 12:09:39.940364 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 6.26s 2026-07-17 12:09:39.940368 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.13s 2026-07-17 12:09:39.940372 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.12s 2026-07-17 12:09:39.940376 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.12s 2026-07-17 12:09:39.940380 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 5.66s 2026-07-17 12:09:40.121977 | mon1 | INFO [default > converge] Executed: Successful 2026-07-17 12:09:40.130562 | mon1 | INFO [default > idempotence] Executing 2026-07-17 12:09:41.556442 | mon1 | 2026-07-17 12:09:41.556533 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-07-17 12:09:41.556684 | mon1 | 2026-07-17 12:09:41.556819 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-07-17 12:09:41.557169 | mon1 | Friday 17 July 2026 12:09:41 +0000 (0:00:00.074) 0:00:00.074 *********** 2026-07-17 12:09:42.853194 | mon1 | [WARNING]: Host 'mon1' is using the discovered Python interpreter at '/usr/bin/python3.10', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.21/reference_appendices/interpreter_discovery.html for more information. 2026-07-17 12:09:42.865722 | mon1 | ok: [mon1] 2026-07-17 12:09:42.865799 | mon1 | 2026-07-17 12:09:42.865912 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-17 12:09:42.866011 | mon1 | Friday 17 July 2026 12:09:42 +0000 (0:00:01.309) 0:00:01.384 *********** 2026-07-17 12:09:43.324671 | mon1 | ok: [mon1] 2026-07-17 12:09:43.324868 | mon1 | 2026-07-17 12:09:43.325094 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-17 12:09:43.325309 | mon1 | Friday 17 July 2026 12:09:43 +0000 (0:00:00.458) 0:00:01.843 *********** 2026-07-17 12:09:43.367270 | mon1 | skipping: [mon1] 2026-07-17 12:09:43.367484 | mon1 | 2026-07-17 12:09:43.367736 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-07-17 12:09:43.367968 | mon1 | Friday 17 July 2026 12:09:43 +0000 (0:00:00.042) 0:00:01.885 *********** 2026-07-17 12:09:43.852505 | mon1 | ok: [mon1] 2026-07-17 12:09:43.852788 | mon1 | 2026-07-17 12:09:43.853090 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-17 12:09:43.853423 | mon1 | Friday 17 July 2026 12:09:43 +0000 (0:00:00.483) 0:00:02.368 *********** 2026-07-17 12:09:43.929939 | mon1 | ok: [mon1] => { 2026-07-17 12:09:43.930009 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-07-17 12:09:43.930021 | mon1 | } 2026-07-17 12:09:43.930031 | mon1 | 2026-07-17 12:09:43.930041 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-17 12:09:43.930050 | mon1 | Friday 17 July 2026 12:09:43 +0000 (0:00:00.078) 0:00:02.447 *********** 2026-07-17 12:09:44.466161 | mon1 | ok: [mon1] 2026-07-17 12:09:44.466239 | mon1 | 2026-07-17 12:09:44.466431 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-17 12:09:44.466471 | mon1 | Friday 17 July 2026 12:09:44 +0000 (0:00:00.537) 0:00:02.985 *********** 2026-07-17 12:09:44.522574 | mon1 | skipping: [mon1] 2026-07-17 12:09:44.522664 | mon1 | 2026-07-17 12:09:44.523034 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-17 12:09:44.523086 | mon1 | Friday 17 July 2026 12:09:44 +0000 (0:00:00.055) 0:00:03.041 *********** 2026-07-17 12:09:44.561098 | mon1 | skipping: [mon1] 2026-07-17 12:09:44.561176 | mon1 | 2026-07-17 12:09:44.561370 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-17 12:09:44.561412 | mon1 | Friday 17 July 2026 12:09:44 +0000 (0:00:00.038) 0:00:03.079 *********** 2026-07-17 12:09:44.824164 | mon1 | ok: [mon1] 2026-07-17 12:09:44.824213 | mon1 | 2026-07-17 12:09:44.824218 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-17 12:09:44.824224 | mon1 | Friday 17 July 2026 12:09:44 +0000 (0:00:00.262) 0:00:03.342 *********** 2026-07-17 12:09:46.169533 | mon1 | ok: [mon1] 2026-07-17 12:09:46.169655 | mon1 | 2026-07-17 12:09:46.169676 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-17 12:09:46.169893 | mon1 | Friday 17 July 2026 12:09:46 +0000 (0:00:01.345) 0:00:04.688 *********** 2026-07-17 12:09:46.254275 | mon1 | ok: [mon1] => { 2026-07-17 12:09:46.254358 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-07-17 12:09:46.254424 | mon1 | } 2026-07-17 12:09:46.254770 | mon1 | 2026-07-17 12:09:46.254846 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-17 12:09:46.254852 | mon1 | Friday 17 July 2026 12:09:46 +0000 (0:00:00.084) 0:00:04.772 *********** 2026-07-17 12:09:46.703939 | mon1 | ok: [mon1] 2026-07-17 12:09:46.704058 | mon1 | 2026-07-17 12:09:46.704135 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-17 12:09:46.704309 | mon1 | Friday 17 July 2026 12:09:46 +0000 (0:00:00.450) 0:00:05.222 *********** 2026-07-17 12:09:49.165028 | mon1 | ok: [mon1] 2026-07-17 12:09:49.165118 | mon1 | 2026-07-17 12:09:49.165180 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-07-17 12:09:49.165311 | mon1 | Friday 17 July 2026 12:09:49 +0000 (0:00:02.461) 0:00:07.683 *********** 2026-07-17 12:09:49.198625 | mon1 | skipping: [mon1] 2026-07-17 12:09:49.199144 | mon1 | 2026-07-17 12:09:49.199197 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-07-17 12:09:49.199236 | mon1 | Friday 17 July 2026 12:09:49 +0000 (0:00:00.032) 0:00:07.716 *********** 2026-07-17 12:09:49.230603 | mon1 | skipping: [mon1] 2026-07-17 12:09:49.231078 | mon1 | 2026-07-17 12:09:49.231127 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-07-17 12:09:49.231135 | mon1 | Friday 17 July 2026 12:09:49 +0000 (0:00:00.032) 0:00:07.749 *********** 2026-07-17 12:09:49.260577 | mon1 | skipping: [mon1] 2026-07-17 12:09:49.260647 | mon1 | 2026-07-17 12:09:49.260871 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-07-17 12:09:49.260925 | mon1 | Friday 17 July 2026 12:09:49 +0000 (0:00:00.029) 0:00:07.778 *********** 2026-07-17 12:09:50.485629 | mon1 | ok: [mon1] 2026-07-17 12:09:50.485904 | mon1 | 2026-07-17 12:09:50.485934 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-07-17 12:09:50.486185 | mon1 | Friday 17 July 2026 12:09:50 +0000 (0:00:01.225) 0:00:09.004 *********** 2026-07-17 12:09:51.018126 | mon1 | ok: [mon1] 2026-07-17 12:09:51.018200 | mon1 | 2026-07-17 12:09:51.018379 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-07-17 12:09:51.018396 | mon1 | Friday 17 July 2026 12:09:51 +0000 (0:00:00.532) 0:00:09.537 *********** 2026-07-17 12:09:52.257685 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-07-17 12:09:52.257762 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-07-17 12:09:52.258744 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-07-17 12:09:52.258795 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-07-17 12:09:52.258810 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-07-17 12:09:52.258817 | mon1 | 2026-07-17 12:09:52.258824 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-07-17 12:09:52.258830 | mon1 | Friday 17 July 2026 12:09:52 +0000 (0:00:01.239) 0:00:10.776 *********** 2026-07-17 12:09:52.908108 | mon1 | ok: [mon1] 2026-07-17 12:09:52.908174 | mon1 | 2026-07-17 12:09:52.908645 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-07-17 12:09:52.908690 | mon1 | Friday 17 July 2026 12:09:52 +0000 (0:00:00.643) 0:00:11.419 *********** 2026-07-17 12:09:52.908695 | mon1 | 2026-07-17 12:09:52.908700 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-07-17 12:09:52.908710 | mon1 | Friday 17 July 2026 12:09:52 +0000 (0:00:00.007) 0:00:11.427 *********** 2026-07-17 12:09:53.583263 | mon1 | ok: [mon1] 2026-07-17 12:09:53.583341 | mon1 | 2026-07-17 12:09:53.583731 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-17 12:09:53.583789 | mon1 | Friday 17 July 2026 12:09:53 +0000 (0:00:00.674) 0:00:12.101 *********** 2026-07-17 12:09:53.849760 | mon1 | ok: [mon1] 2026-07-17 12:09:53.849907 | mon1 | 2026-07-17 12:09:53.849964 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-17 12:09:53.850122 | mon1 | Friday 17 July 2026 12:09:53 +0000 (0:00:00.266) 0:00:12.368 *********** 2026-07-17 12:09:53.922451 | mon1 | ok: [mon1] => { 2026-07-17 12:09:53.922600 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-07-17 12:09:53.923139 | mon1 | } 2026-07-17 12:09:53.923187 | mon1 | 2026-07-17 12:09:53.923195 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-17 12:09:53.923242 | mon1 | Friday 17 July 2026 12:09:53 +0000 (0:00:00.072) 0:00:12.440 *********** 2026-07-17 12:09:54.346909 | mon1 | ok: [mon1] 2026-07-17 12:09:54.347128 | mon1 | 2026-07-17 12:09:54.347325 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-17 12:09:54.347490 | mon1 | Friday 17 July 2026 12:09:54 +0000 (0:00:00.415) 0:00:12.856 *********** 2026-07-17 12:09:57.618816 | mon1 | ok: [mon1] 2026-07-17 12:09:57.618888 | mon1 | 2026-07-17 12:09:57.619073 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-07-17 12:09:57.619090 | mon1 | Friday 17 July 2026 12:09:57 +0000 (0:00:03.281) 0:00:16.137 *********** 2026-07-17 12:09:58.774649 | mon1 | ok: [mon1] 2026-07-17 12:09:58.775354 | mon1 | 2026-07-17 12:09:58.775427 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-07-17 12:09:58.775447 | mon1 | Friday 17 July 2026 12:09:58 +0000 (0:00:01.155) 0:00:17.293 *********** 2026-07-17 12:09:59.152565 | mon1 | ok: [mon1] 2026-07-17 12:09:59.152666 | mon1 | 2026-07-17 12:09:59.152958 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-07-17 12:09:59.152978 | mon1 | Friday 17 July 2026 12:09:59 +0000 (0:00:00.378) 0:00:17.671 *********** 2026-07-17 12:09:59.713374 | mon1 | ok: [mon1] 2026-07-17 12:09:59.713460 | mon1 | 2026-07-17 12:09:59.713780 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-07-17 12:09:59.713828 | mon1 | Friday 17 July 2026 12:09:59 +0000 (0:00:00.560) 0:00:18.232 *********** 2026-07-17 12:10:00.460266 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-07-17 12:10:00.460380 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-07-17 12:10:00.460443 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-07-17 12:10:00.460792 | mon1 | 2026-07-17 12:10:00.460840 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-07-17 12:10:00.460847 | mon1 | Friday 17 July 2026 12:10:00 +0000 (0:00:00.746) 0:00:18.979 *********** 2026-07-17 12:10:00.999540 | mon1 | ok: [mon1] 2026-07-17 12:10:00.999610 | mon1 | 2026-07-17 12:10:00.999702 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-07-17 12:10:00.999840 | mon1 | Friday 17 July 2026 12:10:00 +0000 (0:00:00.539) 0:00:19.518 *********** 2026-07-17 12:10:01.538615 | mon1 | ok: [mon1] 2026-07-17 12:10:01.538695 | mon1 | 2026-07-17 12:10:01.538753 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-07-17 12:10:01.539152 | mon1 | Friday 17 July 2026 12:10:01 +0000 (0:00:00.530) 0:00:20.049 *********** 2026-07-17 12:10:01.539237 | mon1 | 2026-07-17 12:10:01.539245 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-07-17 12:10:01.539250 | mon1 | Friday 17 July 2026 12:10:01 +0000 (0:00:00.008) 0:00:20.057 *********** 2026-07-17 12:10:01.973076 | mon1 | ok: [mon1] 2026-07-17 12:10:01.973153 | mon1 | 2026-07-17 12:10:01.973278 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-07-17 12:10:01.973423 | mon1 | Friday 17 July 2026 12:10:01 +0000 (0:00:00.434) 0:00:20.492 *********** 2026-07-17 12:10:02.026083 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-07-17 12:10:02.026605 | mon1 | 2026-07-17 12:10:02.026655 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-07-17 12:10:02.026663 | mon1 | Friday 17 July 2026 12:10:02 +0000 (0:00:00.052) 0:00:20.544 *********** 2026-07-17 12:10:03.172202 | mon1 | ok: [mon1] 2026-07-17 12:10:03.172369 | mon1 | 2026-07-17 12:10:03.172438 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-07-17 12:10:03.172606 | mon1 | Friday 17 July 2026 12:10:03 +0000 (0:00:01.146) 0:00:21.690 *********** 2026-07-17 12:10:03.953795 | mon1 | ok: [mon1] => (item=chronyd) 2026-07-17 12:10:03.953871 | mon1 | ok: [mon1] => (item=sshd) 2026-07-17 12:10:03.954204 | mon1 | 2026-07-17 12:10:03.954252 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-07-17 12:10:03.954259 | mon1 | Friday 17 July 2026 12:10:03 +0000 (0:00:00.781) 0:00:22.472 *********** 2026-07-17 12:10:04.836672 | mon1 | ok: [mon1] 2026-07-17 12:10:04.836750 | mon1 | 2026-07-17 12:10:04.836967 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-07-17 12:10:04.837013 | mon1 | Friday 17 July 2026 12:10:04 +0000 (0:00:00.883) 0:00:23.355 *********** 2026-07-17 12:10:05.105987 | mon1 | ok: [mon1] 2026-07-17 12:10:05.106050 | mon1 | 2026-07-17 12:10:05.106153 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-07-17 12:10:05.106302 | mon1 | Friday 17 July 2026 12:10:05 +0000 (0:00:00.269) 0:00:23.624 *********** 2026-07-17 12:10:05.556958 | mon1 | ok: [mon1] 2026-07-17 12:10:05.557032 | mon1 | 2026-07-17 12:10:05.557254 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-07-17 12:10:05.557297 | mon1 | Friday 17 July 2026 12:10:05 +0000 (0:00:00.451) 0:00:24.075 *********** 2026-07-17 12:10:05.926804 | mon1 | ok: [mon1] 2026-07-17 12:10:05.926899 | mon1 | 2026-07-17 12:10:05.926920 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-07-17 12:10:05.927047 | mon1 | Friday 17 July 2026 12:10:05 +0000 (0:00:00.369) 0:00:24.445 *********** 2026-07-17 12:10:06.118335 | mon1 | ok: [mon1] 2026-07-17 12:10:06.118443 | mon1 | 2026-07-17 12:10:06.118510 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-07-17 12:10:06.118705 | mon1 | Friday 17 July 2026 12:10:06 +0000 (0:00:00.191) 0:00:24.636 *********** 2026-07-17 12:10:06.405566 | mon1 | ok: [mon1] => (item=mon1) 2026-07-17 12:10:06.405642 | mon1 | 2026-07-17 12:10:06.405992 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-07-17 12:10:06.406045 | mon1 | Friday 17 July 2026 12:10:06 +0000 (0:00:00.287) 0:00:24.924 *********** 2026-07-17 12:10:06.452954 | mon1 | ok: [mon1] 2026-07-17 12:10:06.453017 | mon1 | 2026-07-17 12:10:06.453288 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-07-17 12:10:06.453308 | mon1 | Friday 17 July 2026 12:10:06 +0000 (0:00:00.047) 0:00:24.971 *********** 2026-07-17 12:10:06.489824 | mon1 | skipping: [mon1] 2026-07-17 12:10:06.489897 | mon1 | 2026-07-17 12:10:06.489996 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-07-17 12:10:06.490102 | mon1 | Friday 17 July 2026 12:10:06 +0000 (0:00:00.037) 0:00:25.008 *********** 2026-07-17 12:10:06.563097 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-07-17 12:10:06.563174 | mon1 | 2026-07-17 12:10:06.563348 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-07-17 12:10:06.563417 | mon1 | Friday 17 July 2026 12:10:06 +0000 (0:00:00.073) 0:00:25.081 *********** 2026-07-17 12:10:12.761047 | mon1 | ok: [mon1] 2026-07-17 12:10:12.761133 | mon1 | 2026-07-17 12:10:12.761351 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-07-17 12:10:12.761397 | mon1 | Friday 17 July 2026 12:10:12 +0000 (0:00:06.198) 0:00:31.279 *********** 2026-07-17 12:10:12.814788 | mon1 | ok: [mon1] => (item=mon1) 2026-07-17 12:10:12.814850 | mon1 | 2026-07-17 12:10:12.815052 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-07-17 12:10:12.815097 | mon1 | Friday 17 July 2026 12:10:12 +0000 (0:00:00.053) 0:00:31.333 *********** 2026-07-17 12:10:13.248584 | mon1 | ok: [mon1] 2026-07-17 12:10:13.248666 | mon1 | 2026-07-17 12:10:13.248922 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-07-17 12:10:13.248970 | mon1 | Friday 17 July 2026 12:10:13 +0000 (0:00:00.433) 0:00:31.767 *********** 2026-07-17 12:10:19.865271 | mon1 | ok: [mon1] 2026-07-17 12:10:19.865355 | mon1 | 2026-07-17 12:10:19.865419 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-07-17 12:10:19.865545 | mon1 | Friday 17 July 2026 12:10:19 +0000 (0:00:06.616) 0:00:38.384 *********** 2026-07-17 12:10:26.000523 | mon1 | ok: [mon1] 2026-07-17 12:10:26.000606 | mon1 | 2026-07-17 12:10:26.000849 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-07-17 12:10:26.000894 | mon1 | Friday 17 July 2026 12:10:25 +0000 (0:00:06.135) 0:00:44.519 *********** 2026-07-17 12:10:40.210534 | mon1 | ok: [mon1] 2026-07-17 12:10:40.210622 | mon1 | 2026-07-17 12:10:40.210637 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-07-17 12:10:40.210820 | mon1 | Friday 17 July 2026 12:10:40 +0000 (0:00:14.210) 0:00:58.729 *********** 2026-07-17 12:10:40.284590 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-07-17 12:10:40.284672 | mon1 | 2026-07-17 12:10:40.284737 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-07-17 12:10:40.284865 | mon1 | Friday 17 July 2026 12:10:40 +0000 (0:00:00.074) 0:00:58.803 *********** 2026-07-17 12:10:40.330021 | mon1 | skipping: [mon1] 2026-07-17 12:10:40.330538 | mon1 | 2026-07-17 12:10:40.330592 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-07-17 12:10:40.330601 | mon1 | Friday 17 July 2026 12:10:40 +0000 (0:00:00.044) 0:00:58.848 *********** 2026-07-17 12:10:40.374587 | mon1 | skipping: [mon1] => (item=mon1) 2026-07-17 12:10:40.375268 | mon1 | skipping: [mon1] 2026-07-17 12:10:40.375319 | mon1 | 2026-07-17 12:10:40.375326 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-07-17 12:10:40.375337 | mon1 | Friday 17 July 2026 12:10:40 +0000 (0:00:00.044) 0:00:58.893 *********** 2026-07-17 12:10:40.690513 | mon1 | ok: [mon1] 2026-07-17 12:10:40.691374 | mon1 | 2026-07-17 12:10:40.691437 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-07-17 12:10:40.691449 | mon1 | Friday 17 July 2026 12:10:40 +0000 (0:00:00.314) 0:00:59.208 *********** 2026-07-17 12:10:47.398725 | mon1 | ok: [mon1] 2026-07-17 12:10:47.398801 | mon1 | 2026-07-17 12:10:47.399011 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-07-17 12:10:47.399057 | mon1 | Friday 17 July 2026 12:10:47 +0000 (0:00:06.709) 0:01:05.917 *********** 2026-07-17 12:10:53.482074 | mon1 | ok: [mon1] 2026-07-17 12:10:53.482148 | mon1 | 2026-07-17 12:10:53.482761 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-07-17 12:10:53.482812 | mon1 | Friday 17 July 2026 12:10:53 +0000 (0:00:06.083) 0:01:12.000 *********** 2026-07-17 12:10:59.598741 | mon1 | ok: [mon1] 2026-07-17 12:10:59.599255 | mon1 | 2026-07-17 12:10:59.599301 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-07-17 12:10:59.599311 | mon1 | Friday 17 July 2026 12:10:59 +0000 (0:00:06.116) 0:01:18.117 *********** 2026-07-17 12:11:05.304305 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-07-17 12:11:05.304379 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-07-17 12:11:05.305298 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-07-17 12:11:05.305317 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-07-17 12:11:05.305325 | mon1 | 2026-07-17 12:11:05.305331 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-07-17 12:11:05.305338 | mon1 | 2026-07-17 12:11:05.305344 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-07-17 12:11:05.305350 | mon1 | Friday 17 July 2026 12:11:05 +0000 (0:00:05.706) 0:01:23.823 *********** 2026-07-17 12:11:06.421705 | mon1 | [WARNING]: Host 'osd1' is using the discovered Python interpreter at '/usr/bin/python3.10', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.21/reference_appendices/interpreter_discovery.html for more information. 2026-07-17 12:11:06.429040 | mon1 | ok: [osd1] 2026-07-17 12:11:06.429158 | mon1 | 2026-07-17 12:11:06.429303 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-17 12:11:06.429485 | mon1 | Friday 17 July 2026 12:11:06 +0000 (0:00:01.124) 0:01:24.947 *********** 2026-07-17 12:11:06.682695 | mon1 | ok: [osd1] 2026-07-17 12:11:06.682762 | mon1 | 2026-07-17 12:11:06.682982 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-17 12:11:06.683026 | mon1 | Friday 17 July 2026 12:11:06 +0000 (0:00:00.253) 0:01:25.201 *********** 2026-07-17 12:11:06.722432 | mon1 | skipping: [osd1] 2026-07-17 12:11:06.722504 | mon1 | 2026-07-17 12:11:06.722707 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-07-17 12:11:06.722756 | mon1 | Friday 17 July 2026 12:11:06 +0000 (0:00:00.039) 0:01:25.241 *********** 2026-07-17 12:11:06.993299 | mon1 | ok: [osd1] 2026-07-17 12:11:06.993371 | mon1 | 2026-07-17 12:11:06.993434 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-17 12:11:06.993564 | mon1 | Friday 17 July 2026 12:11:06 +0000 (0:00:00.270) 0:01:25.512 *********** 2026-07-17 12:11:07.064003 | mon1 | ok: [osd1] => { 2026-07-17 12:11:07.064083 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-07-17 12:11:07.064149 | mon1 | } 2026-07-17 12:11:07.064495 | mon1 | 2026-07-17 12:11:07.064547 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-17 12:11:07.064554 | mon1 | Friday 17 July 2026 12:11:07 +0000 (0:00:00.070) 0:01:25.582 *********** 2026-07-17 12:11:07.478073 | mon1 | ok: [osd1] 2026-07-17 12:11:07.478135 | mon1 | 2026-07-17 12:11:07.478398 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-17 12:11:07.478441 | mon1 | Friday 17 July 2026 12:11:07 +0000 (0:00:00.414) 0:01:25.996 *********** 2026-07-17 12:11:07.516770 | mon1 | skipping: [osd1] 2026-07-17 12:11:07.516855 | mon1 | 2026-07-17 12:11:07.517073 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-17 12:11:07.517126 | mon1 | Friday 17 July 2026 12:11:07 +0000 (0:00:00.038) 0:01:26.035 *********** 2026-07-17 12:11:07.558494 | mon1 | skipping: [osd1] 2026-07-17 12:11:07.558569 | mon1 | 2026-07-17 12:11:07.558761 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-17 12:11:07.558800 | mon1 | Friday 17 July 2026 12:11:07 +0000 (0:00:00.042) 0:01:26.077 *********** 2026-07-17 12:11:07.824402 | mon1 | ok: [osd1] 2026-07-17 12:11:07.824465 | mon1 | 2026-07-17 12:11:07.824605 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-17 12:11:07.824694 | mon1 | Friday 17 July 2026 12:11:07 +0000 (0:00:00.265) 0:01:26.343 *********** 2026-07-17 12:11:08.977073 | mon1 | ok: [osd1] 2026-07-17 12:11:08.977165 | mon1 | 2026-07-17 12:11:08.977263 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-17 12:11:08.977468 | mon1 | Friday 17 July 2026 12:11:08 +0000 (0:00:01.152) 0:01:27.496 *********** 2026-07-17 12:11:09.051171 | mon1 | ok: [osd1] => { 2026-07-17 12:11:09.051336 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-07-17 12:11:09.051525 | mon1 | } 2026-07-17 12:11:09.051649 | mon1 | 2026-07-17 12:11:09.051793 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-17 12:11:09.051927 | mon1 | Friday 17 July 2026 12:11:09 +0000 (0:00:00.073) 0:01:27.569 *********** 2026-07-17 12:11:09.464356 | mon1 | ok: [osd1] 2026-07-17 12:11:09.464414 | mon1 | 2026-07-17 12:11:09.464538 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-17 12:11:09.464681 | mon1 | Friday 17 July 2026 12:11:09 +0000 (0:00:00.413) 0:01:27.983 *********** 2026-07-17 12:11:11.524088 | mon1 | ok: [osd1] 2026-07-17 12:11:11.524563 | mon1 | 2026-07-17 12:11:11.524608 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-07-17 12:11:11.524614 | mon1 | Friday 17 July 2026 12:11:11 +0000 (0:00:02.059) 0:01:30.042 *********** 2026-07-17 12:11:11.556800 | mon1 | skipping: [osd1] 2026-07-17 12:11:11.556872 | mon1 | 2026-07-17 12:11:11.556940 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-07-17 12:11:11.557070 | mon1 | Friday 17 July 2026 12:11:11 +0000 (0:00:00.032) 0:01:30.074 *********** 2026-07-17 12:11:11.582731 | mon1 | skipping: [osd1] 2026-07-17 12:11:11.582796 | mon1 | 2026-07-17 12:11:11.582900 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-07-17 12:11:11.583035 | mon1 | Friday 17 July 2026 12:11:11 +0000 (0:00:00.026) 0:01:30.101 *********** 2026-07-17 12:11:11.604682 | mon1 | skipping: [osd1] 2026-07-17 12:11:11.605095 | mon1 | 2026-07-17 12:11:11.605141 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-07-17 12:11:11.605148 | mon1 | Friday 17 July 2026 12:11:11 +0000 (0:00:00.021) 0:01:30.123 *********** 2026-07-17 12:11:12.756838 | mon1 | ok: [osd1] 2026-07-17 12:11:12.756910 | mon1 | 2026-07-17 12:11:12.757211 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-07-17 12:11:12.757258 | mon1 | Friday 17 July 2026 12:11:12 +0000 (0:00:01.152) 0:01:31.275 *********** 2026-07-17 12:11:13.311269 | mon1 | ok: [osd1] 2026-07-17 12:11:13.311364 | mon1 | 2026-07-17 12:11:13.311717 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-07-17 12:11:13.311773 | mon1 | Friday 17 July 2026 12:11:13 +0000 (0:00:00.554) 0:01:31.829 *********** 2026-07-17 12:11:14.494353 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-07-17 12:11:14.495341 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-07-17 12:11:14.495448 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-07-17 12:11:14.496800 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-07-17 12:11:14.496878 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-07-17 12:11:14.496891 | mon1 | 2026-07-17 12:11:14.496902 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-07-17 12:11:14.496911 | mon1 | Friday 17 July 2026 12:11:14 +0000 (0:00:01.179) 0:01:33.009 *********** 2026-07-17 12:11:15.126876 | mon1 | ok: [osd1] 2026-07-17 12:11:15.126952 | mon1 | 2026-07-17 12:11:15.127306 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-07-17 12:11:15.127388 | mon1 | Friday 17 July 2026 12:11:15 +0000 (0:00:00.631) 0:01:33.640 *********** 2026-07-17 12:11:15.127398 | mon1 | 2026-07-17 12:11:15.127413 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-07-17 12:11:15.127420 | mon1 | Friday 17 July 2026 12:11:15 +0000 (0:00:00.005) 0:01:33.645 *********** 2026-07-17 12:11:15.535910 | mon1 | ok: [osd1] 2026-07-17 12:11:15.535971 | mon1 | 2026-07-17 12:11:15.536063 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-17 12:11:15.536202 | mon1 | Friday 17 July 2026 12:11:15 +0000 (0:00:00.409) 0:01:34.054 *********** 2026-07-17 12:11:15.797271 | mon1 | ok: [osd1] 2026-07-17 12:11:15.797349 | mon1 | 2026-07-17 12:11:15.797409 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-17 12:11:15.797525 | mon1 | Friday 17 July 2026 12:11:15 +0000 (0:00:00.261) 0:01:34.316 *********** 2026-07-17 12:11:15.866494 | mon1 | ok: [osd1] => { 2026-07-17 12:11:15.867191 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-07-17 12:11:15.867258 | mon1 | } 2026-07-17 12:11:15.867266 | mon1 | 2026-07-17 12:11:15.867272 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-17 12:11:15.867278 | mon1 | Friday 17 July 2026 12:11:15 +0000 (0:00:00.069) 0:01:34.385 *********** 2026-07-17 12:11:16.300958 | mon1 | ok: [osd1] 2026-07-17 12:11:16.301031 | mon1 | 2026-07-17 12:11:16.301322 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-17 12:11:16.301372 | mon1 | Friday 17 July 2026 12:11:16 +0000 (0:00:00.434) 0:01:34.819 *********** 2026-07-17 12:11:19.607350 | mon1 | ok: [osd1] 2026-07-17 12:11:19.607465 | mon1 | 2026-07-17 12:11:19.607799 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-07-17 12:11:19.607853 | mon1 | Friday 17 July 2026 12:11:19 +0000 (0:00:03.306) 0:01:38.126 *********** 2026-07-17 12:11:20.779393 | mon1 | ok: [osd1] 2026-07-17 12:11:20.779474 | mon1 | 2026-07-17 12:11:20.779875 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-07-17 12:11:20.779926 | mon1 | Friday 17 July 2026 12:11:20 +0000 (0:00:01.171) 0:01:39.297 *********** 2026-07-17 12:11:21.034066 | mon1 | ok: [osd1] 2026-07-17 12:11:21.034123 | mon1 | 2026-07-17 12:11:21.034361 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-07-17 12:11:21.034404 | mon1 | Friday 17 July 2026 12:11:21 +0000 (0:00:00.255) 0:01:39.552 *********** 2026-07-17 12:11:21.570855 | mon1 | ok: [osd1] 2026-07-17 12:11:21.570966 | mon1 | 2026-07-17 12:11:21.570973 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-07-17 12:11:21.571150 | mon1 | Friday 17 July 2026 12:11:21 +0000 (0:00:00.536) 0:01:40.089 *********** 2026-07-17 12:11:22.314617 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-07-17 12:11:22.314690 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-07-17 12:11:22.315245 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-07-17 12:11:22.315332 | mon1 | 2026-07-17 12:11:22.315340 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-07-17 12:11:22.315346 | mon1 | Friday 17 July 2026 12:11:22 +0000 (0:00:00.742) 0:01:40.832 *********** 2026-07-17 12:11:22.850382 | mon1 | ok: [osd1] 2026-07-17 12:11:22.850495 | mon1 | 2026-07-17 12:11:22.850931 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-07-17 12:11:22.851001 | mon1 | Friday 17 July 2026 12:11:22 +0000 (0:00:00.536) 0:01:41.368 *********** 2026-07-17 12:11:23.397927 | mon1 | ok: [osd1] 2026-07-17 12:11:23.398015 | mon1 | 2026-07-17 12:11:23.398817 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-07-17 12:11:23.398868 | mon1 | Friday 17 July 2026 12:11:23 +0000 (0:00:00.540) 0:01:41.909 *********** 2026-07-17 12:11:23.398875 | mon1 | 2026-07-17 12:11:23.398879 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-07-17 12:11:23.398883 | mon1 | Friday 17 July 2026 12:11:23 +0000 (0:00:00.007) 0:01:41.916 *********** 2026-07-17 12:11:23.828739 | mon1 | ok: [osd1] 2026-07-17 12:11:23.828817 | mon1 | 2026-07-17 12:11:23.829011 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-07-17 12:11:23.829054 | mon1 | Friday 17 July 2026 12:11:23 +0000 (0:00:00.431) 0:01:42.347 *********** 2026-07-17 12:11:23.889844 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-07-17 12:11:23.889940 | mon1 | 2026-07-17 12:11:23.890322 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-07-17 12:11:23.890406 | mon1 | Friday 17 July 2026 12:11:23 +0000 (0:00:00.059) 0:01:42.407 *********** 2026-07-17 12:11:25.074368 | mon1 | ok: [osd1] 2026-07-17 12:11:25.074485 | mon1 | 2026-07-17 12:11:25.074493 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-07-17 12:11:25.074678 | mon1 | Friday 17 July 2026 12:11:25 +0000 (0:00:01.185) 0:01:43.592 *********** 2026-07-17 12:11:25.940285 | mon1 | ok: [osd1] => (item=chronyd) 2026-07-17 12:11:25.940363 | mon1 | ok: [osd1] => (item=sshd) 2026-07-17 12:11:25.940744 | mon1 | 2026-07-17 12:11:25.940789 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-07-17 12:11:25.940795 | mon1 | Friday 17 July 2026 12:11:25 +0000 (0:00:00.866) 0:01:44.459 *********** 2026-07-17 12:11:26.684435 | mon1 | ok: [osd1] 2026-07-17 12:11:26.684505 | mon1 | 2026-07-17 12:11:26.684765 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-07-17 12:11:26.684827 | mon1 | Friday 17 July 2026 12:11:26 +0000 (0:00:00.744) 0:01:45.203 *********** 2026-07-17 12:11:26.942454 | mon1 | ok: [osd1] 2026-07-17 12:11:26.942554 | mon1 | 2026-07-17 12:11:26.942920 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-07-17 12:11:26.942966 | mon1 | Friday 17 July 2026 12:11:26 +0000 (0:00:00.257) 0:01:45.461 *********** 2026-07-17 12:11:27.326232 | mon1 | ok: [osd1] 2026-07-17 12:11:27.326307 | mon1 | 2026-07-17 12:11:27.326642 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-07-17 12:11:27.326695 | mon1 | Friday 17 July 2026 12:11:27 +0000 (0:00:00.383) 0:01:45.844 *********** 2026-07-17 12:11:27.611445 | mon1 | ok: [osd1] 2026-07-17 12:11:27.611507 | mon1 | 2026-07-17 12:11:27.611601 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-07-17 12:11:27.611723 | mon1 | Friday 17 July 2026 12:11:27 +0000 (0:00:00.285) 0:01:46.130 *********** 2026-07-17 12:11:27.890113 | mon1 | ok: [osd1 -> mon1(199.19.213.175)] => (item=mon1) 2026-07-17 12:11:27.890172 | mon1 | 2026-07-17 12:11:27.890183 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-07-17 12:11:27.890206 | mon1 | Friday 17 July 2026 12:11:27 +0000 (0:00:00.277) 0:01:46.408 *********** 2026-07-17 12:11:27.933789 | mon1 | ok: [osd1] 2026-07-17 12:11:27.933836 | mon1 | 2026-07-17 12:11:27.933845 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-07-17 12:11:27.933851 | mon1 | Friday 17 July 2026 12:11:27 +0000 (0:00:00.043) 0:01:46.452 *********** 2026-07-17 12:11:28.001805 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-07-17 12:11:28.001847 | mon1 | 2026-07-17 12:11:28.001852 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-07-17 12:11:28.001857 | mon1 | Friday 17 July 2026 12:11:28 +0000 (0:00:00.068) 0:01:46.520 *********** 2026-07-17 12:11:34.319285 | mon1 | ok: [osd1 -> mon1(199.19.213.175)] 2026-07-17 12:11:34.319360 | mon1 | 2026-07-17 12:11:34.319586 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-07-17 12:11:34.319606 | mon1 | Friday 17 July 2026 12:11:34 +0000 (0:00:06.317) 0:01:52.837 *********** 2026-07-17 12:11:34.369005 | mon1 | ok: [osd1] => (item=osd1) 2026-07-17 12:11:34.369052 | mon1 | 2026-07-17 12:11:34.369601 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-07-17 12:11:34.369663 | mon1 | Friday 17 July 2026 12:11:34 +0000 (0:00:00.049) 0:01:52.886 *********** 2026-07-17 12:11:34.699048 | mon1 | ok: [osd1] 2026-07-17 12:11:34.699130 | mon1 | 2026-07-17 12:11:34.699193 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-07-17 12:11:34.699362 | mon1 | Friday 17 July 2026 12:11:34 +0000 (0:00:00.331) 0:01:53.217 *********** 2026-07-17 12:11:41.407017 | mon1 | ok: [osd1 -> mon1(199.19.213.175)] 2026-07-17 12:11:41.407090 | mon1 | 2026-07-17 12:11:41.407220 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-07-17 12:11:41.407314 | mon1 | Friday 17 July 2026 12:11:41 +0000 (0:00:06.707) 0:01:59.925 *********** 2026-07-17 12:11:46.826864 | mon1 | ok: [osd1] 2026-07-17 12:11:46.826932 | mon1 | 2026-07-17 12:11:46.827012 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-07-17 12:11:46.827146 | mon1 | Friday 17 July 2026 12:11:46 +0000 (0:00:05.419) 0:02:05.345 *********** 2026-07-17 12:12:09.040955 | mon1 | ok: [osd1] 2026-07-17 12:12:09.041030 | mon1 | 2026-07-17 12:12:09.041091 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-07-17 12:12:09.041237 | mon1 | Friday 17 July 2026 12:12:09 +0000 (0:00:22.213) 0:02:27.559 *********** 2026-07-17 12:12:09.107095 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-07-17 12:12:09.107179 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-07-17 12:12:09.107912 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-07-17 12:12:09.107960 | mon1 | skipping: [osd1] 2026-07-17 12:12:09.107968 | mon1 | 2026-07-17 12:12:09.107974 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-07-17 12:12:09.107981 | mon1 | Friday 17 July 2026 12:12:09 +0000 (0:00:00.065) 0:02:27.625 *********** 2026-07-17 12:12:15.219904 | mon1 | ok: [osd1 -> mon1(199.19.213.175)] 2026-07-17 12:12:15.219980 | mon1 | 2026-07-17 12:12:15.220072 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-07-17 12:12:15.220210 | mon1 | Friday 17 July 2026 12:12:15 +0000 (0:00:06.113) 0:02:33.738 *********** 2026-07-17 12:12:21.324024 | mon1 | ok: [osd1 -> mon1(199.19.213.175)] 2026-07-17 12:12:21.324109 | mon1 | 2026-07-17 12:12:21.324316 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-07-17 12:12:21.324362 | mon1 | Friday 17 July 2026 12:12:21 +0000 (0:00:06.103) 0:02:39.842 *********** 2026-07-17 12:12:21.375750 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-07-17 12:12:21.376128 | mon1 | 2026-07-17 12:12:21.376149 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-07-17 12:12:21.376157 | mon1 | Friday 17 July 2026 12:12:21 +0000 (0:00:00.051) 0:02:39.893 *********** 2026-07-17 12:12:21.411642 | mon1 | ok: [osd1] 2026-07-17 12:12:21.411711 | mon1 | 2026-07-17 12:12:21.411911 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-07-17 12:12:21.411953 | mon1 | Friday 17 July 2026 12:12:21 +0000 (0:00:00.036) 0:02:39.930 *********** 2026-07-17 12:12:27.717315 | mon1 | ok: [osd1 -> mon1(199.19.213.175)] 2026-07-17 12:12:27.717400 | mon1 | 2026-07-17 12:12:27.717706 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-07-17 12:12:27.717753 | mon1 | Friday 17 July 2026 12:12:27 +0000 (0:00:06.305) 0:02:46.235 *********** 2026-07-17 12:12:27.756934 | mon1 | ok: [osd1] 2026-07-17 12:12:27.757043 | mon1 | 2026-07-17 12:12:27.757074 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-07-17 12:12:27.757192 | mon1 | Friday 17 July 2026 12:12:27 +0000 (0:00:00.039) 0:02:46.275 *********** 2026-07-17 12:12:27.805157 | mon1 | skipping: [osd1] => (item=1) 2026-07-17 12:12:27.805230 | mon1 | skipping: [osd1] => (item=1) 2026-07-17 12:12:27.805693 | mon1 | skipping: [osd1] => (item=1) 2026-07-17 12:12:27.805733 | mon1 | skipping: [osd1] 2026-07-17 12:12:27.805738 | mon1 | 2026-07-17 12:12:27.805743 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-07-17 12:12:27.805748 | mon1 | Friday 17 July 2026 12:12:27 +0000 (0:00:00.048) 0:02:46.324 *********** 2026-07-17 12:12:27.865447 | mon1 | skipping: [osd1] 2026-07-17 12:12:27.865509 | mon1 | 2026-07-17 12:12:27.865656 | mon1 | PLAY [Deploy Ceph exporters] *************************************************** 2026-07-17 12:12:27.865688 | mon1 | 2026-07-17 12:12:27.865870 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-07-17 12:12:27.865884 | mon1 | Friday 17 July 2026 12:12:27 +0000 (0:00:00.060) 0:02:46.384 *********** 2026-07-17 12:12:28.816564 | mon1 | ok: [mon1] 2026-07-17 12:12:28.816666 | mon1 | 2026-07-17 12:12:28.817012 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-17 12:12:28.817061 | mon1 | Friday 17 July 2026 12:12:28 +0000 (0:00:00.950) 0:02:47.335 *********** 2026-07-17 12:12:29.068253 | mon1 | ok: [mon1] 2026-07-17 12:12:29.068298 | mon1 | 2026-07-17 12:12:29.068303 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-17 12:12:29.068308 | mon1 | Friday 17 July 2026 12:12:29 +0000 (0:00:00.251) 0:02:47.586 *********** 2026-07-17 12:12:29.103341 | mon1 | skipping: [mon1] 2026-07-17 12:12:29.103411 | mon1 | 2026-07-17 12:12:29.103431 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-07-17 12:12:29.103538 | mon1 | Friday 17 July 2026 12:12:29 +0000 (0:00:00.035) 0:02:47.622 *********** 2026-07-17 12:12:29.363762 | mon1 | ok: [mon1] 2026-07-17 12:12:29.363838 | mon1 | 2026-07-17 12:12:29.364108 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-17 12:12:29.364156 | mon1 | Friday 17 July 2026 12:12:29 +0000 (0:00:00.260) 0:02:47.882 *********** 2026-07-17 12:12:29.431450 | mon1 | ok: [mon1] => { 2026-07-17 12:12:29.431577 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-07-17 12:12:29.431591 | mon1 | } 2026-07-17 12:12:29.431916 | mon1 | 2026-07-17 12:12:29.431993 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-17 12:12:29.432000 | mon1 | Friday 17 July 2026 12:12:29 +0000 (0:00:00.066) 0:02:47.949 *********** 2026-07-17 12:12:29.811204 | mon1 | ok: [mon1] 2026-07-17 12:12:29.811320 | mon1 | 2026-07-17 12:12:29.811582 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-17 12:12:29.811628 | mon1 | Friday 17 July 2026 12:12:29 +0000 (0:00:00.380) 0:02:48.330 *********** 2026-07-17 12:12:29.847403 | mon1 | skipping: [mon1] 2026-07-17 12:12:29.847480 | mon1 | 2026-07-17 12:12:29.847801 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-17 12:12:29.847852 | mon1 | Friday 17 July 2026 12:12:29 +0000 (0:00:00.036) 0:02:48.366 *********** 2026-07-17 12:12:29.887025 | mon1 | skipping: [mon1] 2026-07-17 12:12:29.887120 | mon1 | 2026-07-17 12:12:29.887316 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-17 12:12:29.887390 | mon1 | Friday 17 July 2026 12:12:29 +0000 (0:00:00.039) 0:02:48.405 *********** 2026-07-17 12:12:30.143497 | mon1 | ok: [mon1] 2026-07-17 12:12:30.143589 | mon1 | 2026-07-17 12:12:30.143610 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-17 12:12:30.143759 | mon1 | Friday 17 July 2026 12:12:30 +0000 (0:00:00.256) 0:02:48.662 *********** 2026-07-17 12:12:31.559340 | mon1 | ok: [mon1] 2026-07-17 12:12:31.559412 | mon1 | 2026-07-17 12:12:31.559459 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-17 12:12:31.559583 | mon1 | Friday 17 July 2026 12:12:31 +0000 (0:00:01.415) 0:02:50.078 *********** 2026-07-17 12:12:31.637728 | mon1 | ok: [mon1] => { 2026-07-17 12:12:31.637794 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-07-17 12:12:31.638306 | mon1 | } 2026-07-17 12:12:31.638323 | mon1 | 2026-07-17 12:12:31.638330 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-17 12:12:31.638337 | mon1 | Friday 17 July 2026 12:12:31 +0000 (0:00:00.078) 0:02:50.156 *********** 2026-07-17 12:12:32.069016 | mon1 | ok: [mon1] 2026-07-17 12:12:32.069109 | mon1 | 2026-07-17 12:12:32.069385 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-17 12:12:32.069401 | mon1 | Friday 17 July 2026 12:12:32 +0000 (0:00:00.431) 0:02:50.587 *********** 2026-07-17 12:12:34.140293 | mon1 | ok: [mon1] 2026-07-17 12:12:34.140362 | mon1 | 2026-07-17 12:12:34.140609 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-07-17 12:12:34.140662 | mon1 | Friday 17 July 2026 12:12:34 +0000 (0:00:02.071) 0:02:52.659 *********** 2026-07-17 12:12:34.170874 | mon1 | skipping: [mon1] 2026-07-17 12:12:34.170997 | mon1 | 2026-07-17 12:12:34.171301 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-07-17 12:12:34.171484 | mon1 | Friday 17 July 2026 12:12:34 +0000 (0:00:00.030) 0:02:52.689 *********** 2026-07-17 12:12:34.196643 | mon1 | skipping: [mon1] 2026-07-17 12:12:34.196792 | mon1 | 2026-07-17 12:12:34.197094 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-07-17 12:12:34.197134 | mon1 | Friday 17 July 2026 12:12:34 +0000 (0:00:00.025) 0:02:52.715 *********** 2026-07-17 12:12:34.220297 | mon1 | skipping: [mon1] 2026-07-17 12:12:34.220359 | mon1 | 2026-07-17 12:12:34.220477 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-07-17 12:12:34.220611 | mon1 | Friday 17 July 2026 12:12:34 +0000 (0:00:00.023) 0:02:52.739 *********** 2026-07-17 12:12:35.337163 | mon1 | ok: [mon1] 2026-07-17 12:12:35.337234 | mon1 | 2026-07-17 12:12:35.337459 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-07-17 12:12:35.337503 | mon1 | Friday 17 July 2026 12:12:35 +0000 (0:00:01.116) 0:02:53.856 *********** 2026-07-17 12:12:35.862254 | mon1 | ok: [mon1] 2026-07-17 12:12:35.862320 | mon1 | 2026-07-17 12:12:35.862548 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-07-17 12:12:35.862588 | mon1 | Friday 17 July 2026 12:12:35 +0000 (0:00:00.525) 0:02:54.381 *********** 2026-07-17 12:12:37.106717 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-07-17 12:12:37.106796 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-07-17 12:12:37.107332 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-07-17 12:12:37.107385 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-07-17 12:12:37.107399 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-07-17 12:12:37.107411 | mon1 | 2026-07-17 12:12:37.107670 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-07-17 12:12:37.107689 | mon1 | Friday 17 July 2026 12:12:37 +0000 (0:00:01.243) 0:02:55.625 *********** 2026-07-17 12:12:37.737317 | mon1 | ok: [mon1] 2026-07-17 12:12:37.737414 | mon1 | 2026-07-17 12:12:37.737429 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-07-17 12:12:37.737869 | mon1 | Friday 17 July 2026 12:12:37 +0000 (0:00:00.625) 0:02:56.250 *********** 2026-07-17 12:12:37.737910 | mon1 | 2026-07-17 12:12:37.737915 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-07-17 12:12:37.737919 | mon1 | Friday 17 July 2026 12:12:37 +0000 (0:00:00.005) 0:02:56.256 *********** 2026-07-17 12:12:38.173790 | mon1 | ok: [mon1] 2026-07-17 12:12:38.173860 | mon1 | 2026-07-17 12:12:38.174054 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-17 12:12:38.174103 | mon1 | Friday 17 July 2026 12:12:38 +0000 (0:00:00.436) 0:02:56.692 *********** 2026-07-17 12:12:38.462129 | mon1 | ok: [mon1] 2026-07-17 12:12:38.462205 | mon1 | 2026-07-17 12:12:38.462229 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-17 12:12:38.462551 | mon1 | Friday 17 July 2026 12:12:38 +0000 (0:00:00.288) 0:02:56.981 *********** 2026-07-17 12:12:38.530762 | mon1 | ok: [mon1] => { 2026-07-17 12:12:38.530848 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-07-17 12:12:38.531285 | mon1 | } 2026-07-17 12:12:38.531332 | mon1 | 2026-07-17 12:12:38.531338 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-17 12:12:38.531344 | mon1 | Friday 17 July 2026 12:12:38 +0000 (0:00:00.068) 0:02:57.049 *********** 2026-07-17 12:12:38.971728 | mon1 | ok: [mon1] 2026-07-17 12:12:38.971798 | mon1 | 2026-07-17 12:12:38.972093 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-17 12:12:38.972143 | mon1 | Friday 17 July 2026 12:12:38 +0000 (0:00:00.440) 0:02:57.490 *********** 2026-07-17 12:12:42.201136 | mon1 | ok: [mon1] 2026-07-17 12:12:42.201203 | mon1 | 2026-07-17 12:12:42.201442 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-07-17 12:12:42.201485 | mon1 | Friday 17 July 2026 12:12:42 +0000 (0:00:03.229) 0:03:00.719 *********** 2026-07-17 12:12:43.420717 | mon1 | ok: [mon1] 2026-07-17 12:12:43.420777 | mon1 | 2026-07-17 12:12:43.420787 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-07-17 12:12:43.420795 | mon1 | Friday 17 July 2026 12:12:43 +0000 (0:00:01.218) 0:03:01.938 *********** 2026-07-17 12:12:43.678288 | mon1 | ok: [mon1] 2026-07-17 12:12:43.678339 | mon1 | 2026-07-17 12:12:43.678345 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-07-17 12:12:43.678350 | mon1 | Friday 17 July 2026 12:12:43 +0000 (0:00:00.257) 0:03:02.196 *********** 2026-07-17 12:12:44.235736 | mon1 | ok: [mon1] 2026-07-17 12:12:44.235801 | mon1 | 2026-07-17 12:12:44.235813 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-07-17 12:12:44.235825 | mon1 | Friday 17 July 2026 12:12:44 +0000 (0:00:00.556) 0:03:02.753 *********** 2026-07-17 12:12:44.979339 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-07-17 12:12:44.979411 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-07-17 12:12:44.979424 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-07-17 12:12:44.979434 | mon1 | 2026-07-17 12:12:44.979444 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-07-17 12:12:44.979461 | mon1 | Friday 17 July 2026 12:12:44 +0000 (0:00:00.743) 0:03:03.496 *********** 2026-07-17 12:12:45.508581 | mon1 | ok: [mon1] 2026-07-17 12:12:45.508756 | mon1 | 2026-07-17 12:12:45.508995 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-07-17 12:12:45.509216 | mon1 | Friday 17 July 2026 12:12:45 +0000 (0:00:00.530) 0:03:04.027 *********** 2026-07-17 12:12:46.062287 | mon1 | ok: [mon1] 2026-07-17 12:12:46.062371 | mon1 | 2026-07-17 12:12:46.062379 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-07-17 12:12:46.062386 | mon1 | Friday 17 July 2026 12:12:46 +0000 (0:00:00.544) 0:03:04.571 *********** 2026-07-17 12:12:46.062392 | mon1 | 2026-07-17 12:12:46.062398 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-07-17 12:12:46.062425 | mon1 | Friday 17 July 2026 12:12:46 +0000 (0:00:00.008) 0:03:04.579 *********** 2026-07-17 12:12:46.496771 | mon1 | ok: [mon1] 2026-07-17 12:12:46.496871 | mon1 | 2026-07-17 12:12:46.497279 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-07-17 12:12:46.497341 | mon1 | Friday 17 July 2026 12:12:46 +0000 (0:00:00.435) 0:03:05.015 *********** 2026-07-17 12:12:46.547078 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-07-17 12:12:46.547150 | mon1 | 2026-07-17 12:12:46.547405 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-07-17 12:12:46.547448 | mon1 | Friday 17 July 2026 12:12:46 +0000 (0:00:00.050) 0:03:05.065 *********** 2026-07-17 12:12:47.999507 | mon1 | ok: [mon1] 2026-07-17 12:12:47.999570 | mon1 | 2026-07-17 12:12:47.999806 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-07-17 12:12:47.999823 | mon1 | Friday 17 July 2026 12:12:47 +0000 (0:00:01.452) 0:03:06.518 *********** 2026-07-17 12:12:48.796682 | mon1 | ok: [mon1] => (item=chronyd) 2026-07-17 12:12:48.796742 | mon1 | ok: [mon1] => (item=sshd) 2026-07-17 12:12:48.796833 | mon1 | 2026-07-17 12:12:48.797080 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-07-17 12:12:48.797124 | mon1 | Friday 17 July 2026 12:12:48 +0000 (0:00:00.797) 0:03:07.315 *********** 2026-07-17 12:12:49.676426 | mon1 | ok: [mon1] 2026-07-17 12:12:49.676497 | mon1 | 2026-07-17 12:12:49.676706 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-07-17 12:12:49.676749 | mon1 | Friday 17 July 2026 12:12:49 +0000 (0:00:00.879) 0:03:08.195 *********** 2026-07-17 12:12:49.946828 | mon1 | ok: [mon1] 2026-07-17 12:12:49.946902 | mon1 | 2026-07-17 12:12:49.947144 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-07-17 12:12:49.947189 | mon1 | Friday 17 July 2026 12:12:49 +0000 (0:00:00.270) 0:03:08.465 *********** 2026-07-17 12:12:50.235277 | mon1 | ok: [mon1] 2026-07-17 12:12:50.235344 | mon1 | 2026-07-17 12:12:50.235571 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-07-17 12:12:50.235588 | mon1 | Friday 17 July 2026 12:12:50 +0000 (0:00:00.288) 0:03:08.754 *********** 2026-07-17 12:12:50.482093 | mon1 | ok: [mon1] 2026-07-17 12:12:50.482172 | mon1 | 2026-07-17 12:12:50.482235 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] *********** 2026-07-17 12:12:50.482359 | mon1 | Friday 17 July 2026 12:12:50 +0000 (0:00:00.246) 0:03:09.001 *********** 2026-07-17 12:12:56.735469 | mon1 | ok: [mon1] 2026-07-17 12:12:56.735587 | mon1 | 2026-07-17 12:12:56.735599 | mon1 | PLAY RECAP ********************************************************************* 2026-07-17 12:12:56.735610 | mon1 | mon1 : ok=83 changed=0 unreachable=0 failed=0 skipped=15 rescued=0 ignored=0 2026-07-17 12:12:56.735619 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-07-17 12:12:56.735627 | mon1 | 2026-07-17 12:12:56.735644 | mon1 | 2026-07-17 12:12:56.735650 | mon1 | TASKS RECAP ******************************************************************** 2026-07-17 12:12:56.735828 | mon1 | Friday 17 July 2026 12:12:56 +0000 (0:00:06.252) 0:03:15.253 *********** 2026-07-17 12:12:56.735850 | mon1 | =============================================================================== 2026-07-17 12:12:56.736539 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.21s 2026-07-17 12:12:56.736604 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.21s 2026-07-17 12:12:56.736617 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.71s 2026-07-17 12:12:56.736637 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.71s 2026-07-17 12:12:56.736647 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.62s 2026-07-17 12:12:56.736673 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.32s 2026-07-17 12:12:56.736692 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.31s 2026-07-17 12:12:56.736704 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 6.25s 2026-07-17 12:12:56.736912 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.20s 2026-07-17 12:12:56.736943 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.14s 2026-07-17 12:12:56.737505 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.12s 2026-07-17 12:12:56.737788 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.11s 2026-07-17 12:12:56.737797 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.10s 2026-07-17 12:12:56.737830 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.08s 2026-07-17 12:12:56.737982 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 5.71s 2026-07-17 12:12:56.738217 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.42s 2026-07-17 12:12:56.739040 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.31s 2026-07-17 12:12:56.739055 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.28s 2026-07-17 12:12:56.739081 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.23s 2026-07-17 12:12:56.739087 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.46s 2026-07-17 12:12:56.892814 | mon1 | INFO [default > idempotence] Executed: Successful 2026-07-17 12:12:56.902065 | mon1 | INFO [default > side_effect] Executing 2026-07-17 12:12:56.902529 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-07-17 12:12:56.908359 | mon1 | INFO [default > verify] Executing 2026-07-17 12:12:57.764898 | mon1 | 2026-07-17 12:12:57.765285 | mon1 | PLAY [Verify] ****************************************************************** 2026-07-17 12:12:57.765603 | mon1 | 2026-07-17 12:12:57.765896 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-07-17 12:12:57.766207 | mon1 | Friday 17 July 2026 12:12:57 +0000 (0:00:00.010) 0:00:00.010 *********** 2026-07-17 12:12:58.961559 | mon1 | [WARNING]: Host 'mon1' is using the discovered Python interpreter at '/usr/bin/python3.10', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.21/reference_appendices/interpreter_discovery.html for more information. 2026-07-17 12:12:58.966747 | mon1 | ok: [mon1] 2026-07-17 12:12:58.966784 | mon1 | 2026-07-17 12:12:58.966797 | mon1 | TASK [Get cluster health status] *********************************************** 2026-07-17 12:12:58.966807 | mon1 | Friday 17 July 2026 12:12:58 +0000 (0:00:01.201) 0:00:01.211 *********** 2026-07-17 12:13:09.113399 | mon1 | ok: [mon1] 2026-07-17 12:13:09.113455 | mon1 | 2026-07-17 12:13:09.113464 | mon1 | TASK [Print cluster health status] ********************************************* 2026-07-17 12:13:09.113471 | mon1 | Friday 17 July 2026 12:13:09 +0000 (0:00:10.146) 0:00:11.358 *********** 2026-07-17 12:13:09.151330 | mon1 | ok: [mon1] => { 2026-07-17 12:13:09.151394 | mon1 | "_ceph_health": { 2026-07-17 12:13:09.151406 | mon1 | "changed": false, 2026-07-17 12:13:09.151416 | mon1 | "changed_when_result": false, 2026-07-17 12:13:09.151426 | mon1 | "cmd": [ 2026-07-17 12:13:09.151435 | mon1 | "cephadm", 2026-07-17 12:13:09.151444 | mon1 | "shell", 2026-07-17 12:13:09.151453 | mon1 | "--", 2026-07-17 12:13:09.151462 | mon1 | "ceph", 2026-07-17 12:13:09.151471 | mon1 | "health" 2026-07-17 12:13:09.151480 | mon1 | ], 2026-07-17 12:13:09.151489 | mon1 | "delta": "0:00:09.786076", 2026-07-17 12:13:09.151498 | mon1 | "end": "2026-07-17 12:13:09.064908", 2026-07-17 12:13:09.151507 | mon1 | "failed": false, 2026-07-17 12:13:09.151516 | mon1 | "msg": "", 2026-07-17 12:13:09.151548 | mon1 | "rc": 0, 2026-07-17 12:13:09.151558 | mon1 | "start": "2026-07-17 12:12:59.278832", 2026-07-17 12:13:09.151567 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-07-17 12:13:09.151577 | mon1 | "stderr_lines": [ 2026-07-17 12:13:09.151586 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-07-17 12:13:09.151596 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-07-17 12:13:09.151612 | mon1 | ], 2026-07-17 12:13:09.151621 | mon1 | "stdout": "HEALTH_OK", 2026-07-17 12:13:09.151630 | mon1 | "stdout_lines": [ 2026-07-17 12:13:09.151639 | mon1 | "HEALTH_OK" 2026-07-17 12:13:09.151650 | mon1 | ] 2026-07-17 12:13:09.151739 | mon1 | } 2026-07-17 12:13:09.151818 | mon1 | } 2026-07-17 12:13:09.151901 | mon1 | 2026-07-17 12:13:09.152001 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-07-17 12:13:09.152087 | mon1 | Friday 17 July 2026 12:13:09 +0000 (0:00:00.035) 0:00:11.393 *********** 2026-07-17 12:13:09.185836 | mon1 | ok: [mon1] => { 2026-07-17 12:13:09.185990 | mon1 | "changed": false, 2026-07-17 12:13:09.186214 | mon1 | "msg": "All assertions passed" 2026-07-17 12:13:09.186386 | mon1 | } 2026-07-17 12:13:09.186564 | mon1 | 2026-07-17 12:13:09.186780 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-07-17 12:13:09.187025 | mon1 | Friday 17 July 2026 12:13:09 +0000 (0:00:00.037) 0:00:11.430 *********** 2026-07-17 12:13:15.142804 | mon1 | changed: [mon1] 2026-07-17 12:13:15.142875 | mon1 | 2026-07-17 12:13:15.142888 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-07-17 12:13:15.142899 | mon1 | Friday 17 July 2026 12:13:15 +0000 (0:00:05.955) 0:00:17.386 *********** 2026-07-17 12:13:17.279763 | mon1 | changed: [mon1] 2026-07-17 12:13:17.280433 | mon1 | 2026-07-17 12:13:17.280469 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-07-17 12:13:17.280475 | mon1 | Friday 17 July 2026 12:13:17 +0000 (0:00:02.137) 0:00:19.524 *********** 2026-07-17 12:13:18.485320 | mon1 | ok: [mon1] 2026-07-17 12:13:18.485388 | mon1 | 2026-07-17 12:13:18.485477 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-07-17 12:13:18.485583 | mon1 | Friday 17 July 2026 12:13:18 +0000 (0:00:01.206) 0:00:20.730 *********** 2026-07-17 12:13:18.537435 | mon1 | ok: [mon1] => { 2026-07-17 12:13:18.538527 | mon1 | "changed": false, 2026-07-17 12:13:18.538574 | mon1 | "msg": "All assertions passed" 2026-07-17 12:13:18.538583 | mon1 | } 2026-07-17 12:13:18.538591 | mon1 | 2026-07-17 12:13:18.538599 | mon1 | TASK [Retrieve info for the test Ceph key using the legacy key module] ********* 2026-07-17 12:13:18.538606 | mon1 | Friday 17 July 2026 12:13:18 +0000 (0:00:00.051) 0:00:20.781 *********** 2026-07-17 12:13:19.605988 | mon1 | ok: [mon1] 2026-07-17 12:13:19.606073 | mon1 | 2026-07-17 12:13:19.606460 | mon1 | TASK [Assert that the legacy key module info state returns the correct key] **** 2026-07-17 12:13:19.606510 | mon1 | Friday 17 July 2026 12:13:19 +0000 (0:00:01.069) 0:00:21.850 *********** 2026-07-17 12:13:19.650842 | mon1 | ok: [mon1] => { 2026-07-17 12:13:19.651275 | mon1 | "changed": false, 2026-07-17 12:13:19.651326 | mon1 | "msg": "All assertions passed" 2026-07-17 12:13:19.654977 | mon1 | } 2026-07-17 12:13:19.655025 | mon1 | 2026-07-17 12:13:19.655033 | mon1 | PLAY RECAP ********************************************************************* 2026-07-17 12:13:19.655040 | mon1 | mon1 : ok=10 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-07-17 12:13:19.655046 | mon1 | 2026-07-17 12:13:19.655052 | mon1 | 2026-07-17 12:13:19.655058 | mon1 | TASKS RECAP ******************************************************************** 2026-07-17 12:13:19.655063 | mon1 | Friday 17 July 2026 12:13:19 +0000 (0:00:00.045) 0:00:21.896 *********** 2026-07-17 12:13:19.655069 | mon1 | =============================================================================== 2026-07-17 12:13:19.655075 | mon1 | Get cluster health status ---------------------------------------------- 10.15s 2026-07-17 12:13:19.655094 | mon1 | Create a test Ceph pool ------------------------------------------------- 5.96s 2026-07-17 12:13:19.655100 | mon1 | Create a test Ceph key -------------------------------------------------- 2.14s 2026-07-17 12:13:19.655105 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.21s 2026-07-17 12:13:19.655111 | mon1 | Gathering Facts --------------------------------------------------------- 1.20s 2026-07-17 12:13:19.655117 | mon1 | Retrieve info for the test Ceph key using the legacy key module --------- 1.07s 2026-07-17 12:13:19.655122 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.05s 2026-07-17 12:13:19.655128 | mon1 | Assert that the legacy key module info state returns the correct key ---- 0.05s 2026-07-17 12:13:19.655133 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.04s 2026-07-17 12:13:19.655139 | mon1 | Print cluster health status --------------------------------------------- 0.04s 2026-07-17 12:13:19.762586 | mon1 | INFO [default > verify] Executed: Successful 2026-07-17 12:13:19.772033 | mon1 | INFO [default > cleanup] Executing 2026-07-17 12:13:19.772521 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-07-17 12:13:19.778448 | mon1 | INFO [default > destroy] Executing 2026-07-17 12:13:19.778549 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-07-17 12:13:19.778645 | mon1 | INFO [default > destroy] Executed: Successful 2026-07-17 12:13:19.779315 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-07-17 12:13:19.916425 | mon1 | ok: Runtime: 0:13:27.339022 2026-07-17 12:13:19.938733 | 2026-07-17 12:13:19.938888 | PLAY RECAP 2026-07-17 12:13:19.938965 | mon1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-07-17 12:13:19.939007 | 2026-07-17 12:13:20.145693 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-07-17 12:13:20.151227 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-07-17 12:13:21.054814 | 2026-07-17 12:13:21.055101 | PLAY [all] 2026-07-17 12:13:21.074250 | 2026-07-17 12:13:21.074517 | TASK [fetch-output : Set log path for multiple nodes] 2026-07-17 12:13:21.133885 | mon1 | ok 2026-07-17 12:13:21.151834 | osd1 | ok 2026-07-17 12:13:21.159691 | 2026-07-17 12:13:21.159981 | TASK [fetch-output : Set log path for single node] 2026-07-17 12:13:21.192077 | mon1 | skipping: Conditional result was False 2026-07-17 12:13:21.203674 | osd1 | skipping: Conditional result was False 2026-07-17 12:13:21.212425 | 2026-07-17 12:13:21.212623 | LOOP [fetch-output : Ensure local output dirs] 2026-07-17 12:13:21.743178 | mon1 -> localhost | changed: "/var/lib/zuul/builds/4d2cd2a346de41d0b1b67ab0789d2be6/work/logs/mon1" 2026-07-17 12:13:21.785650 | osd1 -> localhost | changed: "/var/lib/zuul/builds/4d2cd2a346de41d0b1b67ab0789d2be6/work/logs/osd1" 2026-07-17 12:13:22.044862 | mon1 -> localhost | changed: "/var/lib/zuul/builds/4d2cd2a346de41d0b1b67ab0789d2be6/work/artifacts" 2026-07-17 12:13:22.076341 | osd1 -> localhost | ok: "/var/lib/zuul/builds/4d2cd2a346de41d0b1b67ab0789d2be6/work/artifacts" 2026-07-17 12:13:22.323986 | mon1 -> localhost | changed: "/var/lib/zuul/builds/4d2cd2a346de41d0b1b67ab0789d2be6/work/docs" 2026-07-17 12:13:22.365891 | osd1 -> localhost | ok: "/var/lib/zuul/builds/4d2cd2a346de41d0b1b67ab0789d2be6/work/docs" 2026-07-17 12:13:22.366078 | osd1 -> localhost | changed: All items complete 2026-07-17 12:13:22.366132 | 2026-07-17 12:13:22.386103 | 2026-07-17 12:13:22.386278 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-07-17 12:13:23.139529 | mon1 | changed: .d..t...... ./ 2026-07-17 12:13:23.157558 | osd1 | changed: .d..t...... ./ 2026-07-17 12:13:23.643771 | mon1 | changed: .d..t...... ./ 2026-07-17 12:13:23.673320 | osd1 | changed: .d..t...... ./ 2026-07-17 12:13:24.134345 | mon1 | changed: .d..t...... ./ 2026-07-17 12:13:24.206417 | osd1 | ok 2026-07-17 12:13:24.206583 | osd1 | changed: All items complete 2026-07-17 12:13:24.206619 | 2026-07-17 12:13:24.241298 | 2026-07-17 12:13:24.241548 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-07-17 12:13:24.813017 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.006150 2026-07-17 12:13:25.113056 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.006772 2026-07-17 12:13:25.144173 | 2026-07-17 12:13:25.144330 | PLAY [all] 2026-07-17 12:13:25.155390 | 2026-07-17 12:13:25.155588 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-07-17 12:13:25.634463 | mon1 | changed 2026-07-17 12:13:25.817894 | osd1 | changed 2026-07-17 12:13:25.830399 | 2026-07-17 12:13:25.830501 | PLAY RECAP 2026-07-17 12:13:25.830546 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-07-17 12:13:25.830577 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-07-17 12:13:25.830598 | 2026-07-17 12:13:26.000402 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-07-17 12:13:26.004569 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-07-17 12:13:26.700061 | 2026-07-17 12:13:26.700253 | PLAY [localhost] 2026-07-17 12:13:26.712883 | 2026-07-17 12:13:26.713097 | TASK [Generate Zuul manifest] 2026-07-17 12:13:26.735860 | localhost | ok 2026-07-17 12:13:26.754582 | 2026-07-17 12:13:26.754783 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-07-17 12:13:27.196719 | localhost | changed 2026-07-17 12:13:27.212080 | 2026-07-17 12:13:27.212414 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-07-17 12:13:27.242725 | localhost | ok 2026-07-17 12:13:27.253893 | 2026-07-17 12:13:27.254099 | TASK [Upload logs] 2026-07-17 12:13:27.276240 | localhost | ok 2026-07-17 12:13:27.368147 | 2026-07-17 12:13:27.368435 | TASK [Set zuul-log-path fact] 2026-07-17 12:13:27.388830 | localhost | ok 2026-07-17 12:13:27.407536 | 2026-07-17 12:13:27.407735 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-07-17 12:13:27.438324 | localhost | ok 2026-07-17 12:13:27.449484 | 2026-07-17 12:13:27.449669 | TASK [upload-logs : Create log directories] 2026-07-17 12:13:27.923719 | localhost | changed 2026-07-17 12:13:27.931092 | 2026-07-17 12:13:27.931259 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-07-17 12:13:28.421205 | localhost -> localhost | ok: Runtime: 0:00:00.005665 2026-07-17 12:13:28.428916 | 2026-07-17 12:13:28.429132 | TASK [upload-logs : Upload logs to log server] 2026-07-17 12:13:29.011185 | localhost | Output suppressed because no_log was given 2026-07-17 12:13:29.016774 | 2026-07-17 12:13:29.016942 | LOOP [upload-logs : Compress console log and json output] 2026-07-17 12:13:29.126177 | localhost | skipping: Conditional result was False 2026-07-17 12:13:29.138605 | localhost | skipping: Conditional result was False 2026-07-17 12:13:29.151941 | 2026-07-17 12:13:29.152142 | LOOP [upload-logs : Upload compressed console log and json output] 2026-07-17 12:13:29.251009 | localhost | skipping: Conditional result was False 2026-07-17 12:13:29.251354 | 2026-07-17 12:13:29.259472 | localhost | skipping: Conditional result was False 2026-07-17 12:13:29.321074 | 2026-07-17 12:13:29.321236 | LOOP [upload-logs : Upload console log and json output]