2026-06-25 19:33:09.155033 | Job console starting 2026-06-25 19:33:09.179261 | Updating git repos 2026-06-25 19:33:09.203493 | Cloning repos into workspace 2026-06-25 19:33:13.082703 | Restoring repo states 2026-06-25 19:33:13.102803 | Merging changes 2026-06-25 19:33:15.317361 | Checking out repos 2026-06-25 19:33:17.509263 | Preparing playbooks 2026-06-25 19:33:29.650532 | Running Ansible setup 2026-06-25 19:33:34.862515 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-06-25 19:33:35.659456 | 2026-06-25 19:33:35.810078 | PLAY [localhost] 2026-06-25 19:33:35.825351 | 2026-06-25 19:33:35.825514 | TASK [Gathering Facts] 2026-06-25 19:33:36.849532 | localhost | ok 2026-06-25 19:33:36.862081 | 2026-06-25 19:33:36.862240 | TASK [Setup log path fact] 2026-06-25 19:33:36.885049 | localhost | ok 2026-06-25 19:33:36.900379 | 2026-06-25 19:33:36.900564 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-06-25 19:33:36.933624 | localhost | ok 2026-06-25 19:33:37.018711 | 2026-06-25 19:33:37.018873 | TASK [emit-job-header : Print job information] 2026-06-25 19:33:37.069125 | # Job Information 2026-06-25 19:33:37.193765 | Ansible Version: 2.16.18 2026-06-25 19:33:37.193977 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy 2026-06-25 19:33:37.194039 | Pipeline: check 2026-06-25 19:33:37.194088 | Executor: 2d72f0692154 2026-06-25 19:33:37.194144 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/114 2026-06-25 19:33:37.194199 | Event ID: 61647630-70a3-11f1-9fa9-47e27f910c64 2026-06-25 19:33:37.199800 | 2026-06-25 19:33:37.199901 | LOOP [emit-job-header : Print node information] 2026-06-25 19:33:37.295749 | localhost | ok: 2026-06-25 19:33:37.296001 | localhost | # Node Information 2026-06-25 19:33:37.296033 | localhost | Inventory Hostname: mon1 2026-06-25 19:33:37.296057 | localhost | Hostname: np0000182890 2026-06-25 19:33:37.296079 | localhost | Username: zuul 2026-06-25 19:33:37.296107 | localhost | Distro: Ubuntu 22.04 2026-06-25 19:33:37.296130 | localhost | Provider: yul1 2026-06-25 19:33:37.296158 | localhost | Region: ca-ymq-1 2026-06-25 19:33:37.296185 | localhost | Label: ubuntu-jammy 2026-06-25 19:33:37.296211 | localhost | Product Name: OpenStack Nova 2026-06-25 19:33:37.296237 | localhost | Interface IP: 199.19.213.76 2026-06-25 19:33:37.345664 | localhost | ok: 2026-06-25 19:33:37.345794 | localhost | # Node Information 2026-06-25 19:33:37.345833 | localhost | Inventory Hostname: osd1 2026-06-25 19:33:37.345862 | localhost | Hostname: np0000182891 2026-06-25 19:33:37.345890 | localhost | Username: zuul 2026-06-25 19:33:37.345917 | localhost | Distro: Ubuntu 22.04 2026-06-25 19:33:37.345944 | localhost | Provider: yul1 2026-06-25 19:33:37.345970 | localhost | Region: ca-ymq-1 2026-06-25 19:33:37.345996 | localhost | Label: ubuntu-jammy 2026-06-25 19:33:37.346023 | localhost | Product Name: OpenStack Nova 2026-06-25 19:33:37.346050 | localhost | Interface IP: 199.19.213.193 2026-06-25 19:33:37.358936 | 2026-06-25 19:33:37.359114 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-06-25 19:33:37.845493 | localhost -> localhost | changed 2026-06-25 19:33:37.853863 | 2026-06-25 19:33:37.854262 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-06-25 19:33:39.196016 | localhost -> localhost | changed 2026-06-25 19:33:39.204706 | 2026-06-25 19:33:39.204777 | PLAY [all] 2026-06-25 19:33:39.213890 | 2026-06-25 19:33:39.213970 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-06-25 19:33:39.736733 | mon1 -> localhost | ok 2026-06-25 19:33:39.749334 | 2026-06-25 19:33:39.749646 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-06-25 19:33:39.784651 | mon1 | ok 2026-06-25 19:33:39.789568 | osd1 | ok 2026-06-25 19:33:39.809737 | mon1 | included: /var/lib/zuul/builds/0a641963566640c89e2464eb511edae1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-06-25 19:33:39.809823 | osd1 | included: /var/lib/zuul/builds/0a641963566640c89e2464eb511edae1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-06-25 19:33:39.817253 | 2026-06-25 19:33:39.817582 | TASK [add-build-sshkey : Create Temp SSH key] 2026-06-25 19:33:42.142678 | mon1 -> localhost | Generating public/private rsa key pair. 2026-06-25 19:33:42.142963 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/0a641963566640c89e2464eb511edae1/work/0a641963566640c89e2464eb511edae1_id_rsa 2026-06-25 19:33:42.143015 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/0a641963566640c89e2464eb511edae1/work/0a641963566640c89e2464eb511edae1_id_rsa.pub 2026-06-25 19:33:42.143044 | mon1 -> localhost | The key fingerprint is: 2026-06-25 19:33:42.143070 | mon1 -> localhost | SHA256:gXQ9i2oBScoRBx6iRH3d57ebl5XAopwJVmmRxGCwj50 zuul-build-sshkey 2026-06-25 19:33:42.143092 | mon1 -> localhost | The key's randomart image is: 2026-06-25 19:33:42.143115 | mon1 -> localhost | +---[RSA 3072]----+ 2026-06-25 19:33:42.143136 | mon1 -> localhost | |oo*+oo+o*++ | 2026-06-25 19:33:42.143157 | mon1 -> localhost | |o+ *ooo+ Bo. | 2026-06-25 19:33:42.143201 | mon1 -> localhost | |. + .o. +.oo. | 2026-06-25 19:33:42.143409 | mon1 -> localhost | | =oo..o + | 2026-06-25 19:33:42.143440 | mon1 -> localhost | | ..ES + o o .| 2026-06-25 19:33:42.143463 | mon1 -> localhost | | o = . ..| 2026-06-25 19:33:42.143484 | mon1 -> localhost | | . o o| 2026-06-25 19:33:42.143506 | mon1 -> localhost | | o o | 2026-06-25 19:33:42.143532 | mon1 -> localhost | | . | 2026-06-25 19:33:42.143563 | mon1 -> localhost | +----[SHA256]-----+ 2026-06-25 19:33:42.143734 | mon1 -> localhost | ok: Runtime: 0:00:01.605285 2026-06-25 19:33:42.158984 | 2026-06-25 19:33:42.159168 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-06-25 19:33:42.199279 | mon1 | ok 2026-06-25 19:33:42.204997 | osd1 | ok 2026-06-25 19:33:42.222230 | mon1 | included: /var/lib/zuul/builds/0a641963566640c89e2464eb511edae1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-06-25 19:33:42.222468 | osd1 | included: /var/lib/zuul/builds/0a641963566640c89e2464eb511edae1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-06-25 19:33:42.239686 | 2026-06-25 19:33:42.239785 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-06-25 19:33:42.260048 | mon1 | skipping: Conditional result was False 2026-06-25 19:33:42.281562 | osd1 | skipping: Conditional result was False 2026-06-25 19:33:42.290908 | 2026-06-25 19:33:42.291037 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-06-25 19:33:42.816374 | osd1 | changed 2026-06-25 19:33:42.932826 | mon1 | changed 2026-06-25 19:33:42.945821 | 2026-06-25 19:33:42.946037 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-06-25 19:33:43.145534 | mon1 | ok 2026-06-25 19:33:43.151266 | osd1 | ok 2026-06-25 19:33:43.156087 | 2026-06-25 19:33:43.156205 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-06-25 19:33:43.654086 | osd1 | changed 2026-06-25 19:33:43.660385 | mon1 | changed 2026-06-25 19:33:43.667840 | 2026-06-25 19:33:43.667908 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-06-25 19:33:44.189792 | mon1 | changed 2026-06-25 19:33:44.359400 | osd1 | changed 2026-06-25 19:33:44.370395 | 2026-06-25 19:33:44.371268 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-06-25 19:33:44.399659 | mon1 | skipping: Conditional result was False 2026-06-25 19:33:44.432273 | osd1 | skipping: Conditional result was False 2026-06-25 19:33:44.437845 | 2026-06-25 19:33:44.437918 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-06-25 19:33:44.916576 | mon1 -> localhost | changed 2026-06-25 19:33:44.938861 | 2026-06-25 19:33:44.938979 | TASK [add-build-sshkey : Add back temp key] 2026-06-25 19:33:45.338972 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/0a641963566640c89e2464eb511edae1/work/0a641963566640c89e2464eb511edae1_id_rsa (zuul-build-sshkey) 2026-06-25 19:33:45.339268 | mon1 -> localhost | ok: Runtime: 0:00:00.014711 2026-06-25 19:33:45.363424 | 2026-06-25 19:33:45.363590 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-06-25 19:33:45.664762 | mon1 | ok 2026-06-25 19:33:45.683284 | osd1 | ok 2026-06-25 19:33:45.691324 | 2026-06-25 19:33:45.691428 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-06-25 19:33:45.721264 | mon1 | skipping: Conditional result was False 2026-06-25 19:33:45.732470 | osd1 | skipping: Conditional result was False 2026-06-25 19:33:45.747471 | 2026-06-25 19:33:45.747650 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-06-25 19:33:46.088518 | osd1 | ok 2026-06-25 19:33:46.096882 | mon1 | ok 2026-06-25 19:33:46.105589 | 2026-06-25 19:33:46.105730 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-06-25 19:33:47.169528 | mon1 | Output suppressed because no_log was given 2026-06-25 19:33:47.195239 | osd1 | Output suppressed because no_log was given 2026-06-25 19:33:47.208410 | 2026-06-25 19:33:47.208490 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-06-25 19:33:47.406306 | mon1 | ok: "logs" 2026-06-25 19:33:47.406557 | mon1 | ok: All items complete 2026-06-25 19:33:47.406587 | 2026-06-25 19:33:47.416462 | osd1 | ok: "logs" 2026-06-25 19:33:47.586511 | osd1 | ok: "artifacts" 2026-06-25 19:33:47.601287 | mon1 | ok: "artifacts" 2026-06-25 19:33:47.755332 | osd1 | ok: "docs" 2026-06-25 19:33:47.781675 | mon1 | ok: "docs" 2026-06-25 19:33:47.799184 | 2026-06-25 19:33:47.799369 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-06-25 19:33:47.992249 | mon1 | changed: "logs" 2026-06-25 19:33:49.076378 | mon1 | ok: All items complete 2026-06-25 19:33:49.077618 | 2026-06-25 19:33:49.087640 | osd1 | changed: "logs" 2026-06-25 19:33:49.095657 | mon1 | changed: "artifacts" 2026-06-25 19:33:49.101875 | osd1 | changed: "artifacts" 2026-06-25 19:33:49.107417 | mon1 | changed: "docs" 2026-06-25 19:33:49.112913 | osd1 | changed: "docs" 2026-06-25 19:33:49.133522 | 2026-06-25 19:33:49.133630 | PLAY RECAP 2026-06-25 19:33:49.133681 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-06-25 19:33:49.133712 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-06-25 19:33:49.133737 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-06-25 19:33:49.133755 | 2026-06-25 19:33:49.406667 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-06-25 19:33:49.412850 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-06-25 19:33:50.163862 | 2026-06-25 19:33:50.185100 | PLAY [all] 2026-06-25 19:33:50.203136 | 2026-06-25 19:33:50.203259 | TASK [setup-uv : Extract archive] 2026-06-25 19:33:52.637086 | mon1 | changed 2026-06-25 19:33:53.664862 | osd1 | changed 2026-06-25 19:33:53.672926 | 2026-06-25 19:33:53.673069 | TASK [setup-uv : Print version] 2026-06-25 19:33:54.060849 | osd1 | uv 0.8.13 2026-06-25 19:33:54.066427 | mon1 | uv 0.8.13 2026-06-25 19:33:54.239702 | osd1 | ok: Runtime: 0:00:00.010754 2026-06-25 19:33:54.247512 | mon1 | ok: Runtime: 0:00:00.012484 2026-06-25 19:33:54.260746 | 2026-06-25 19:33:54.260813 | TASK [Install Ansible collection siblings] 2026-06-25 19:33:55.140224 | mon1 | ok: 2026-06-25 19:33:56.632179 | mon1 | Skipping community.general: no checked-out sibling 2026-06-25 19:33:56.632385 | mon1 | Skipping ansible.utils: no checked-out sibling 2026-06-25 19:33:56.632449 | mon1 | Skipping vexxhost.containers: no checked-out sibling 2026-06-25 19:33:56.636622 | 2026-06-25 19:33:56.636865 | PLAY RECAP 2026-06-25 19:33:56.637111 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-06-25 19:33:56.637310 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-06-25 19:33:56.637414 | 2026-06-25 19:33:56.783134 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-06-25 19:33:56.789335 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-06-25 19:33:57.489002 | 2026-06-25 19:33:57.489242 | PLAY [all] 2026-06-25 19:33:57.504141 | 2026-06-25 19:33:57.504257 | LOOP [Check inventory directories] 2026-06-25 19:33:57.853217 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph" 2026-06-25 19:33:58.009822 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory" 2026-06-25 19:33:58.157490 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory" 2026-06-25 19:33:58.174262 | 2026-06-25 19:33:58.174491 | LOOP [Copy inventory file for Zuul] 2026-06-25 19:33:58.969965 | mon1 | changed: 2026-06-25 19:34:00.893383 | mon1 | { 2026-06-25 19:34:00.894383 | mon1 | "ansible_loop_var": "item", 2026-06-25 19:34:00.894524 | mon1 | "changed": false, 2026-06-25 19:34:00.894606 | mon1 | "failed": false, 2026-06-25 19:34:00.894708 | mon1 | "invocation": { 2026-06-25 19:34:00.894775 | mon1 | "module_args": { 2026-06-25 19:34:00.894836 | mon1 | "checksum_algorithm": "sha1", 2026-06-25 19:34:00.894895 | mon1 | "follow": true, 2026-06-25 19:34:00.894959 | mon1 | "get_attributes": true, 2026-06-25 19:34:00.895051 | mon1 | "get_checksum": true, 2026-06-25 19:34:00.895114 | mon1 | "get_mime": true, 2026-06-25 19:34:00.895176 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph" 2026-06-25 19:34:00.895250 | mon1 | } 2026-06-25 19:34:00.895316 | mon1 | }, 2026-06-25 19:34:00.895381 | mon1 | "item": "src/github.com/vexxhost/ansible-collection-ceph", 2026-06-25 19:34:00.895445 | mon1 | "stat": { 2026-06-25 19:34:00.895508 | mon1 | "atime": 1782416027.0584881, 2026-06-25 19:34:00.895574 | mon1 | "attr_flags": "e", 2026-06-25 19:34:00.895659 | mon1 | "attributes": [ 2026-06-25 19:34:00.895749 | mon1 | "extents" 2026-06-25 19:34:00.895823 | mon1 | ], 2026-06-25 19:34:00.895892 | mon1 | "block_size": 4096, 2026-06-25 19:34:00.895999 | mon1 | "blocks": 8, 2026-06-25 19:34:00.896072 | mon1 | "charset": "unknown", 2026-06-25 19:34:00.896141 | mon1 | "ctime": 1782416027.0744925, 2026-06-25 19:34:00.896507 | mon1 | "dev": 64513, 2026-06-25 19:34:00.897375 | mon1 | "device_type": 0, 2026-06-25 19:34:00.897547 | mon1 | "executable": true, 2026-06-25 19:34:00.897598 | mon1 | "exists": true, 2026-06-25 19:34:00.897694 | mon1 | "gid": 1000, 2026-06-25 19:34:00.897769 | mon1 | "gr_name": "zuul", 2026-06-25 19:34:00.898053 | mon1 | "inode": 1041437, 2026-06-25 19:34:00.898174 | mon1 | "isblk": false, 2026-06-25 19:34:00.898257 | mon1 | "ischr": false, 2026-06-25 19:34:00.898296 | mon1 | "isdir": true, 2026-06-25 19:34:00.898348 | mon1 | "isfifo": false, 2026-06-25 19:34:00.898380 | mon1 | "isgid": false, 2026-06-25 19:34:00.898430 | mon1 | "islnk": false, 2026-06-25 19:34:00.898461 | mon1 | "isreg": false, 2026-06-25 19:34:00.898523 | mon1 | "issock": false, 2026-06-25 19:34:00.898617 | mon1 | "isuid": false, 2026-06-25 19:34:00.898653 | mon1 | "mimetype": "unknown", 2026-06-25 19:34:00.898709 | mon1 | "mode": "0755", 2026-06-25 19:34:00.898767 | mon1 | "mtime": 1782415993.5631278, 2026-06-25 19:34:00.898800 | mon1 | "nlink": 10, 2026-06-25 19:34:00.898826 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph", 2026-06-25 19:34:00.898852 | mon1 | "pw_name": "zuul", 2026-06-25 19:34:00.898919 | mon1 | "readable": true, 2026-06-25 19:34:00.898973 | mon1 | "rgrp": true, 2026-06-25 19:34:00.899004 | mon1 | "roth": true, 2026-06-25 19:34:00.899031 | mon1 | "rusr": true, 2026-06-25 19:34:00.899056 | mon1 | "size": 4096, 2026-06-25 19:34:00.899098 | mon1 | "uid": 1000, 2026-06-25 19:34:00.899123 | mon1 | "version": "1692059676", 2026-06-25 19:34:00.899149 | mon1 | "wgrp": false, 2026-06-25 19:34:00.899177 | mon1 | "woth": false, 2026-06-25 19:34:00.899202 | mon1 | "writeable": true, 2026-06-25 19:34:00.899225 | mon1 | "wusr": true, 2026-06-25 19:34:00.899249 | mon1 | "xgrp": true, 2026-06-25 19:34:00.899272 | mon1 | "xoth": true, 2026-06-25 19:34:00.899295 | mon1 | "xusr": true 2026-06-25 19:34:00.899319 | mon1 | } 2026-06-25 19:34:00.899343 | mon1 | } 2026-06-25 19:34:00.899415 | mon1 | ok: All items complete 2026-06-25 19:34:00.899616 | 2026-06-25 19:34:00.902432 | mon1 | skipping: Conditional result was False 2026-06-25 19:34:00.903420 | mon1 | skipping: Conditional result was False 2026-06-25 19:34:00.918426 | 2026-06-25 19:34:00.918598 | LOOP [Switch "ansible_host" to private IP] 2026-06-25 19:34:01.350538 | mon1 | changed: 2 replacements made 2026-06-25 19:34:01.353201 | mon1 | skipping: Conditional result was False 2026-06-25 19:34:01.354156 | mon1 | skipping: Conditional result was False 2026-06-25 19:34:01.371302 | 2026-06-25 19:34:01.371431 | TASK [Run Molecule scenario] 2026-06-25 19:34:01.945707 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-06-25 19:34:02.623223 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-06-25 19:34:02.835153 | mon1 | Using CPython 3.13.7 2026-06-25 19:34:02.835227 | mon1 | Creating virtual environment at: .venv 2026-06-25 19:34:03.134255 | mon1 | Downloading pygments (1.2MiB) 2026-06-25 19:34:03.135545 | mon1 | Downloading netaddr (2.2MiB) 2026-06-25 19:34:03.137823 | mon1 | Downloading cryptography (4.3MiB) 2026-06-25 19:34:03.144074 | mon1 | Downloading ansible-core (2.1MiB) 2026-06-25 19:34:03.375170 | mon1 | Downloading netaddr 2026-06-25 19:34:03.390503 | mon1 | Downloading cryptography 2026-06-25 19:34:03.399968 | mon1 | Downloading pygments 2026-06-25 19:34:03.526276 | mon1 | Downloading ansible-core 2026-06-25 19:34:03.559095 | mon1 | Installed 36 packages in 32ms 2026-06-25 19:34:04.757098 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-06-25 19:34:04.757228 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-06-25 19:34:05.410528 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-06-25 19:34:05.410612 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-06-25 19:34:26.564952 | mon1 | INFO [default > dependency] Executing 2026-06-25 19:34:26.565074 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-06-25 19:34:26.565263 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-06-25 19:34:26.565459 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-06-25 19:34:26.572926 | mon1 | INFO [default > cleanup] Executing 2026-06-25 19:34:26.573313 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-06-25 19:34:26.580454 | mon1 | INFO [default > destroy] Executing 2026-06-25 19:34:26.580524 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-06-25 19:34:26.580618 | mon1 | INFO [default > destroy] Executed: Successful 2026-06-25 19:34:26.587290 | mon1 | INFO [default > syntax] Executing 2026-06-25 19:34:27.597997 | mon1 | 2026-06-25 19:34:27.598083 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-06-25 19:34:27.651518 | mon1 | INFO [default > syntax] Executed: Successful 2026-06-25 19:34:27.659602 | mon1 | INFO [default > create] Executing 2026-06-25 19:34:27.661402 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-06-25 19:34:27.668336 | mon1 | INFO [default > prepare] Executing 2026-06-25 19:34:28.378332 | mon1 | 2026-06-25 19:34:28.378414 | mon1 | PLAY [Prepare] ***************************************************************** 2026-06-25 19:34:28.378562 | mon1 | 2026-06-25 19:34:28.378699 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-06-25 19:34:28.378835 | mon1 | Thursday 25 June 2026 19:34:28 +0000 (0:00:00.033) 0:00:00.033 ********* 2026-06-25 19:34:29.553653 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-06-25 19:34:29.553863 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-06-25 19:34:29.554074 | mon1 | interpreter could change the meaning of that path. See 2026-06-25 19:34:29.554313 | mon1 | https://docs.ansible.com/ansible- 2026-06-25 19:34:29.554533 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-06-25 19:34:29.569530 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-06-25 19:34:29.569722 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-06-25 19:34:29.569921 | mon1 | interpreter could change the meaning of that path. See 2026-06-25 19:34:29.570109 | mon1 | https://docs.ansible.com/ansible- 2026-06-25 19:34:29.570302 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-06-25 19:34:29.576575 | mon1 | ok: [osd1] 2026-06-25 19:34:29.576695 | mon1 | ok: [mon1] 2026-06-25 19:34:29.576812 | mon1 | 2026-06-25 19:34:29.576943 | mon1 | TASK [Configure short hostname] ************************************************ 2026-06-25 19:34:29.577073 | mon1 | Thursday 25 June 2026 19:34:29 +0000 (0:00:01.198) 0:00:01.232 ********* 2026-06-25 19:34:31.698565 | mon1 | changed: [mon1] 2026-06-25 19:34:31.698755 | mon1 | changed: [osd1] 2026-06-25 19:34:31.698940 | mon1 | 2026-06-25 19:34:31.699143 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-06-25 19:34:31.699397 | mon1 | Thursday 25 June 2026 19:34:31 +0000 (0:00:02.121) 0:00:03.353 ********* 2026-06-25 19:34:31.990714 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-06-25 19:34:31.990825 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-06-25 19:34:31.990965 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-06-25 19:34:32.011181 | mon1 | changed: [mon1] 2026-06-25 19:34:32.011294 | mon1 | changed: [osd1] 2026-06-25 19:34:32.011458 | mon1 | 2026-06-25 19:34:32.011603 | mon1 | TASK [Update apt cache] ******************************************************** 2026-06-25 19:34:32.011774 | mon1 | Thursday 25 June 2026 19:34:32 +0000 (0:00:00.312) 0:00:03.666 ********* 2026-06-25 19:34:52.425439 | mon1 | changed: [mon1] 2026-06-25 19:34:52.426452 | mon1 | changed: [osd1] 2026-06-25 19:34:52.426463 | mon1 | 2026-06-25 19:34:52.426468 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-06-25 19:34:52.426473 | mon1 | 2026-06-25 19:34:52.426478 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-06-25 19:34:52.426674 | mon1 | Thursday 25 June 2026 19:34:52 +0000 (0:00:20.414) 0:00:24.081 ********* 2026-06-25 19:34:53.159117 | mon1 | ok: [osd1] 2026-06-25 19:34:53.159304 | mon1 | 2026-06-25 19:34:53.159525 | mon1 | TASK [Install depedencies] ***************************************************** 2026-06-25 19:34:53.159791 | mon1 | Thursday 25 June 2026 19:34:53 +0000 (0:00:00.733) 0:00:24.814 ********* 2026-06-25 19:35:12.985030 | mon1 | changed: [osd1] 2026-06-25 19:35:12.985154 | mon1 | 2026-06-25 19:35:12.985166 | mon1 | TASK [Start up service] ******************************************************** 2026-06-25 19:35:12.985271 | mon1 | Thursday 25 June 2026 19:35:12 +0000 (0:00:19.825) 0:00:44.640 ********* 2026-06-25 19:35:13.607380 | mon1 | ok: [osd1] 2026-06-25 19:35:13.607575 | mon1 | 2026-06-25 19:35:13.607855 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-06-25 19:35:13.608070 | mon1 | Thursday 25 June 2026 19:35:13 +0000 (0:00:00.622) 0:00:45.262 ********* 2026-06-25 19:35:13.919641 | mon1 | ok: [osd1] 2026-06-25 19:35:13.919782 | mon1 | 2026-06-25 19:35:13.919997 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-06-25 19:35:13.920274 | mon1 | Thursday 25 June 2026 19:35:13 +0000 (0:00:00.312) 0:00:45.575 ********* 2026-06-25 19:35:14.598206 | mon1 | changed: [osd1] 2026-06-25 19:35:14.598442 | mon1 | 2026-06-25 19:35:14.598746 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-06-25 19:35:14.598909 | mon1 | Thursday 25 June 2026 19:35:14 +0000 (0:00:00.678) 0:00:46.253 ********* 2026-06-25 19:35:14.794094 | mon1 | ok: [osd1] 2026-06-25 19:35:14.794330 | mon1 | 2026-06-25 19:35:14.794518 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-06-25 19:35:14.794660 | mon1 | Thursday 25 June 2026 19:35:14 +0000 (0:00:00.196) 0:00:46.449 ********* 2026-06-25 19:35:14.810570 | mon1 | skipping: [osd1] 2026-06-25 19:35:14.810744 | mon1 | 2026-06-25 19:35:14.810960 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-06-25 19:35:14.811170 | mon1 | Thursday 25 June 2026 19:35:14 +0000 (0:00:00.016) 0:00:46.465 ********* 2026-06-25 19:35:15.391457 | mon1 | changed: [osd1] => (item=osd0) 2026-06-25 19:35:15.391545 | mon1 | changed: [osd1] => (item=osd1) 2026-06-25 19:35:15.391719 | mon1 | changed: [osd1] => (item=osd2) 2026-06-25 19:35:15.391884 | mon1 | 2026-06-25 19:35:15.391988 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-06-25 19:35:15.392152 | mon1 | Thursday 25 June 2026 19:35:15 +0000 (0:00:00.580) 0:00:47.046 ********* 2026-06-25 19:35:16.022593 | mon1 | changed: [osd1] => (item=osd0) 2026-06-25 19:35:16.022803 | mon1 | changed: [osd1] => (item=osd1) 2026-06-25 19:35:16.023037 | mon1 | changed: [osd1] => (item=osd2) 2026-06-25 19:35:16.023231 | mon1 | 2026-06-25 19:35:16.023450 | mon1 | TASK [Start loop devices] ****************************************************** 2026-06-25 19:35:16.023703 | mon1 | Thursday 25 June 2026 19:35:16 +0000 (0:00:00.631) 0:00:47.677 ********* 2026-06-25 19:35:16.747046 | mon1 | changed: [osd1] => (item=osd0) 2026-06-25 19:35:16.747152 | mon1 | changed: [osd1] => (item=osd1) 2026-06-25 19:35:16.747164 | mon1 | changed: [osd1] => (item=osd2) 2026-06-25 19:35:16.747238 | mon1 | 2026-06-25 19:35:16.747329 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-06-25 19:35:16.747422 | mon1 | Thursday 25 June 2026 19:35:16 +0000 (0:00:00.724) 0:00:48.402 ********* 2026-06-25 19:35:19.696834 | mon1 | changed: [osd1] => (item=osd0) 2026-06-25 19:35:19.696948 | mon1 | changed: [osd1] => (item=osd1) 2026-06-25 19:35:19.697089 | mon1 | changed: [osd1] => (item=osd2) 2026-06-25 19:35:19.697211 | mon1 | 2026-06-25 19:35:19.697401 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-06-25 19:35:19.697568 | mon1 | Thursday 25 June 2026 19:35:19 +0000 (0:00:02.949) 0:00:51.352 ********* 2026-06-25 19:35:21.644027 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-06-25 19:35:21.644110 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-06-25 19:35:21.644246 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-06-25 19:35:21.644358 | mon1 | 2026-06-25 19:35:21.644538 | mon1 | PLAY RECAP ********************************************************************* 2026-06-25 19:35:21.644626 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-06-25 19:35:21.644772 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-06-25 19:35:21.644888 | mon1 | 2026-06-25 19:35:21.645016 | mon1 | 2026-06-25 19:35:21.645210 | mon1 | TASKS RECAP ******************************************************************** 2026-06-25 19:35:21.645361 | mon1 | Thursday 25 June 2026 19:35:21 +0000 (0:00:01.947) 0:00:53.299 ********* 2026-06-25 19:35:21.645494 | mon1 | =============================================================================== 2026-06-25 19:35:21.645632 | mon1 | Update apt cache ------------------------------------------------------- 20.41s 2026-06-25 19:35:21.645769 | mon1 | Install depedencies ---------------------------------------------------- 19.83s 2026-06-25 19:35:21.645903 | mon1 | Create a volume group for each loop device ------------------------------ 2.95s 2026-06-25 19:35:21.646028 | mon1 | Configure short hostname ------------------------------------------------ 2.12s 2026-06-25 19:35:21.646147 | mon1 | Create a logical volume for each loop device ---------------------------- 1.95s 2026-06-25 19:35:21.646263 | mon1 | Gathering Facts --------------------------------------------------------- 1.20s 2026-06-25 19:35:21.646394 | mon1 | Gathering Facts --------------------------------------------------------- 0.73s 2026-06-25 19:35:21.646519 | mon1 | Start loop devices ------------------------------------------------------ 0.72s 2026-06-25 19:35:21.646641 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.68s 2026-06-25 19:35:21.646759 | mon1 | Set permissions on loopback devices ------------------------------------- 0.63s 2026-06-25 19:35:21.646868 | mon1 | Start up service -------------------------------------------------------- 0.62s 2026-06-25 19:35:21.646978 | mon1 | Create devices for Ceph ------------------------------------------------- 0.58s 2026-06-25 19:35:21.647095 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.31s 2026-06-25 19:35:21.647218 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.31s 2026-06-25 19:35:21.647363 | mon1 | Get list of all loopback devices ---------------------------------------- 0.20s 2026-06-25 19:35:21.647496 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-06-25 19:35:21.711886 | mon1 | INFO [default > prepare] Executed: Successful 2026-06-25 19:35:21.718799 | mon1 | INFO [default > converge] Executing 2026-06-25 19:35:22.633704 | mon1 | 2026-06-25 19:35:22.633895 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-06-25 19:35:22.634085 | mon1 | 2026-06-25 19:35:22.634293 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-06-25 19:35:22.634571 | mon1 | Thursday 25 June 2026 19:35:22 +0000 (0:00:00.048) 0:00:00.048 ********* 2026-06-25 19:35:23.712053 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-06-25 19:35:23.712140 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-06-25 19:35:23.712298 | mon1 | interpreter could change the meaning of that path. See 2026-06-25 19:35:23.712441 | mon1 | https://docs.ansible.com/ansible- 2026-06-25 19:35:23.712560 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-06-25 19:35:23.724278 | mon1 | ok: [mon1] 2026-06-25 19:35:23.724497 | mon1 | 2026-06-25 19:35:23.724755 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-06-25 19:35:23.725067 | mon1 | Thursday 25 June 2026 19:35:23 +0000 (0:00:01.090) 0:00:01.138 ********* 2026-06-25 19:35:24.046929 | mon1 | ok: [mon1] 2026-06-25 19:35:24.046983 | mon1 | 2026-06-25 19:35:24.047085 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-06-25 19:35:24.047177 | mon1 | Thursday 25 June 2026 19:35:24 +0000 (0:00:00.322) 0:00:01.461 ********* 2026-06-25 19:35:24.083189 | mon1 | skipping: [mon1] 2026-06-25 19:35:24.083278 | mon1 | 2026-06-25 19:35:24.083431 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-06-25 19:35:24.083572 | mon1 | Thursday 25 June 2026 19:35:24 +0000 (0:00:00.036) 0:00:01.497 ********* 2026-06-25 19:35:24.404535 | mon1 | changed: [mon1] 2026-06-25 19:35:24.404782 | mon1 | 2026-06-25 19:35:24.405034 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-06-25 19:35:24.405256 | mon1 | Thursday 25 June 2026 19:35:24 +0000 (0:00:00.321) 0:00:01.818 ********* 2026-06-25 19:35:24.514557 | mon1 | ok: [mon1] => { 2026-06-25 19:35:24.514734 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-06-25 19:35:24.514907 | mon1 | } 2026-06-25 19:35:24.515073 | mon1 | 2026-06-25 19:35:24.515286 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-06-25 19:35:24.515439 | mon1 | Thursday 25 June 2026 19:35:24 +0000 (0:00:00.110) 0:00:01.928 ********* 2026-06-25 19:35:25.216004 | mon1 | changed: [mon1] 2026-06-25 19:35:25.216194 | mon1 | 2026-06-25 19:35:25.216428 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-06-25 19:35:25.216663 | mon1 | Thursday 25 June 2026 19:35:25 +0000 (0:00:00.701) 0:00:02.630 ********* 2026-06-25 19:35:25.258483 | mon1 | skipping: [mon1] 2026-06-25 19:35:25.258655 | mon1 | 2026-06-25 19:35:25.258871 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-06-25 19:35:25.259085 | mon1 | Thursday 25 June 2026 19:35:25 +0000 (0:00:00.042) 0:00:02.672 ********* 2026-06-25 19:35:25.301381 | mon1 | skipping: [mon1] 2026-06-25 19:35:25.301515 | mon1 | 2026-06-25 19:35:25.301724 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-06-25 19:35:25.301934 | mon1 | Thursday 25 June 2026 19:35:25 +0000 (0:00:00.042) 0:00:02.715 ********* 2026-06-25 19:35:25.507228 | mon1 | ok: [mon1] 2026-06-25 19:35:25.507333 | mon1 | 2026-06-25 19:35:25.507579 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-06-25 19:35:25.507839 | mon1 | Thursday 25 June 2026 19:35:25 +0000 (0:00:00.205) 0:00:02.921 ********* 2026-06-25 19:35:26.756876 | mon1 | ok: [mon1] 2026-06-25 19:35:26.757129 | mon1 | 2026-06-25 19:35:26.757342 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-06-25 19:35:26.757533 | mon1 | Thursday 25 June 2026 19:35:26 +0000 (0:00:01.250) 0:00:04.171 ********* 2026-06-25 19:35:26.836194 | mon1 | ok: [mon1] => { 2026-06-25 19:35:26.836294 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz" 2026-06-25 19:35:26.836483 | mon1 | } 2026-06-25 19:35:26.836699 | mon1 | 2026-06-25 19:35:26.836880 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-06-25 19:35:26.837057 | mon1 | Thursday 25 June 2026 19:35:26 +0000 (0:00:00.078) 0:00:04.249 ********* 2026-06-25 19:35:27.716101 | mon1 | changed: [mon1] 2026-06-25 19:35:27.716173 | mon1 | 2026-06-25 19:35:27.716299 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-06-25 19:35:27.716476 | mon1 | Thursday 25 June 2026 19:35:27 +0000 (0:00:00.880) 0:00:05.129 ********* 2026-06-25 19:35:30.556177 | mon1 | changed: [mon1] 2026-06-25 19:35:30.556335 | mon1 | 2026-06-25 19:35:30.556348 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-06-25 19:35:30.556384 | mon1 | Thursday 25 June 2026 19:35:30 +0000 (0:00:02.840) 0:00:07.970 ********* 2026-06-25 19:35:30.584826 | mon1 | skipping: [mon1] 2026-06-25 19:35:30.584863 | mon1 | 2026-06-25 19:35:30.584980 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-06-25 19:35:30.585100 | mon1 | Thursday 25 June 2026 19:35:30 +0000 (0:00:00.029) 0:00:07.999 ********* 2026-06-25 19:35:30.616839 | mon1 | skipping: [mon1] 2026-06-25 19:35:30.616910 | mon1 | 2026-06-25 19:35:30.617232 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-06-25 19:35:30.617273 | mon1 | Thursday 25 June 2026 19:35:30 +0000 (0:00:00.031) 0:00:08.031 ********* 2026-06-25 19:35:30.648556 | mon1 | skipping: [mon1] 2026-06-25 19:35:30.648968 | mon1 | 2026-06-25 19:35:30.649007 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-06-25 19:35:30.649015 | mon1 | Thursday 25 June 2026 19:35:30 +0000 (0:00:00.031) 0:00:08.063 ********* 2026-06-25 19:35:37.899613 | mon1 | changed: [mon1] 2026-06-25 19:35:37.899821 | mon1 | 2026-06-25 19:35:37.899836 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-06-25 19:35:37.899936 | mon1 | Thursday 25 June 2026 19:35:37 +0000 (0:00:07.251) 0:00:15.314 ********* 2026-06-25 19:35:38.429087 | mon1 | changed: [mon1] 2026-06-25 19:35:38.429156 | mon1 | 2026-06-25 19:35:38.429481 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-06-25 19:35:38.429530 | mon1 | Thursday 25 June 2026 19:35:38 +0000 (0:00:00.529) 0:00:15.843 ********* 2026-06-25 19:35:39.360289 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-06-25 19:35:39.360417 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-06-25 19:35:39.360437 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-06-25 19:35:39.360515 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-06-25 19:35:39.360926 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-06-25 19:35:39.361004 | mon1 | 2026-06-25 19:35:39.361011 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-06-25 19:35:39.361017 | mon1 | Thursday 25 June 2026 19:35:39 +0000 (0:00:00.930) 0:00:16.774 ********* 2026-06-25 19:35:39.954969 | mon1 | changed: [mon1] 2026-06-25 19:35:39.955032 | mon1 | 2026-06-25 19:35:39.955105 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-06-25 19:35:39.955499 | mon1 | Thursday 25 June 2026 19:35:39 +0000 (0:00:00.587) 0:00:17.361 ********* 2026-06-25 19:35:39.955547 | mon1 | 2026-06-25 19:35:39.955553 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-06-25 19:35:39.955557 | mon1 | Thursday 25 June 2026 19:35:39 +0000 (0:00:00.007) 0:00:17.369 ********* 2026-06-25 19:35:40.889356 | mon1 | ok: [mon1] 2026-06-25 19:35:40.889459 | mon1 | 2026-06-25 19:35:40.889599 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-06-25 19:35:40.889752 | mon1 | Thursday 25 June 2026 19:35:40 +0000 (0:00:00.934) 0:00:18.304 ********* 2026-06-25 19:35:41.320157 | mon1 | changed: [mon1] 2026-06-25 19:35:41.320219 | mon1 | 2026-06-25 19:35:41.320225 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-06-25 19:35:41.320229 | mon1 | Thursday 25 June 2026 19:35:41 +0000 (0:00:00.430) 0:00:18.734 ********* 2026-06-25 19:35:41.833872 | mon1 | changed: [mon1] 2026-06-25 19:35:41.833953 | mon1 | 2026-06-25 19:35:41.833961 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-06-25 19:35:41.833969 | mon1 | Thursday 25 June 2026 19:35:41 +0000 (0:00:00.513) 0:00:19.248 ********* 2026-06-25 19:35:42.021844 | mon1 | ok: [mon1] 2026-06-25 19:35:42.021947 | mon1 | 2026-06-25 19:35:42.022004 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-06-25 19:35:42.022131 | mon1 | Thursday 25 June 2026 19:35:42 +0000 (0:00:00.188) 0:00:19.436 ********* 2026-06-25 19:35:42.106783 | mon1 | ok: [mon1] => { 2026-06-25 19:35:42.106852 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-06-25 19:35:42.106937 | mon1 | } 2026-06-25 19:35:42.107244 | mon1 | 2026-06-25 19:35:42.107288 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-06-25 19:35:42.107294 | mon1 | Thursday 25 June 2026 19:35:42 +0000 (0:00:00.084) 0:00:19.521 ********* 2026-06-25 19:35:43.093150 | mon1 | changed: [mon1] 2026-06-25 19:35:43.093242 | mon1 | 2026-06-25 19:35:43.093534 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-06-25 19:35:43.093592 | mon1 | Thursday 25 June 2026 19:35:43 +0000 (0:00:00.986) 0:00:20.507 ********* 2026-06-25 19:35:47.548799 | mon1 | changed: [mon1] 2026-06-25 19:35:47.548893 | mon1 | 2026-06-25 19:35:47.549113 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-06-25 19:35:47.549156 | mon1 | Thursday 25 June 2026 19:35:47 +0000 (0:00:04.455) 0:00:24.963 ********* 2026-06-25 19:35:48.628581 | mon1 | ok: [mon1] 2026-06-25 19:35:48.629194 | mon1 | 2026-06-25 19:35:48.629240 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-06-25 19:35:48.629246 | mon1 | Thursday 25 June 2026 19:35:48 +0000 (0:00:01.079) 0:00:26.042 ********* 2026-06-25 19:35:48.993162 | mon1 | changed: [mon1] 2026-06-25 19:35:48.993228 | mon1 | 2026-06-25 19:35:48.993441 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-06-25 19:35:48.993490 | mon1 | Thursday 25 June 2026 19:35:48 +0000 (0:00:00.364) 0:00:26.407 ********* 2026-06-25 19:35:49.448824 | mon1 | changed: [mon1] 2026-06-25 19:35:49.448898 | mon1 | 2026-06-25 19:35:49.448959 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-06-25 19:35:49.449084 | mon1 | Thursday 25 June 2026 19:35:49 +0000 (0:00:00.455) 0:00:26.863 ********* 2026-06-25 19:35:50.017512 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-06-25 19:35:50.017615 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-06-25 19:35:50.018151 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-06-25 19:35:50.018172 | mon1 | 2026-06-25 19:35:50.018180 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-06-25 19:35:50.018186 | mon1 | Thursday 25 June 2026 19:35:50 +0000 (0:00:00.568) 0:00:27.432 ********* 2026-06-25 19:35:50.455088 | mon1 | changed: [mon1] 2026-06-25 19:35:50.455157 | mon1 | 2026-06-25 19:35:50.455239 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-06-25 19:35:50.455377 | mon1 | Thursday 25 June 2026 19:35:50 +0000 (0:00:00.437) 0:00:27.869 ********* 2026-06-25 19:35:50.899794 | mon1 | changed: [mon1] 2026-06-25 19:35:50.899876 | mon1 | 2026-06-25 19:35:50.900558 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-06-25 19:35:50.900579 | mon1 | Thursday 25 June 2026 19:35:50 +0000 (0:00:00.436) 0:00:28.306 ********* 2026-06-25 19:35:50.900586 | mon1 | 2026-06-25 19:35:50.900592 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-06-25 19:35:50.900609 | mon1 | Thursday 25 June 2026 19:35:50 +0000 (0:00:00.007) 0:00:28.314 ********* 2026-06-25 19:35:51.557339 | mon1 | ok: [mon1] 2026-06-25 19:35:51.557422 | mon1 | 2026-06-25 19:35:51.557464 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-06-25 19:35:51.557594 | mon1 | Thursday 25 June 2026 19:35:51 +0000 (0:00:00.657) 0:00:28.972 ********* 2026-06-25 19:35:52.922911 | mon1 | changed: [mon1] 2026-06-25 19:35:52.922986 | mon1 | 2026-06-25 19:35:52.923326 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-06-25 19:35:52.923377 | mon1 | Thursday 25 June 2026 19:35:52 +0000 (0:00:01.365) 0:00:30.337 ********* 2026-06-25 19:35:53.423908 | mon1 | changed: [mon1] 2026-06-25 19:35:53.423982 | mon1 | 2026-06-25 19:35:53.423995 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-06-25 19:35:53.424005 | mon1 | Thursday 25 June 2026 19:35:53 +0000 (0:00:00.500) 0:00:30.838 ********* 2026-06-25 19:35:53.467482 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-06-25 19:35:53.467568 | mon1 | 2026-06-25 19:35:53.467584 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-06-25 19:35:53.467792 | mon1 | Thursday 25 June 2026 19:35:53 +0000 (0:00:00.044) 0:00:30.882 ********* 2026-06-25 19:36:18.938582 | mon1 | changed: [mon1] 2026-06-25 19:36:18.938655 | mon1 | 2026-06-25 19:36:18.938957 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-06-25 19:36:18.938976 | mon1 | Thursday 25 June 2026 19:36:18 +0000 (0:00:25.471) 0:00:56.353 ********* 2026-06-25 19:36:19.570249 | mon1 | ok: [mon1] => (item=chronyd) 2026-06-25 19:36:19.571069 | mon1 | ok: [mon1] => (item=sshd) 2026-06-25 19:36:19.571195 | mon1 | 2026-06-25 19:36:19.571211 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-06-25 19:36:19.571221 | mon1 | Thursday 25 June 2026 19:36:19 +0000 (0:00:00.631) 0:00:56.984 ********* 2026-06-25 19:36:19.886964 | mon1 | changed: [mon1] 2026-06-25 19:36:19.887100 | mon1 | 2026-06-25 19:36:19.887156 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-06-25 19:36:19.887286 | mon1 | Thursday 25 June 2026 19:36:19 +0000 (0:00:00.317) 0:00:57.301 ********* 2026-06-25 19:36:20.083148 | mon1 | ok: [mon1] 2026-06-25 19:36:20.083207 | mon1 | 2026-06-25 19:36:20.083420 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-06-25 19:36:20.083477 | mon1 | Thursday 25 June 2026 19:36:20 +0000 (0:00:00.196) 0:00:57.497 ********* 2026-06-25 19:36:20.532945 | mon1 | changed: [mon1] 2026-06-25 19:36:20.533021 | mon1 | 2026-06-25 19:36:20.533212 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-06-25 19:36:20.533229 | mon1 | Thursday 25 June 2026 19:36:20 +0000 (0:00:00.449) 0:00:57.947 ********* 2026-06-25 19:36:20.875000 | mon1 | changed: [mon1] 2026-06-25 19:36:20.875063 | mon1 | 2026-06-25 19:36:20.875286 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-06-25 19:36:20.875334 | mon1 | Thursday 25 June 2026 19:36:20 +0000 (0:00:00.342) 0:00:58.289 ********* 2026-06-25 19:36:20.993103 | mon1 | ok: [mon1] 2026-06-25 19:36:20.993191 | mon1 | 2026-06-25 19:36:20.993488 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-06-25 19:36:20.993550 | mon1 | Thursday 25 June 2026 19:36:20 +0000 (0:00:00.117) 0:00:58.407 ********* 2026-06-25 19:36:21.203328 | mon1 | ok: [mon1] => (item=mon1) 2026-06-25 19:36:21.203408 | mon1 | 2026-06-25 19:36:21.203606 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-06-25 19:36:21.203623 | mon1 | Thursday 25 June 2026 19:36:21 +0000 (0:00:00.210) 0:00:58.617 ********* 2026-06-25 19:36:21.251453 | mon1 | ok: [mon1] 2026-06-25 19:36:21.251516 | mon1 | 2026-06-25 19:36:21.251610 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-06-25 19:36:21.251727 | mon1 | Thursday 25 June 2026 19:36:21 +0000 (0:00:00.048) 0:00:58.666 ********* 2026-06-25 19:36:21.349376 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-06-25 19:36:21.349449 | mon1 | 2026-06-25 19:36:21.349619 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-06-25 19:36:21.349635 | mon1 | Thursday 25 June 2026 19:36:21 +0000 (0:00:00.098) 0:00:58.764 ********* 2026-06-25 19:36:21.620222 | mon1 | changed: [mon1] 2026-06-25 19:36:21.620303 | mon1 | 2026-06-25 19:36:21.620625 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-06-25 19:36:21.620687 | mon1 | Thursday 25 June 2026 19:36:21 +0000 (0:00:00.270) 0:00:59.034 ********* 2026-06-25 19:36:22.290430 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-06-25 19:36:22.291090 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-06-25 19:36:22.291210 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-06-25 19:36:22.291218 | mon1 | 2026-06-25 19:36:22.291225 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-06-25 19:36:22.291231 | mon1 | Thursday 25 June 2026 19:36:22 +0000 (0:00:00.670) 0:00:59.705 ********* 2026-06-25 19:38:45.666410 | mon1 | ok: [mon1] 2026-06-25 19:38:45.666468 | mon1 | 2026-06-25 19:38:45.666476 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-06-25 19:38:45.666484 | mon1 | Thursday 25 June 2026 19:38:45 +0000 (0:02:23.375) 0:03:23.080 ********* 2026-06-25 19:38:45.905461 | mon1 | changed: [mon1] 2026-06-25 19:38:45.905540 | mon1 | 2026-06-25 19:38:45.905872 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-06-25 19:38:45.905925 | mon1 | Thursday 25 June 2026 19:38:45 +0000 (0:00:00.239) 0:03:23.320 ********* 2026-06-25 19:38:45.940479 | mon1 | ok: [mon1] 2026-06-25 19:38:45.940540 | mon1 | 2026-06-25 19:38:45.940636 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-06-25 19:38:45.940774 | mon1 | Thursday 25 June 2026 19:38:45 +0000 (0:00:00.035) 0:03:23.355 ********* 2026-06-25 19:38:45.999883 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-06-25 19:38:45.999961 | mon1 | 2026-06-25 19:38:45.999973 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-06-25 19:38:45.999990 | mon1 | Thursday 25 June 2026 19:38:45 +0000 (0:00:00.059) 0:03:23.414 ********* 2026-06-25 19:38:51.482524 | mon1 | ok: [mon1] 2026-06-25 19:38:51.482600 | mon1 | 2026-06-25 19:38:51.482615 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-06-25 19:38:51.482627 | mon1 | Thursday 25 June 2026 19:38:51 +0000 (0:00:05.481) 0:03:28.895 ********* 2026-06-25 19:38:51.532004 | mon1 | ok: [mon1] => (item=mon1) 2026-06-25 19:38:51.532090 | mon1 | 2026-06-25 19:38:51.532148 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-06-25 19:38:51.532257 | mon1 | Thursday 25 June 2026 19:38:51 +0000 (0:00:00.050) 0:03:28.946 ********* 2026-06-25 19:38:51.909973 | mon1 | ok: [mon1] 2026-06-25 19:38:51.910048 | mon1 | 2026-06-25 19:38:51.910341 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-06-25 19:38:51.910392 | mon1 | Thursday 25 June 2026 19:38:51 +0000 (0:00:00.378) 0:03:29.324 ********* 2026-06-25 19:38:59.206885 | mon1 | ok: [mon1] 2026-06-25 19:38:59.206972 | mon1 | 2026-06-25 19:38:59.206979 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-06-25 19:38:59.206985 | mon1 | Thursday 25 June 2026 19:38:59 +0000 (0:00:07.296) 0:03:36.620 ********* 2026-06-25 19:39:11.650636 | mon1 | changed: [mon1] 2026-06-25 19:39:11.650723 | mon1 | 2026-06-25 19:39:11.650740 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-06-25 19:39:11.650866 | mon1 | Thursday 25 June 2026 19:39:11 +0000 (0:00:12.444) 0:03:49.065 ********* 2026-06-25 19:39:25.692974 | mon1 | ok: [mon1] 2026-06-25 19:39:25.693063 | mon1 | 2026-06-25 19:39:25.693149 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-06-25 19:39:25.693303 | mon1 | Thursday 25 June 2026 19:39:25 +0000 (0:00:14.041) 0:04:03.107 ********* 2026-06-25 19:39:25.759066 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-06-25 19:39:25.759203 | mon1 | 2026-06-25 19:39:25.759220 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-06-25 19:39:25.759423 | mon1 | Thursday 25 June 2026 19:39:25 +0000 (0:00:00.066) 0:04:03.173 ********* 2026-06-25 19:39:25.798132 | mon1 | skipping: [mon1] 2026-06-25 19:39:25.798204 | mon1 | 2026-06-25 19:39:25.798416 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-06-25 19:39:25.798469 | mon1 | Thursday 25 June 2026 19:39:25 +0000 (0:00:00.039) 0:04:03.212 ********* 2026-06-25 19:39:25.841829 | mon1 | skipping: [mon1] => (item=mon1) 2026-06-25 19:39:25.841907 | mon1 | skipping: [mon1] 2026-06-25 19:39:25.842371 | mon1 | 2026-06-25 19:39:25.842428 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-06-25 19:39:25.842438 | mon1 | Thursday 25 June 2026 19:39:25 +0000 (0:00:00.043) 0:04:03.256 ********* 2026-06-25 19:39:26.100115 | mon1 | ok: [mon1] 2026-06-25 19:39:26.100191 | mon1 | 2026-06-25 19:39:26.100254 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-06-25 19:39:26.100416 | mon1 | Thursday 25 June 2026 19:39:26 +0000 (0:00:00.258) 0:04:03.514 ********* 2026-06-25 19:39:32.523353 | mon1 | ok: [mon1] 2026-06-25 19:39:32.523431 | mon1 | 2026-06-25 19:39:32.523632 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-06-25 19:39:32.523647 | mon1 | Thursday 25 June 2026 19:39:32 +0000 (0:00:06.423) 0:04:09.938 ********* 2026-06-25 19:39:44.445534 | mon1 | changed: [mon1] 2026-06-25 19:39:44.445607 | mon1 | 2026-06-25 19:39:44.445832 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-06-25 19:39:44.445874 | mon1 | Thursday 25 June 2026 19:39:44 +0000 (0:00:11.922) 0:04:21.860 ********* 2026-06-25 19:39:51.961075 | mon1 | ok: [mon1] 2026-06-25 19:39:51.961154 | mon1 | 2026-06-25 19:39:51.961476 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-06-25 19:39:51.961528 | mon1 | Thursday 25 June 2026 19:39:51 +0000 (0:00:07.515) 0:04:29.375 ********* 2026-06-25 19:39:58.134655 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-06-25 19:39:58.134731 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-06-25 19:39:58.134782 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-06-25 19:39:58.134881 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-06-25 19:39:58.134969 | mon1 | 2026-06-25 19:39:58.135064 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-06-25 19:39:58.135139 | mon1 | 2026-06-25 19:39:58.135241 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-06-25 19:39:58.135329 | mon1 | Thursday 25 June 2026 19:39:58 +0000 (0:00:06.173) 0:04:35.549 ********* 2026-06-25 19:39:59.238446 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-06-25 19:39:59.238637 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-06-25 19:39:59.238788 | mon1 | interpreter could change the meaning of that path. See 2026-06-25 19:39:59.239039 | mon1 | https://docs.ansible.com/ansible- 2026-06-25 19:39:59.239204 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-06-25 19:39:59.251153 | mon1 | ok: [osd1] 2026-06-25 19:39:59.251251 | mon1 | 2026-06-25 19:39:59.251403 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-06-25 19:39:59.251560 | mon1 | Thursday 25 June 2026 19:39:59 +0000 (0:00:01.116) 0:04:36.665 ********* 2026-06-25 19:39:59.453524 | mon1 | ok: [osd1] 2026-06-25 19:39:59.453596 | mon1 | 2026-06-25 19:39:59.453649 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-06-25 19:39:59.453752 | mon1 | Thursday 25 June 2026 19:39:59 +0000 (0:00:00.202) 0:04:36.868 ********* 2026-06-25 19:39:59.486655 | mon1 | skipping: [osd1] 2026-06-25 19:39:59.486723 | mon1 | 2026-06-25 19:39:59.486802 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-06-25 19:39:59.486891 | mon1 | Thursday 25 June 2026 19:39:59 +0000 (0:00:00.033) 0:04:36.901 ********* 2026-06-25 19:39:59.736320 | mon1 | changed: [osd1] 2026-06-25 19:39:59.736397 | mon1 | 2026-06-25 19:39:59.736600 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-06-25 19:39:59.736646 | mon1 | Thursday 25 June 2026 19:39:59 +0000 (0:00:00.249) 0:04:37.151 ********* 2026-06-25 19:39:59.786990 | mon1 | ok: [osd1] => { 2026-06-25 19:39:59.787108 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-06-25 19:39:59.787689 | mon1 | } 2026-06-25 19:39:59.787739 | mon1 | 2026-06-25 19:39:59.787747 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-06-25 19:39:59.787753 | mon1 | Thursday 25 June 2026 19:39:59 +0000 (0:00:00.050) 0:04:37.201 ********* 2026-06-25 19:40:00.276322 | mon1 | changed: [osd1] 2026-06-25 19:40:00.276380 | mon1 | 2026-06-25 19:40:00.276483 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-06-25 19:40:00.276640 | mon1 | Thursday 25 June 2026 19:40:00 +0000 (0:00:00.489) 0:04:37.691 ********* 2026-06-25 19:40:00.310396 | mon1 | skipping: [osd1] 2026-06-25 19:40:00.310468 | mon1 | 2026-06-25 19:40:00.310579 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-06-25 19:40:00.310696 | mon1 | Thursday 25 June 2026 19:40:00 +0000 (0:00:00.034) 0:04:37.725 ********* 2026-06-25 19:40:00.339144 | mon1 | skipping: [osd1] 2026-06-25 19:40:00.339205 | mon1 | 2026-06-25 19:40:00.339296 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-06-25 19:40:00.339376 | mon1 | Thursday 25 June 2026 19:40:00 +0000 (0:00:00.028) 0:04:37.754 ********* 2026-06-25 19:40:00.537407 | mon1 | ok: [osd1] 2026-06-25 19:40:00.537470 | mon1 | 2026-06-25 19:40:00.537550 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-06-25 19:40:00.537642 | mon1 | Thursday 25 June 2026 19:40:00 +0000 (0:00:00.198) 0:04:37.952 ********* 2026-06-25 19:40:01.740848 | mon1 | ok: [osd1] 2026-06-25 19:40:01.740927 | mon1 | 2026-06-25 19:40:01.741033 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-06-25 19:40:01.741155 | mon1 | Thursday 25 June 2026 19:40:01 +0000 (0:00:01.203) 0:04:39.155 ********* 2026-06-25 19:40:01.800544 | mon1 | ok: [osd1] => { 2026-06-25 19:40:01.800629 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz" 2026-06-25 19:40:01.800725 | mon1 | } 2026-06-25 19:40:01.800810 | mon1 | 2026-06-25 19:40:01.800909 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-06-25 19:40:01.801026 | mon1 | Thursday 25 June 2026 19:40:01 +0000 (0:00:00.059) 0:04:39.215 ********* 2026-06-25 19:40:02.726881 | mon1 | changed: [osd1] 2026-06-25 19:40:02.726954 | mon1 | 2026-06-25 19:40:02.727110 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-06-25 19:40:02.727246 | mon1 | Thursday 25 June 2026 19:40:02 +0000 (0:00:00.925) 0:04:40.141 ********* 2026-06-25 19:40:05.388372 | mon1 | changed: [osd1] 2026-06-25 19:40:05.388455 | mon1 | 2026-06-25 19:40:05.388596 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-06-25 19:40:05.388755 | mon1 | Thursday 25 June 2026 19:40:05 +0000 (0:00:02.661) 0:04:42.802 ********* 2026-06-25 19:40:05.419210 | mon1 | skipping: [osd1] 2026-06-25 19:40:05.419273 | mon1 | 2026-06-25 19:40:05.419284 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-06-25 19:40:05.419293 | mon1 | Thursday 25 June 2026 19:40:05 +0000 (0:00:00.030) 0:04:42.832 ********* 2026-06-25 19:40:05.445129 | mon1 | skipping: [osd1] 2026-06-25 19:40:05.445508 | mon1 | 2026-06-25 19:40:05.445530 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-06-25 19:40:05.445539 | mon1 | Thursday 25 June 2026 19:40:05 +0000 (0:00:00.026) 0:04:42.859 ********* 2026-06-25 19:40:05.469247 | mon1 | skipping: [osd1] 2026-06-25 19:40:05.469320 | mon1 | 2026-06-25 19:40:05.469480 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-06-25 19:40:05.469611 | mon1 | Thursday 25 June 2026 19:40:05 +0000 (0:00:00.024) 0:04:42.883 ********* 2026-06-25 19:40:13.501230 | mon1 | changed: [osd1] 2026-06-25 19:40:13.501312 | mon1 | 2026-06-25 19:40:13.501535 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-06-25 19:40:13.501585 | mon1 | Thursday 25 June 2026 19:40:13 +0000 (0:00:08.032) 0:04:50.915 ********* 2026-06-25 19:40:13.988457 | mon1 | changed: [osd1] 2026-06-25 19:40:13.988515 | mon1 | 2026-06-25 19:40:13.988635 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-06-25 19:40:13.988759 | mon1 | Thursday 25 June 2026 19:40:13 +0000 (0:00:00.487) 0:04:51.403 ********* 2026-06-25 19:40:14.931062 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-06-25 19:40:14.931120 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-06-25 19:40:14.931824 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-06-25 19:40:14.931889 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-06-25 19:40:14.931898 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-06-25 19:40:14.931905 | mon1 | 2026-06-25 19:40:14.931919 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-06-25 19:40:14.931981 | mon1 | Thursday 25 June 2026 19:40:14 +0000 (0:00:00.942) 0:04:52.345 ********* 2026-06-25 19:40:15.537125 | mon1 | changed: [osd1] 2026-06-25 19:40:15.537191 | mon1 | 2026-06-25 19:40:15.537241 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-06-25 19:40:15.537677 | mon1 | Thursday 25 June 2026 19:40:15 +0000 (0:00:00.599) 0:04:52.945 ********* 2026-06-25 19:40:15.537721 | mon1 | 2026-06-25 19:40:15.537727 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-06-25 19:40:15.537731 | mon1 | Thursday 25 June 2026 19:40:15 +0000 (0:00:00.006) 0:04:52.951 ********* 2026-06-25 19:40:16.295832 | mon1 | ok: [osd1] 2026-06-25 19:40:16.295935 | mon1 | 2026-06-25 19:40:16.296245 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-06-25 19:40:16.296304 | mon1 | Thursday 25 June 2026 19:40:16 +0000 (0:00:00.758) 0:04:53.710 ********* 2026-06-25 19:40:16.770133 | mon1 | changed: [osd1] 2026-06-25 19:40:16.770269 | mon1 | 2026-06-25 19:40:16.770280 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-06-25 19:40:16.770294 | mon1 | Thursday 25 June 2026 19:40:16 +0000 (0:00:00.474) 0:04:54.184 ********* 2026-06-25 19:40:17.324641 | mon1 | changed: [osd1] 2026-06-25 19:40:17.324753 | mon1 | 2026-06-25 19:40:17.324777 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-06-25 19:40:17.324788 | mon1 | Thursday 25 June 2026 19:40:17 +0000 (0:00:00.554) 0:04:54.739 ********* 2026-06-25 19:40:17.516339 | mon1 | ok: [osd1] 2026-06-25 19:40:17.516417 | mon1 | 2026-06-25 19:40:17.516433 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-06-25 19:40:17.516615 | mon1 | Thursday 25 June 2026 19:40:17 +0000 (0:00:00.191) 0:04:54.930 ********* 2026-06-25 19:40:17.573876 | mon1 | ok: [osd1] => { 2026-06-25 19:40:17.573955 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-06-25 19:40:17.574538 | mon1 | } 2026-06-25 19:40:17.574590 | mon1 | 2026-06-25 19:40:17.574598 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-06-25 19:40:17.574605 | mon1 | Thursday 25 June 2026 19:40:17 +0000 (0:00:00.057) 0:04:54.988 ********* 2026-06-25 19:40:18.387489 | mon1 | changed: [osd1] 2026-06-25 19:40:18.387586 | mon1 | 2026-06-25 19:40:18.387632 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-06-25 19:40:18.387782 | mon1 | Thursday 25 June 2026 19:40:18 +0000 (0:00:00.813) 0:04:55.802 ********* 2026-06-25 19:40:22.784529 | mon1 | changed: [osd1] 2026-06-25 19:40:22.784617 | mon1 | 2026-06-25 19:40:22.784885 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-06-25 19:40:22.784906 | mon1 | Thursday 25 June 2026 19:40:22 +0000 (0:00:04.396) 0:05:00.199 ********* 2026-06-25 19:40:23.848869 | mon1 | ok: [osd1] 2026-06-25 19:40:23.848979 | mon1 | 2026-06-25 19:40:23.849290 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-06-25 19:40:23.849371 | mon1 | Thursday 25 June 2026 19:40:23 +0000 (0:00:01.063) 0:05:01.263 ********* 2026-06-25 19:40:24.081841 | mon1 | changed: [osd1] 2026-06-25 19:40:24.082015 | mon1 | 2026-06-25 19:40:24.082044 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-06-25 19:40:24.082055 | mon1 | Thursday 25 June 2026 19:40:24 +0000 (0:00:00.233) 0:05:01.496 ********* 2026-06-25 19:40:24.563761 | mon1 | changed: [osd1] 2026-06-25 19:40:24.563807 | mon1 | 2026-06-25 19:40:24.563813 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-06-25 19:40:24.563818 | mon1 | Thursday 25 June 2026 19:40:24 +0000 (0:00:00.481) 0:05:01.978 ********* 2026-06-25 19:40:25.130752 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-06-25 19:40:25.130835 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-06-25 19:40:25.130889 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-06-25 19:40:25.131258 | mon1 | 2026-06-25 19:40:25.131338 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-06-25 19:40:25.131345 | mon1 | Thursday 25 June 2026 19:40:25 +0000 (0:00:00.566) 0:05:02.545 ********* 2026-06-25 19:40:25.605308 | mon1 | changed: [osd1] 2026-06-25 19:40:25.605386 | mon1 | 2026-06-25 19:40:25.605461 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-06-25 19:40:25.605598 | mon1 | Thursday 25 June 2026 19:40:25 +0000 (0:00:00.475) 0:05:03.020 ********* 2026-06-25 19:40:26.071204 | mon1 | changed: [osd1] 2026-06-25 19:40:26.071281 | mon1 | 2026-06-25 19:40:26.071851 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-06-25 19:40:26.071900 | mon1 | Thursday 25 June 2026 19:40:26 +0000 (0:00:00.459) 0:05:03.479 ********* 2026-06-25 19:40:26.071906 | mon1 | 2026-06-25 19:40:26.071911 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-06-25 19:40:26.071915 | mon1 | Thursday 25 June 2026 19:40:26 +0000 (0:00:00.006) 0:05:03.486 ********* 2026-06-25 19:40:26.776208 | mon1 | ok: [osd1] 2026-06-25 19:40:26.776282 | mon1 | 2026-06-25 19:40:26.776570 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-06-25 19:40:26.776621 | mon1 | Thursday 25 June 2026 19:40:26 +0000 (0:00:00.704) 0:05:04.190 ********* 2026-06-25 19:40:27.870513 | mon1 | changed: [osd1] 2026-06-25 19:40:27.870634 | mon1 | 2026-06-25 19:40:27.870644 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-06-25 19:40:27.870808 | mon1 | Thursday 25 June 2026 19:40:27 +0000 (0:00:01.094) 0:05:05.285 ********* 2026-06-25 19:40:28.428193 | mon1 | changed: [osd1] 2026-06-25 19:40:28.428277 | mon1 | 2026-06-25 19:40:28.428332 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-06-25 19:40:28.428453 | mon1 | Thursday 25 June 2026 19:40:28 +0000 (0:00:00.557) 0:05:05.843 ********* 2026-06-25 19:40:28.473190 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-06-25 19:40:28.473262 | mon1 | 2026-06-25 19:40:28.473542 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-06-25 19:40:28.473596 | mon1 | Thursday 25 June 2026 19:40:28 +0000 (0:00:00.044) 0:05:05.887 ********* 2026-06-25 19:40:34.198945 | mon1 | changed: [osd1] 2026-06-25 19:40:34.199033 | mon1 | 2026-06-25 19:40:34.199118 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-06-25 19:40:34.199210 | mon1 | Thursday 25 June 2026 19:40:34 +0000 (0:00:05.725) 0:05:11.613 ********* 2026-06-25 19:40:34.869917 | mon1 | ok: [osd1] => (item=chronyd) 2026-06-25 19:40:34.870021 | mon1 | ok: [osd1] => (item=sshd) 2026-06-25 19:40:34.870420 | mon1 | 2026-06-25 19:40:34.870441 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-06-25 19:40:34.870449 | mon1 | Thursday 25 June 2026 19:40:34 +0000 (0:00:00.670) 0:05:12.284 ********* 2026-06-25 19:40:35.205567 | mon1 | changed: [osd1] 2026-06-25 19:40:35.205963 | mon1 | 2026-06-25 19:40:35.205985 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-06-25 19:40:35.205993 | mon1 | Thursday 25 June 2026 19:40:35 +0000 (0:00:00.335) 0:05:12.620 ********* 2026-06-25 19:40:35.399409 | mon1 | ok: [osd1] 2026-06-25 19:40:35.399491 | mon1 | 2026-06-25 19:40:35.399531 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-06-25 19:40:35.400028 | mon1 | Thursday 25 June 2026 19:40:35 +0000 (0:00:00.193) 0:05:12.814 ********* 2026-06-25 19:40:35.711486 | mon1 | changed: [osd1] 2026-06-25 19:40:35.711552 | mon1 | 2026-06-25 19:40:35.711793 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-06-25 19:40:35.711857 | mon1 | Thursday 25 June 2026 19:40:35 +0000 (0:00:00.312) 0:05:13.126 ********* 2026-06-25 19:40:35.924056 | mon1 | changed: [osd1] 2026-06-25 19:40:35.924140 | mon1 | 2026-06-25 19:40:35.924212 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-06-25 19:40:35.924337 | mon1 | Thursday 25 June 2026 19:40:35 +0000 (0:00:00.212) 0:05:13.338 ********* 2026-06-25 19:40:36.141712 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-06-25 19:40:36.141785 | mon1 | 2026-06-25 19:40:36.141998 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-06-25 19:40:36.142045 | mon1 | Thursday 25 June 2026 19:40:36 +0000 (0:00:00.217) 0:05:13.556 ********* 2026-06-25 19:40:36.186735 | mon1 | ok: [osd1] 2026-06-25 19:40:36.186813 | mon1 | 2026-06-25 19:40:36.187033 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-06-25 19:40:36.187102 | mon1 | Thursday 25 June 2026 19:40:36 +0000 (0:00:00.044) 0:05:13.601 ********* 2026-06-25 19:40:36.241485 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-06-25 19:40:36.241585 | mon1 | 2026-06-25 19:40:36.241889 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-06-25 19:40:36.241948 | mon1 | Thursday 25 June 2026 19:40:36 +0000 (0:00:00.054) 0:05:13.655 ********* 2026-06-25 19:40:42.209532 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-06-25 19:40:42.209583 | mon1 | 2026-06-25 19:40:42.209588 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-06-25 19:40:42.209593 | mon1 | Thursday 25 June 2026 19:40:42 +0000 (0:00:05.968) 0:05:19.623 ********* 2026-06-25 19:40:42.259512 | mon1 | ok: [osd1] => (item=osd1) 2026-06-25 19:40:42.259566 | mon1 | 2026-06-25 19:40:42.259574 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-06-25 19:40:42.259581 | mon1 | Thursday 25 June 2026 19:40:42 +0000 (0:00:00.049) 0:05:19.673 ********* 2026-06-25 19:40:42.530943 | mon1 | changed: [osd1] 2026-06-25 19:40:42.531023 | mon1 | 2026-06-25 19:40:42.531249 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-06-25 19:40:42.531296 | mon1 | Thursday 25 June 2026 19:40:42 +0000 (0:00:00.272) 0:05:19.945 ********* 2026-06-25 19:40:54.685464 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-06-25 19:40:54.685551 | mon1 | 2026-06-25 19:40:54.685775 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-06-25 19:40:54.685827 | mon1 | Thursday 25 June 2026 19:40:54 +0000 (0:00:12.154) 0:05:32.100 ********* 2026-06-25 19:40:56.217236 | mon1 | ok: [osd1] 2026-06-25 19:40:56.217318 | mon1 | 2026-06-25 19:40:56.217540 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-06-25 19:40:56.217589 | mon1 | Thursday 25 June 2026 19:40:56 +0000 (0:00:01.531) 0:05:33.631 ********* 2026-06-25 19:41:45.044482 | mon1 | ok: [osd1] 2026-06-25 19:41:45.044580 | mon1 | 2026-06-25 19:41:45.044890 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-06-25 19:41:45.044943 | mon1 | Thursday 25 June 2026 19:41:45 +0000 (0:00:48.826) 0:06:22.458 ********* 2026-06-25 19:43:19.581477 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-06-25 19:43:19.582566 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-06-25 19:43:19.582598 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-06-25 19:43:19.582610 | mon1 | 2026-06-25 19:43:19.582619 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-06-25 19:43:19.582629 | mon1 | Thursday 25 June 2026 19:43:19 +0000 (0:01:34.536) 0:07:56.995 ********* 2026-06-25 19:43:26.931777 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-06-25 19:43:26.931842 | mon1 | 2026-06-25 19:43:26.931933 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-06-25 19:43:26.932050 | mon1 | Thursday 25 June 2026 19:43:26 +0000 (0:00:07.350) 0:08:04.346 ********* 2026-06-25 19:43:32.974569 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-06-25 19:43:32.974659 | mon1 | 2026-06-25 19:43:32.974810 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-06-25 19:43:32.974945 | mon1 | Thursday 25 June 2026 19:43:32 +0000 (0:00:06.042) 0:08:10.389 ********* 2026-06-25 19:43:33.027035 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-06-25 19:43:33.027129 | mon1 | 2026-06-25 19:43:33.027289 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-06-25 19:43:33.027476 | mon1 | Thursday 25 June 2026 19:43:33 +0000 (0:00:00.052) 0:08:10.441 ********* 2026-06-25 19:43:33.058845 | mon1 | ok: [osd1] 2026-06-25 19:43:33.058949 | mon1 | 2026-06-25 19:43:33.059118 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-06-25 19:43:33.059279 | mon1 | Thursday 25 June 2026 19:43:33 +0000 (0:00:00.031) 0:08:10.473 ********* 2026-06-25 19:43:39.055819 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-06-25 19:43:39.055895 | mon1 | 2026-06-25 19:43:39.055907 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-06-25 19:43:39.056058 | mon1 | Thursday 25 June 2026 19:43:39 +0000 (0:00:05.996) 0:08:16.469 ********* 2026-06-25 19:43:39.088714 | mon1 | ok: [osd1] 2026-06-25 19:43:39.088809 | mon1 | 2026-06-25 19:43:39.089140 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-06-25 19:43:39.089185 | mon1 | Thursday 25 June 2026 19:43:39 +0000 (0:00:00.033) 0:08:16.503 ********* 2026-06-25 19:43:39.127866 | mon1 | skipping: [osd1] => (item=1) 2026-06-25 19:43:39.127936 | mon1 | skipping: [osd1] => (item=1) 2026-06-25 19:43:39.128423 | mon1 | skipping: [osd1] => (item=1) 2026-06-25 19:43:39.128470 | mon1 | skipping: [osd1] 2026-06-25 19:43:39.128475 | mon1 | 2026-06-25 19:43:39.128480 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-06-25 19:43:39.128485 | mon1 | Thursday 25 June 2026 19:43:39 +0000 (0:00:00.039) 0:08:16.542 ********* 2026-06-25 19:43:39.158970 | mon1 | skipping: [osd1] 2026-06-25 19:43:39.159040 | mon1 | 2026-06-25 19:43:39.159865 | mon1 | PLAY RECAP ********************************************************************* 2026-06-25 19:43:39.159936 | mon1 | mon1 : ok=59 changed=29 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-06-25 19:43:39.159947 | mon1 | osd1 : ok=53 changed=24 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-06-25 19:43:39.159957 | mon1 | 2026-06-25 19:43:39.159967 | mon1 | 2026-06-25 19:43:39.159977 | mon1 | TASKS RECAP ******************************************************************** 2026-06-25 19:43:39.159993 | mon1 | Thursday 25 June 2026 19:43:39 +0000 (0:00:00.031) 0:08:16.573 ********* 2026-06-25 19:43:39.162594 | mon1 | =============================================================================== 2026-06-25 19:43:39.162647 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 143.38s 2026-06-25 19:43:39.162653 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 94.54s 2026-06-25 19:43:39.162659 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 48.83s 2026-06-25 19:43:39.162664 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 25.47s 2026-06-25 19:43:39.162669 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.04s 2026-06-25 19:43:39.162674 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 12.44s 2026-06-25 19:43:39.162679 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 12.15s 2026-06-25 19:43:39.162685 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 11.92s 2026-06-25 19:43:39.162690 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.03s 2026-06-25 19:43:39.162695 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 7.52s 2026-06-25 19:43:39.162700 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 7.35s 2026-06-25 19:43:39.162705 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.30s 2026-06-25 19:43:39.162710 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.25s 2026-06-25 19:43:39.162716 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.42s 2026-06-25 19:43:39.162721 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 6.17s 2026-06-25 19:43:39.162726 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.04s 2026-06-25 19:43:39.162731 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.00s 2026-06-25 19:43:39.162736 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.97s 2026-06-25 19:43:39.162741 | mon1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.73s 2026-06-25 19:43:39.162746 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.48s 2026-06-25 19:43:39.277244 | mon1 | INFO [default > converge] Executed: Successful 2026-06-25 19:43:39.282623 | mon1 | INFO [default > idempotence] Executing 2026-06-25 19:43:40.109033 | mon1 | 2026-06-25 19:43:40.109201 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-06-25 19:43:40.109380 | mon1 | 2026-06-25 19:43:40.109579 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-06-25 19:43:40.109812 | mon1 | Thursday 25 June 2026 19:43:40 +0000 (0:00:00.046) 0:00:00.046 ********* 2026-06-25 19:43:41.262922 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-06-25 19:43:41.263196 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-06-25 19:43:41.263453 | mon1 | interpreter could change the meaning of that path. See 2026-06-25 19:43:41.263701 | mon1 | https://docs.ansible.com/ansible- 2026-06-25 19:43:41.263989 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-06-25 19:43:41.274705 | mon1 | ok: [mon1] 2026-06-25 19:43:41.274865 | mon1 | 2026-06-25 19:43:41.275069 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-06-25 19:43:41.275273 | mon1 | Thursday 25 June 2026 19:43:41 +0000 (0:00:01.165) 0:00:01.212 ********* 2026-06-25 19:43:41.586151 | mon1 | ok: [mon1] 2026-06-25 19:43:41.586260 | mon1 | 2026-06-25 19:43:41.586532 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-06-25 19:43:41.586689 | mon1 | Thursday 25 June 2026 19:43:41 +0000 (0:00:00.311) 0:00:01.523 ********* 2026-06-25 19:43:41.620788 | mon1 | skipping: [mon1] 2026-06-25 19:43:41.621051 | mon1 | 2026-06-25 19:43:41.621298 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-06-25 19:43:41.621569 | mon1 | Thursday 25 June 2026 19:43:41 +0000 (0:00:00.034) 0:00:01.558 ********* 2026-06-25 19:43:41.947230 | mon1 | ok: [mon1] 2026-06-25 19:43:41.947473 | mon1 | 2026-06-25 19:43:41.947776 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-06-25 19:43:41.948014 | mon1 | Thursday 25 June 2026 19:43:41 +0000 (0:00:00.326) 0:00:01.884 ********* 2026-06-25 19:43:42.020229 | mon1 | ok: [mon1] => { 2026-06-25 19:43:42.020318 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-06-25 19:43:42.020479 | mon1 | } 2026-06-25 19:43:42.020546 | mon1 | 2026-06-25 19:43:42.020679 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-06-25 19:43:42.020792 | mon1 | Thursday 25 June 2026 19:43:42 +0000 (0:00:00.073) 0:00:01.957 ********* 2026-06-25 19:43:42.426648 | mon1 | ok: [mon1] 2026-06-25 19:43:42.426759 | mon1 | 2026-06-25 19:43:42.426772 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-06-25 19:43:42.426783 | mon1 | Thursday 25 June 2026 19:43:42 +0000 (0:00:00.405) 0:00:02.362 ********* 2026-06-25 19:43:42.463288 | mon1 | skipping: [mon1] 2026-06-25 19:43:42.463333 | mon1 | 2026-06-25 19:43:42.463602 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-06-25 19:43:42.463661 | mon1 | Thursday 25 June 2026 19:43:42 +0000 (0:00:00.038) 0:00:02.400 ********* 2026-06-25 19:43:42.508070 | mon1 | skipping: [mon1] 2026-06-25 19:43:42.508156 | mon1 | 2026-06-25 19:43:42.508398 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-06-25 19:43:42.508446 | mon1 | Thursday 25 June 2026 19:43:42 +0000 (0:00:00.044) 0:00:02.445 ********* 2026-06-25 19:43:42.706939 | mon1 | ok: [mon1] 2026-06-25 19:43:42.707055 | mon1 | 2026-06-25 19:43:42.707068 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-06-25 19:43:42.707180 | mon1 | Thursday 25 June 2026 19:43:42 +0000 (0:00:00.199) 0:00:02.644 ********* 2026-06-25 19:43:43.958653 | mon1 | ok: [mon1] 2026-06-25 19:43:43.958711 | mon1 | 2026-06-25 19:43:43.958808 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-06-25 19:43:43.958914 | mon1 | Thursday 25 June 2026 19:43:43 +0000 (0:00:01.251) 0:00:03.896 ********* 2026-06-25 19:43:44.031179 | mon1 | ok: [mon1] => { 2026-06-25 19:43:44.031909 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz" 2026-06-25 19:43:44.031981 | mon1 | } 2026-06-25 19:43:44.031992 | mon1 | 2026-06-25 19:43:44.032002 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-06-25 19:43:44.032012 | mon1 | Thursday 25 June 2026 19:43:44 +0000 (0:00:00.072) 0:00:03.968 ********* 2026-06-25 19:43:44.383647 | mon1 | ok: [mon1] 2026-06-25 19:43:44.383759 | mon1 | 2026-06-25 19:43:44.383995 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-06-25 19:43:44.384046 | mon1 | Thursday 25 June 2026 19:43:44 +0000 (0:00:00.352) 0:00:04.321 ********* 2026-06-25 19:43:46.600796 | mon1 | ok: [mon1] 2026-06-25 19:43:46.600870 | mon1 | 2026-06-25 19:43:46.601163 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-06-25 19:43:46.601215 | mon1 | Thursday 25 June 2026 19:43:46 +0000 (0:00:02.216) 0:00:06.537 ********* 2026-06-25 19:43:46.629291 | mon1 | skipping: [mon1] 2026-06-25 19:43:46.629396 | mon1 | 2026-06-25 19:43:46.629770 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-06-25 19:43:46.629823 | mon1 | Thursday 25 June 2026 19:43:46 +0000 (0:00:00.028) 0:00:06.566 ********* 2026-06-25 19:43:46.653437 | mon1 | skipping: [mon1] 2026-06-25 19:43:46.653942 | mon1 | 2026-06-25 19:43:46.653988 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-06-25 19:43:46.653995 | mon1 | Thursday 25 June 2026 19:43:46 +0000 (0:00:00.024) 0:00:06.590 ********* 2026-06-25 19:43:46.679946 | mon1 | skipping: [mon1] 2026-06-25 19:43:46.680001 | mon1 | 2026-06-25 19:43:46.680253 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-06-25 19:43:46.680297 | mon1 | Thursday 25 June 2026 19:43:46 +0000 (0:00:00.026) 0:00:06.617 ********* 2026-06-25 19:43:47.808998 | mon1 | ok: [mon1] 2026-06-25 19:43:47.809074 | mon1 | 2026-06-25 19:43:47.809164 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-06-25 19:43:47.809320 | mon1 | Thursday 25 June 2026 19:43:47 +0000 (0:00:01.129) 0:00:07.746 ********* 2026-06-25 19:43:48.239781 | mon1 | ok: [mon1] 2026-06-25 19:43:48.239895 | mon1 | 2026-06-25 19:43:48.240052 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-06-25 19:43:48.240232 | mon1 | Thursday 25 June 2026 19:43:48 +0000 (0:00:00.430) 0:00:08.177 ********* 2026-06-25 19:43:49.150642 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-06-25 19:43:49.150878 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-06-25 19:43:49.151115 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-06-25 19:43:49.151374 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-06-25 19:43:49.151613 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-06-25 19:43:49.151888 | mon1 | 2026-06-25 19:43:49.152119 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-06-25 19:43:49.152353 | mon1 | Thursday 25 June 2026 19:43:49 +0000 (0:00:00.910) 0:00:09.087 ********* 2026-06-25 19:43:49.689325 | mon1 | ok: [mon1] 2026-06-25 19:43:49.689394 | mon1 | 2026-06-25 19:43:49.689467 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-06-25 19:43:49.689561 | mon1 | Thursday 25 June 2026 19:43:49 +0000 (0:00:00.532) 0:00:09.620 ********* 2026-06-25 19:43:49.689643 | mon1 | 2026-06-25 19:43:49.689736 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-06-25 19:43:49.689830 | mon1 | Thursday 25 June 2026 19:43:49 +0000 (0:00:00.006) 0:00:09.626 ********* 2026-06-25 19:43:50.269032 | mon1 | ok: [mon1] 2026-06-25 19:43:50.269098 | mon1 | 2026-06-25 19:43:50.269110 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-06-25 19:43:50.269121 | mon1 | Thursday 25 June 2026 19:43:50 +0000 (0:00:00.578) 0:00:10.205 ********* 2026-06-25 19:43:50.495611 | mon1 | ok: [mon1] 2026-06-25 19:43:50.495780 | mon1 | 2026-06-25 19:43:50.495786 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-06-25 19:43:50.495838 | mon1 | Thursday 25 June 2026 19:43:50 +0000 (0:00:00.227) 0:00:10.433 ********* 2026-06-25 19:43:50.578866 | mon1 | ok: [mon1] => { 2026-06-25 19:43:50.578919 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-06-25 19:43:50.578925 | mon1 | } 2026-06-25 19:43:50.578929 | mon1 | 2026-06-25 19:43:50.578933 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-06-25 19:43:50.578938 | mon1 | Thursday 25 June 2026 19:43:50 +0000 (0:00:00.082) 0:00:10.515 ********* 2026-06-25 19:43:50.952429 | mon1 | ok: [mon1] 2026-06-25 19:43:50.952481 | mon1 | 2026-06-25 19:43:50.952486 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-06-25 19:43:50.952491 | mon1 | Thursday 25 June 2026 19:43:50 +0000 (0:00:00.374) 0:00:10.889 ********* 2026-06-25 19:43:54.067124 | mon1 | ok: [mon1] 2026-06-25 19:43:54.067309 | mon1 | 2026-06-25 19:43:54.067322 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-06-25 19:43:54.067333 | mon1 | Thursday 25 June 2026 19:43:54 +0000 (0:00:03.113) 0:00:14.002 ********* 2026-06-25 19:43:55.205099 | mon1 | ok: [mon1] 2026-06-25 19:43:55.205173 | mon1 | 2026-06-25 19:43:55.205185 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-06-25 19:43:55.205196 | mon1 | Thursday 25 June 2026 19:43:55 +0000 (0:00:01.138) 0:00:15.141 ********* 2026-06-25 19:43:55.518815 | mon1 | ok: [mon1] 2026-06-25 19:43:55.518883 | mon1 | 2026-06-25 19:43:55.519209 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-06-25 19:43:55.519260 | mon1 | Thursday 25 June 2026 19:43:55 +0000 (0:00:00.314) 0:00:15.456 ********* 2026-06-25 19:43:55.976930 | mon1 | ok: [mon1] 2026-06-25 19:43:55.977029 | mon1 | 2026-06-25 19:43:55.977339 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-06-25 19:43:55.977358 | mon1 | Thursday 25 June 2026 19:43:55 +0000 (0:00:00.458) 0:00:15.914 ********* 2026-06-25 19:43:56.546930 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-06-25 19:43:56.547044 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-06-25 19:43:56.547598 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-06-25 19:43:56.547677 | mon1 | 2026-06-25 19:43:56.547686 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-06-25 19:43:56.547693 | mon1 | Thursday 25 June 2026 19:43:56 +0000 (0:00:00.569) 0:00:16.484 ********* 2026-06-25 19:43:56.972533 | mon1 | ok: [mon1] 2026-06-25 19:43:56.972778 | mon1 | 2026-06-25 19:43:56.972987 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-06-25 19:43:56.973034 | mon1 | Thursday 25 June 2026 19:43:56 +0000 (0:00:00.425) 0:00:16.909 ********* 2026-06-25 19:43:57.410803 | mon1 | ok: [mon1] 2026-06-25 19:43:57.410872 | mon1 | 2026-06-25 19:43:57.411358 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-06-25 19:43:57.411406 | mon1 | Thursday 25 June 2026 19:43:57 +0000 (0:00:00.431) 0:00:17.341 ********* 2026-06-25 19:43:57.411412 | mon1 | 2026-06-25 19:43:57.411416 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-06-25 19:43:57.411420 | mon1 | Thursday 25 June 2026 19:43:57 +0000 (0:00:00.007) 0:00:17.348 ********* 2026-06-25 19:43:57.776871 | mon1 | ok: [mon1] 2026-06-25 19:43:57.776969 | mon1 | 2026-06-25 19:43:57.777268 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-06-25 19:43:57.777288 | mon1 | Thursday 25 June 2026 19:43:57 +0000 (0:00:00.366) 0:00:17.714 ********* 2026-06-25 19:43:57.816010 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-06-25 19:43:57.816109 | mon1 | 2026-06-25 19:43:57.816312 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-06-25 19:43:57.816328 | mon1 | Thursday 25 June 2026 19:43:57 +0000 (0:00:00.039) 0:00:17.753 ********* 2026-06-25 19:43:58.873249 | mon1 | ok: [mon1] 2026-06-25 19:43:58.873606 | mon1 | 2026-06-25 19:43:58.873636 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-06-25 19:43:58.873648 | mon1 | Thursday 25 June 2026 19:43:58 +0000 (0:00:01.057) 0:00:18.810 ********* 2026-06-25 19:43:59.505730 | mon1 | ok: [mon1] => (item=chronyd) 2026-06-25 19:43:59.506283 | mon1 | ok: [mon1] => (item=sshd) 2026-06-25 19:43:59.506327 | mon1 | 2026-06-25 19:43:59.506335 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-06-25 19:43:59.506342 | mon1 | Thursday 25 June 2026 19:43:59 +0000 (0:00:00.632) 0:00:19.443 ********* 2026-06-25 19:43:59.780402 | mon1 | ok: [mon1] 2026-06-25 19:43:59.780461 | mon1 | 2026-06-25 19:43:59.780554 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-06-25 19:43:59.780688 | mon1 | Thursday 25 June 2026 19:43:59 +0000 (0:00:00.274) 0:00:19.717 ********* 2026-06-25 19:43:59.969800 | mon1 | ok: [mon1] 2026-06-25 19:43:59.969888 | mon1 | 2026-06-25 19:43:59.970181 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-06-25 19:43:59.970237 | mon1 | Thursday 25 June 2026 19:43:59 +0000 (0:00:00.189) 0:00:19.907 ********* 2026-06-25 19:44:00.393328 | mon1 | ok: [mon1] 2026-06-25 19:44:00.393390 | mon1 | 2026-06-25 19:44:00.393488 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-06-25 19:44:00.393616 | mon1 | Thursday 25 June 2026 19:44:00 +0000 (0:00:00.423) 0:00:20.330 ********* 2026-06-25 19:44:00.713773 | mon1 | ok: [mon1] 2026-06-25 19:44:00.713851 | mon1 | 2026-06-25 19:44:00.714122 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-06-25 19:44:00.714172 | mon1 | Thursday 25 June 2026 19:44:00 +0000 (0:00:00.320) 0:00:20.651 ********* 2026-06-25 19:44:00.787308 | mon1 | ok: [mon1] 2026-06-25 19:44:00.787383 | mon1 | 2026-06-25 19:44:00.787396 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-06-25 19:44:00.787526 | mon1 | Thursday 25 June 2026 19:44:00 +0000 (0:00:00.073) 0:00:20.724 ********* 2026-06-25 19:44:00.997299 | mon1 | ok: [mon1] => (item=mon1) 2026-06-25 19:44:00.998290 | mon1 | 2026-06-25 19:44:00.998355 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-06-25 19:44:00.998368 | mon1 | Thursday 25 June 2026 19:44:00 +0000 (0:00:00.208) 0:00:20.933 ********* 2026-06-25 19:44:01.034172 | mon1 | ok: [mon1] 2026-06-25 19:44:01.034621 | mon1 | 2026-06-25 19:44:01.034669 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-06-25 19:44:01.034675 | mon1 | Thursday 25 June 2026 19:44:01 +0000 (0:00:00.037) 0:00:20.971 ********* 2026-06-25 19:44:01.071907 | mon1 | skipping: [mon1] 2026-06-25 19:44:01.071990 | mon1 | 2026-06-25 19:44:01.072054 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-06-25 19:44:01.072155 | mon1 | Thursday 25 June 2026 19:44:01 +0000 (0:00:00.038) 0:00:21.009 ********* 2026-06-25 19:44:01.138959 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-06-25 19:44:01.139006 | mon1 | 2026-06-25 19:44:01.139122 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-06-25 19:44:01.139243 | mon1 | Thursday 25 June 2026 19:44:01 +0000 (0:00:00.067) 0:00:21.076 ********* 2026-06-25 19:44:07.268508 | mon1 | ok: [mon1] 2026-06-25 19:44:07.268623 | mon1 | 2026-06-25 19:44:07.268990 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-06-25 19:44:07.269078 | mon1 | Thursday 25 June 2026 19:44:07 +0000 (0:00:06.128) 0:00:27.205 ********* 2026-06-25 19:44:07.319479 | mon1 | ok: [mon1] => (item=mon1) 2026-06-25 19:44:07.319589 | mon1 | 2026-06-25 19:44:07.319922 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-06-25 19:44:07.319966 | mon1 | Thursday 25 June 2026 19:44:07 +0000 (0:00:00.051) 0:00:27.256 ********* 2026-06-25 19:44:07.720482 | mon1 | ok: [mon1] 2026-06-25 19:44:07.720571 | mon1 | 2026-06-25 19:44:07.720794 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-06-25 19:44:07.720842 | mon1 | Thursday 25 June 2026 19:44:07 +0000 (0:00:00.401) 0:00:27.657 ********* 2026-06-25 19:44:14.162454 | mon1 | ok: [mon1] 2026-06-25 19:44:14.162549 | mon1 | 2026-06-25 19:44:14.162557 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-06-25 19:44:14.162564 | mon1 | Thursday 25 June 2026 19:44:14 +0000 (0:00:06.440) 0:00:34.098 ********* 2026-06-25 19:44:20.405327 | mon1 | ok: [mon1] 2026-06-25 19:44:20.405416 | mon1 | 2026-06-25 19:44:20.405770 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-06-25 19:44:20.405822 | mon1 | Thursday 25 June 2026 19:44:20 +0000 (0:00:06.243) 0:00:40.342 ********* 2026-06-25 19:44:34.537763 | mon1 | ok: [mon1] 2026-06-25 19:44:34.537813 | mon1 | 2026-06-25 19:44:34.537818 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-06-25 19:44:34.537823 | mon1 | Thursday 25 June 2026 19:44:34 +0000 (0:00:14.132) 0:00:54.474 ********* 2026-06-25 19:44:34.602530 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-06-25 19:44:34.602579 | mon1 | 2026-06-25 19:44:34.602586 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-06-25 19:44:34.602592 | mon1 | Thursday 25 June 2026 19:44:34 +0000 (0:00:00.064) 0:00:54.539 ********* 2026-06-25 19:44:34.641727 | mon1 | skipping: [mon1] 2026-06-25 19:44:34.641796 | mon1 | 2026-06-25 19:44:34.642137 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-06-25 19:44:34.642192 | mon1 | Thursday 25 June 2026 19:44:34 +0000 (0:00:00.039) 0:00:54.578 ********* 2026-06-25 19:44:34.684680 | mon1 | skipping: [mon1] => (item=mon1) 2026-06-25 19:44:34.684751 | mon1 | skipping: [mon1] 2026-06-25 19:44:34.685176 | mon1 | 2026-06-25 19:44:34.685236 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-06-25 19:44:34.685243 | mon1 | Thursday 25 June 2026 19:44:34 +0000 (0:00:00.043) 0:00:54.622 ********* 2026-06-25 19:44:34.936216 | mon1 | ok: [mon1] 2026-06-25 19:44:34.936284 | mon1 | 2026-06-25 19:44:34.936555 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-06-25 19:44:34.936575 | mon1 | Thursday 25 June 2026 19:44:34 +0000 (0:00:00.251) 0:00:54.873 ********* 2026-06-25 19:44:43.742071 | mon1 | ok: [mon1] 2026-06-25 19:44:43.742145 | mon1 | 2026-06-25 19:44:43.742350 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-06-25 19:44:43.742400 | mon1 | Thursday 25 June 2026 19:44:43 +0000 (0:00:08.806) 0:01:03.679 ********* 2026-06-25 19:44:50.413154 | mon1 | ok: [mon1] 2026-06-25 19:44:50.413259 | mon1 | 2026-06-25 19:44:50.413278 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-06-25 19:44:50.413427 | mon1 | Thursday 25 June 2026 19:44:50 +0000 (0:00:06.671) 0:01:10.350 ********* 2026-06-25 19:44:56.508707 | mon1 | ok: [mon1] 2026-06-25 19:44:56.508782 | mon1 | 2026-06-25 19:44:56.508881 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-06-25 19:44:56.508978 | mon1 | Thursday 25 June 2026 19:44:56 +0000 (0:00:06.095) 0:01:16.445 ********* 2026-06-25 19:45:01.153158 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-06-25 19:45:01.153260 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-06-25 19:45:01.153367 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-06-25 19:45:01.153460 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-06-25 19:45:01.153549 | mon1 | 2026-06-25 19:45:01.153661 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-06-25 19:45:01.153762 | mon1 | 2026-06-25 19:45:01.153855 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-06-25 19:45:01.153949 | mon1 | Thursday 25 June 2026 19:45:01 +0000 (0:00:04.633) 0:01:21.079 ********* 2026-06-25 19:45:02.262796 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-06-25 19:45:02.263099 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-06-25 19:45:02.263802 | mon1 | interpreter could change the meaning of that path. See 2026-06-25 19:45:02.264349 | mon1 | https://docs.ansible.com/ansible- 2026-06-25 19:45:02.264605 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-06-25 19:45:02.273330 | mon1 | ok: [osd1] 2026-06-25 19:45:02.273494 | mon1 | 2026-06-25 19:45:02.273709 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-06-25 19:45:02.273922 | mon1 | Thursday 25 June 2026 19:45:02 +0000 (0:00:01.130) 0:01:22.210 ********* 2026-06-25 19:45:02.478695 | mon1 | ok: [osd1] 2026-06-25 19:45:02.478911 | mon1 | 2026-06-25 19:45:02.479219 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-06-25 19:45:02.479518 | mon1 | Thursday 25 June 2026 19:45:02 +0000 (0:00:00.204) 0:01:22.415 ********* 2026-06-25 19:45:02.515916 | mon1 | skipping: [osd1] 2026-06-25 19:45:02.516049 | mon1 | 2026-06-25 19:45:02.516291 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-06-25 19:45:02.516489 | mon1 | Thursday 25 June 2026 19:45:02 +0000 (0:00:00.037) 0:01:22.453 ********* 2026-06-25 19:45:02.757101 | mon1 | ok: [osd1] 2026-06-25 19:45:02.757195 | mon1 | 2026-06-25 19:45:02.757415 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-06-25 19:45:02.757580 | mon1 | Thursday 25 June 2026 19:45:02 +0000 (0:00:00.240) 0:01:22.693 ********* 2026-06-25 19:45:02.841181 | mon1 | ok: [osd1] => { 2026-06-25 19:45:02.841507 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-06-25 19:45:02.841764 | mon1 | } 2026-06-25 19:45:02.841961 | mon1 | 2026-06-25 19:45:02.842196 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-06-25 19:45:02.842421 | mon1 | Thursday 25 June 2026 19:45:02 +0000 (0:00:00.084) 0:01:22.777 ********* 2026-06-25 19:45:03.166674 | mon1 | ok: [osd1] 2026-06-25 19:45:03.166756 | mon1 | 2026-06-25 19:45:03.166902 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-06-25 19:45:03.167056 | mon1 | Thursday 25 June 2026 19:45:03 +0000 (0:00:00.325) 0:01:23.103 ********* 2026-06-25 19:45:03.204607 | mon1 | skipping: [osd1] 2026-06-25 19:45:03.204720 | mon1 | 2026-06-25 19:45:03.204869 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-06-25 19:45:03.205023 | mon1 | Thursday 25 June 2026 19:45:03 +0000 (0:00:00.038) 0:01:23.141 ********* 2026-06-25 19:45:03.244051 | mon1 | skipping: [osd1] 2026-06-25 19:45:03.244249 | mon1 | 2026-06-25 19:45:03.244518 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-06-25 19:45:03.244787 | mon1 | Thursday 25 June 2026 19:45:03 +0000 (0:00:00.039) 0:01:23.181 ********* 2026-06-25 19:45:03.445286 | mon1 | ok: [osd1] 2026-06-25 19:45:03.445512 | mon1 | 2026-06-25 19:45:03.445690 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-06-25 19:45:03.445859 | mon1 | Thursday 25 June 2026 19:45:03 +0000 (0:00:00.200) 0:01:23.382 ********* 2026-06-25 19:45:04.712362 | mon1 | ok: [osd1] 2026-06-25 19:45:04.712717 | mon1 | 2026-06-25 19:45:04.712987 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-06-25 19:45:04.713243 | mon1 | Thursday 25 June 2026 19:45:04 +0000 (0:00:01.266) 0:01:24.648 ********* 2026-06-25 19:45:04.796361 | mon1 | ok: [osd1] => { 2026-06-25 19:45:04.796498 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz" 2026-06-25 19:45:04.796580 | mon1 | } 2026-06-25 19:45:04.796752 | mon1 | 2026-06-25 19:45:04.797019 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-06-25 19:45:04.797378 | mon1 | Thursday 25 June 2026 19:45:04 +0000 (0:00:00.084) 0:01:24.733 ********* 2026-06-25 19:45:05.144322 | mon1 | ok: [osd1] 2026-06-25 19:45:05.144406 | mon1 | 2026-06-25 19:45:05.144621 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-06-25 19:45:05.144866 | mon1 | Thursday 25 June 2026 19:45:05 +0000 (0:00:00.344) 0:01:25.077 ********* 2026-06-25 19:45:07.129359 | mon1 | ok: [osd1] 2026-06-25 19:45:07.129449 | mon1 | 2026-06-25 19:45:07.129462 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-06-25 19:45:07.129470 | mon1 | Thursday 25 June 2026 19:45:07 +0000 (0:00:01.988) 0:01:27.066 ********* 2026-06-25 19:45:07.159884 | mon1 | skipping: [osd1] 2026-06-25 19:45:07.159947 | mon1 | 2026-06-25 19:45:07.159954 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-06-25 19:45:07.159965 | mon1 | Thursday 25 June 2026 19:45:07 +0000 (0:00:00.030) 0:01:27.096 ********* 2026-06-25 19:45:07.186233 | mon1 | skipping: [osd1] 2026-06-25 19:45:07.186277 | mon1 | 2026-06-25 19:45:07.186538 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-06-25 19:45:07.186613 | mon1 | Thursday 25 June 2026 19:45:07 +0000 (0:00:00.027) 0:01:27.123 ********* 2026-06-25 19:45:07.220606 | mon1 | skipping: [osd1] 2026-06-25 19:45:07.220701 | mon1 | 2026-06-25 19:45:07.220929 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-06-25 19:45:07.220969 | mon1 | Thursday 25 June 2026 19:45:07 +0000 (0:00:00.034) 0:01:27.157 ********* 2026-06-25 19:45:08.462042 | mon1 | ok: [osd1] 2026-06-25 19:45:08.462502 | mon1 | 2026-06-25 19:45:08.462524 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-06-25 19:45:08.462533 | mon1 | Thursday 25 June 2026 19:45:08 +0000 (0:00:01.241) 0:01:28.399 ********* 2026-06-25 19:45:08.878145 | mon1 | ok: [osd1] 2026-06-25 19:45:08.878209 | mon1 | 2026-06-25 19:45:08.878435 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-06-25 19:45:08.878487 | mon1 | Thursday 25 June 2026 19:45:08 +0000 (0:00:00.416) 0:01:28.815 ********* 2026-06-25 19:45:09.813519 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-06-25 19:45:09.813581 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-06-25 19:45:09.813588 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-06-25 19:45:09.813593 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-06-25 19:45:09.813597 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-06-25 19:45:09.813602 | mon1 | 2026-06-25 19:45:09.813606 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-06-25 19:45:09.813610 | mon1 | Thursday 25 June 2026 19:45:09 +0000 (0:00:00.934) 0:01:29.750 ********* 2026-06-25 19:45:10.339817 | mon1 | ok: [osd1] 2026-06-25 19:45:10.339873 | mon1 | 2026-06-25 19:45:10.339880 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-06-25 19:45:10.339892 | mon1 | Thursday 25 June 2026 19:45:10 +0000 (0:00:00.518) 0:01:30.268 ********* 2026-06-25 19:45:10.340186 | mon1 | 2026-06-25 19:45:10.340204 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-06-25 19:45:10.340209 | mon1 | Thursday 25 June 2026 19:45:10 +0000 (0:00:00.008) 0:01:30.276 ********* 2026-06-25 19:45:10.687833 | mon1 | ok: [osd1] 2026-06-25 19:45:10.687911 | mon1 | 2026-06-25 19:45:10.687924 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-06-25 19:45:10.687942 | mon1 | Thursday 25 June 2026 19:45:10 +0000 (0:00:00.347) 0:01:30.624 ********* 2026-06-25 19:45:10.888645 | mon1 | ok: [osd1] 2026-06-25 19:45:10.888738 | mon1 | 2026-06-25 19:45:10.888750 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-06-25 19:45:10.888841 | mon1 | Thursday 25 June 2026 19:45:10 +0000 (0:00:00.201) 0:01:30.825 ********* 2026-06-25 19:45:10.972748 | mon1 | ok: [osd1] => { 2026-06-25 19:45:10.972796 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-06-25 19:45:10.972802 | mon1 | } 2026-06-25 19:45:10.972806 | mon1 | 2026-06-25 19:45:10.972810 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-06-25 19:45:10.972814 | mon1 | Thursday 25 June 2026 19:45:10 +0000 (0:00:00.083) 0:01:30.909 ********* 2026-06-25 19:45:11.363187 | mon1 | ok: [osd1] 2026-06-25 19:45:11.363243 | mon1 | 2026-06-25 19:45:11.363253 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-06-25 19:45:11.363261 | mon1 | Thursday 25 June 2026 19:45:11 +0000 (0:00:00.390) 0:01:31.299 ********* 2026-06-25 19:45:14.620497 | mon1 | ok: [osd1] 2026-06-25 19:45:14.620549 | mon1 | 2026-06-25 19:45:14.620554 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-06-25 19:45:14.620559 | mon1 | Thursday 25 June 2026 19:45:14 +0000 (0:00:03.257) 0:01:34.557 ********* 2026-06-25 19:45:15.917207 | mon1 | ok: [osd1] 2026-06-25 19:45:15.917297 | mon1 | 2026-06-25 19:45:15.917335 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-06-25 19:45:15.917474 | mon1 | Thursday 25 June 2026 19:45:15 +0000 (0:00:01.296) 0:01:35.854 ********* 2026-06-25 19:45:16.127232 | mon1 | ok: [osd1] 2026-06-25 19:45:16.127361 | mon1 | 2026-06-25 19:45:16.127374 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-06-25 19:45:16.127388 | mon1 | Thursday 25 June 2026 19:45:16 +0000 (0:00:00.210) 0:01:36.064 ********* 2026-06-25 19:45:16.562691 | mon1 | ok: [osd1] 2026-06-25 19:45:16.562814 | mon1 | 2026-06-25 19:45:16.563130 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-06-25 19:45:16.563193 | mon1 | Thursday 25 June 2026 19:45:16 +0000 (0:00:00.435) 0:01:36.499 ********* 2026-06-25 19:45:17.152474 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-06-25 19:45:17.152541 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-06-25 19:45:17.152883 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-06-25 19:45:17.152899 | mon1 | 2026-06-25 19:45:17.152905 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-06-25 19:45:17.152921 | mon1 | Thursday 25 June 2026 19:45:17 +0000 (0:00:00.589) 0:01:37.089 ********* 2026-06-25 19:45:17.571842 | mon1 | ok: [osd1] 2026-06-25 19:45:17.571973 | mon1 | 2026-06-25 19:45:17.572166 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-06-25 19:45:17.572313 | mon1 | Thursday 25 June 2026 19:45:17 +0000 (0:00:00.418) 0:01:37.508 ********* 2026-06-25 19:45:18.005445 | mon1 | ok: [osd1] 2026-06-25 19:45:18.005512 | mon1 | 2026-06-25 19:45:18.005637 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-06-25 19:45:18.005766 | mon1 | Thursday 25 June 2026 19:45:17 +0000 (0:00:00.428) 0:01:37.936 ********* 2026-06-25 19:45:18.005891 | mon1 | 2026-06-25 19:45:18.006026 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-06-25 19:45:18.006165 | mon1 | Thursday 25 June 2026 19:45:18 +0000 (0:00:00.005) 0:01:37.942 ********* 2026-06-25 19:45:18.371948 | mon1 | ok: [osd1] 2026-06-25 19:45:18.372120 | mon1 | 2026-06-25 19:45:18.372337 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-06-25 19:45:18.372547 | mon1 | Thursday 25 June 2026 19:45:18 +0000 (0:00:00.366) 0:01:38.308 ********* 2026-06-25 19:45:18.417845 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-06-25 19:45:18.418001 | mon1 | 2026-06-25 19:45:18.418200 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-06-25 19:45:18.418414 | mon1 | Thursday 25 June 2026 19:45:18 +0000 (0:00:00.045) 0:01:38.354 ********* 2026-06-25 19:45:19.671867 | mon1 | ok: [osd1] 2026-06-25 19:45:19.671999 | mon1 | 2026-06-25 19:45:19.672264 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-06-25 19:45:19.672533 | mon1 | Thursday 25 June 2026 19:45:19 +0000 (0:00:01.253) 0:01:39.608 ********* 2026-06-25 19:45:20.325744 | mon1 | ok: [osd1] => (item=chronyd) 2026-06-25 19:45:20.325979 | mon1 | ok: [osd1] => (item=sshd) 2026-06-25 19:45:20.326248 | mon1 | 2026-06-25 19:45:20.326518 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-06-25 19:45:20.326867 | mon1 | Thursday 25 June 2026 19:45:20 +0000 (0:00:00.654) 0:01:40.262 ********* 2026-06-25 19:45:20.616771 | mon1 | ok: [osd1] 2026-06-25 19:45:20.617023 | mon1 | 2026-06-25 19:45:20.617356 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-06-25 19:45:20.617677 | mon1 | Thursday 25 June 2026 19:45:20 +0000 (0:00:00.290) 0:01:40.553 ********* 2026-06-25 19:45:20.830634 | mon1 | ok: [osd1] 2026-06-25 19:45:20.830872 | mon1 | 2026-06-25 19:45:20.831066 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-06-25 19:45:20.831250 | mon1 | Thursday 25 June 2026 19:45:20 +0000 (0:00:00.214) 0:01:40.767 ********* 2026-06-25 19:45:21.064311 | mon1 | ok: [osd1] 2026-06-25 19:45:21.064542 | mon1 | 2026-06-25 19:45:21.064736 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-06-25 19:45:21.064915 | mon1 | Thursday 25 June 2026 19:45:21 +0000 (0:00:00.231) 0:01:40.999 ********* 2026-06-25 19:45:21.270052 | mon1 | ok: [osd1] 2026-06-25 19:45:21.270128 | mon1 | 2026-06-25 19:45:21.270205 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-06-25 19:45:21.270341 | mon1 | Thursday 25 June 2026 19:45:21 +0000 (0:00:00.207) 0:01:41.207 ********* 2026-06-25 19:45:21.499292 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-06-25 19:45:21.499372 | mon1 | 2026-06-25 19:45:21.499734 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-06-25 19:45:21.499789 | mon1 | Thursday 25 June 2026 19:45:21 +0000 (0:00:00.229) 0:01:41.436 ********* 2026-06-25 19:45:21.547192 | mon1 | ok: [osd1] 2026-06-25 19:45:21.547767 | mon1 | 2026-06-25 19:45:21.547823 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-06-25 19:45:21.547834 | mon1 | Thursday 25 June 2026 19:45:21 +0000 (0:00:00.047) 0:01:41.483 ********* 2026-06-25 19:45:21.603889 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-06-25 19:45:21.603979 | mon1 | 2026-06-25 19:45:21.604176 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-06-25 19:45:21.604224 | mon1 | Thursday 25 June 2026 19:45:21 +0000 (0:00:00.057) 0:01:41.541 ********* 2026-06-25 19:45:27.682223 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-06-25 19:45:27.682335 | mon1 | 2026-06-25 19:45:27.682595 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-06-25 19:45:27.682618 | mon1 | Thursday 25 June 2026 19:45:27 +0000 (0:00:06.078) 0:01:47.619 ********* 2026-06-25 19:45:27.733237 | mon1 | ok: [osd1] => (item=osd1) 2026-06-25 19:45:27.733334 | mon1 | 2026-06-25 19:45:27.733586 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-06-25 19:45:27.733607 | mon1 | Thursday 25 June 2026 19:45:27 +0000 (0:00:00.051) 0:01:47.670 ********* 2026-06-25 19:45:27.993725 | mon1 | ok: [osd1] 2026-06-25 19:45:27.993804 | mon1 | 2026-06-25 19:45:27.993868 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-06-25 19:45:27.994027 | mon1 | Thursday 25 June 2026 19:45:27 +0000 (0:00:00.260) 0:01:47.931 ********* 2026-06-25 19:45:34.704767 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-06-25 19:45:34.704891 | mon1 | 2026-06-25 19:45:34.704900 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-06-25 19:45:34.705029 | mon1 | Thursday 25 June 2026 19:45:34 +0000 (0:00:06.711) 0:01:54.642 ********* 2026-06-25 19:45:40.064125 | mon1 | ok: [osd1] 2026-06-25 19:45:40.064213 | mon1 | 2026-06-25 19:45:40.064228 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-06-25 19:45:40.064388 | mon1 | Thursday 25 June 2026 19:45:40 +0000 (0:00:05.359) 0:02:00.001 ********* 2026-06-25 19:46:02.108105 | mon1 | ok: [osd1] 2026-06-25 19:46:02.108197 | mon1 | 2026-06-25 19:46:02.108211 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-06-25 19:46:02.108419 | mon1 | Thursday 25 June 2026 19:46:02 +0000 (0:00:22.043) 0:02:22.044 ********* 2026-06-25 19:46:02.164120 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-06-25 19:46:02.164240 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-06-25 19:46:02.164251 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-06-25 19:46:02.164319 | mon1 | skipping: [osd1] 2026-06-25 19:46:02.164638 | mon1 | 2026-06-25 19:46:02.164695 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-06-25 19:46:02.164702 | mon1 | Thursday 25 June 2026 19:46:02 +0000 (0:00:00.056) 0:02:22.101 ********* 2026-06-25 19:46:08.281521 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-06-25 19:46:08.281614 | mon1 | 2026-06-25 19:46:08.281982 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-06-25 19:46:08.282068 | mon1 | Thursday 25 June 2026 19:46:08 +0000 (0:00:06.117) 0:02:28.218 ********* 2026-06-25 19:46:14.307895 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-06-25 19:46:14.308059 | mon1 | 2026-06-25 19:46:14.308322 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-06-25 19:46:14.308380 | mon1 | Thursday 25 June 2026 19:46:14 +0000 (0:00:06.026) 0:02:34.245 ********* 2026-06-25 19:46:14.371686 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-06-25 19:46:14.371765 | mon1 | 2026-06-25 19:46:14.372004 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-06-25 19:46:14.372085 | mon1 | Thursday 25 June 2026 19:46:14 +0000 (0:00:00.063) 0:02:34.308 ********* 2026-06-25 19:46:14.411498 | mon1 | ok: [osd1] 2026-06-25 19:46:14.411619 | mon1 | 2026-06-25 19:46:14.411636 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-06-25 19:46:14.411875 | mon1 | Thursday 25 June 2026 19:46:14 +0000 (0:00:00.040) 0:02:34.348 ********* 2026-06-25 19:46:20.494782 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-06-25 19:46:20.494908 | mon1 | 2026-06-25 19:46:20.494947 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-06-25 19:46:20.494962 | mon1 | Thursday 25 June 2026 19:46:20 +0000 (0:00:06.083) 0:02:40.432 ********* 2026-06-25 19:46:20.534896 | mon1 | ok: [osd1] 2026-06-25 19:46:20.535005 | mon1 | 2026-06-25 19:46:20.535014 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-06-25 19:46:20.535023 | mon1 | Thursday 25 June 2026 19:46:20 +0000 (0:00:00.039) 0:02:40.472 ********* 2026-06-25 19:46:20.581522 | mon1 | skipping: [osd1] => (item=1) 2026-06-25 19:46:20.581590 | mon1 | skipping: [osd1] => (item=1) 2026-06-25 19:46:20.582015 | mon1 | skipping: [osd1] => (item=1) 2026-06-25 19:46:20.582030 | mon1 | skipping: [osd1] 2026-06-25 19:46:20.582036 | mon1 | 2026-06-25 19:46:20.582040 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-06-25 19:46:20.582045 | mon1 | Thursday 25 June 2026 19:46:20 +0000 (0:00:00.046) 0:02:40.518 ********* 2026-06-25 19:46:20.608061 | mon1 | skipping: [osd1] 2026-06-25 19:46:20.608134 | mon1 | 2026-06-25 19:46:20.609234 | mon1 | PLAY RECAP ********************************************************************* 2026-06-25 19:46:20.609357 | mon1 | mon1 : ok=49 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-06-25 19:46:20.609369 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-06-25 19:46:20.609377 | mon1 | 2026-06-25 19:46:20.609386 | mon1 | 2026-06-25 19:46:20.609394 | mon1 | TASKS RECAP ******************************************************************** 2026-06-25 19:46:20.609402 | mon1 | Thursday 25 June 2026 19:46:20 +0000 (0:00:00.026) 0:02:40.545 ********* 2026-06-25 19:46:20.609429 | mon1 | =============================================================================== 2026-06-25 19:46:20.609438 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.04s 2026-06-25 19:46:20.609446 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.13s 2026-06-25 19:46:20.609454 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 8.81s 2026-06-25 19:46:20.609470 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.71s 2026-06-25 19:46:20.609479 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.67s 2026-06-25 19:46:20.609487 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.44s 2026-06-25 19:46:20.610748 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.24s 2026-06-25 19:46:20.610797 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.13s 2026-06-25 19:46:20.610802 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.12s 2026-06-25 19:46:20.610806 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.10s 2026-06-25 19:46:20.610810 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.08s 2026-06-25 19:46:20.610814 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.08s 2026-06-25 19:46:20.610818 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.03s 2026-06-25 19:46:20.610822 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.36s 2026-06-25 19:46:20.610825 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 4.63s 2026-06-25 19:46:20.610829 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.26s 2026-06-25 19:46:20.610833 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.11s 2026-06-25 19:46:20.610837 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.22s 2026-06-25 19:46:20.610840 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.99s 2026-06-25 19:46:20.610844 | mon1 | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.30s 2026-06-25 19:46:20.714657 | mon1 | INFO [default > idempotence] Executed: Successful 2026-06-25 19:46:20.723443 | mon1 | INFO [default > side_effect] Executing 2026-06-25 19:46:20.723893 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-06-25 19:46:20.729179 | mon1 | INFO [default > verify] Executing 2026-06-25 19:46:21.355334 | mon1 | 2026-06-25 19:46:21.355527 | mon1 | PLAY [Verify] ****************************************************************** 2026-06-25 19:46:21.355650 | mon1 | 2026-06-25 19:46:21.355798 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-06-25 19:46:21.355928 | mon1 | Thursday 25 June 2026 19:46:21 +0000 (0:00:00.007) 0:00:00.007 ********* 2026-06-25 19:46:22.465344 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-06-25 19:46:22.465409 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-06-25 19:46:22.465421 | mon1 | interpreter could change the meaning of that path. See 2026-06-25 19:46:22.465430 | mon1 | https://docs.ansible.com/ansible- 2026-06-25 19:46:22.465440 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-06-25 19:46:22.472836 | mon1 | ok: [mon1] 2026-06-25 19:46:22.472868 | mon1 | 2026-06-25 19:46:22.472878 | mon1 | TASK [Get cluster health status] *********************************************** 2026-06-25 19:46:22.472888 | mon1 | Thursday 25 June 2026 19:46:22 +0000 (0:00:01.116) 0:00:01.123 ********* 2026-06-25 19:46:32.705097 | mon1 | ok: [mon1] 2026-06-25 19:46:32.705167 | mon1 | 2026-06-25 19:46:32.705178 | mon1 | TASK [Print cluster health status] ********************************************* 2026-06-25 19:46:32.705187 | mon1 | Thursday 25 June 2026 19:46:32 +0000 (0:00:10.231) 0:00:11.355 ********* 2026-06-25 19:46:32.734361 | mon1 | ok: [mon1] => { 2026-06-25 19:46:32.734427 | mon1 | "_ceph_health": { 2026-06-25 19:46:32.734436 | mon1 | "changed": false, 2026-06-25 19:46:32.734442 | mon1 | "cmd": [ 2026-06-25 19:46:32.734448 | mon1 | "cephadm", 2026-06-25 19:46:32.734454 | mon1 | "shell", 2026-06-25 19:46:32.734459 | mon1 | "--", 2026-06-25 19:46:32.734465 | mon1 | "ceph", 2026-06-25 19:46:32.734478 | mon1 | "health" 2026-06-25 19:46:32.734749 | mon1 | ], 2026-06-25 19:46:32.734987 | mon1 | "delta": "0:00:09.963194", 2026-06-25 19:46:32.735173 | mon1 | "end": "2026-06-25 19:46:32.669507", 2026-06-25 19:46:32.735362 | mon1 | "failed": false, 2026-06-25 19:46:32.735545 | mon1 | "msg": "", 2026-06-25 19:46:32.735768 | mon1 | "rc": 0, 2026-06-25 19:46:32.735970 | mon1 | "start": "2026-06-25 19:46:22.706313", 2026-06-25 19:46:32.736191 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-06-25 19:46:32.736388 | mon1 | "stderr_lines": [ 2026-06-25 19:46:32.736581 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-06-25 19:46:32.736791 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-06-25 19:46:32.736979 | mon1 | ], 2026-06-25 19:46:32.737221 | mon1 | "stdout": "HEALTH_OK", 2026-06-25 19:46:32.737466 | mon1 | "stdout_lines": [ 2026-06-25 19:46:32.737665 | mon1 | "HEALTH_OK" 2026-06-25 19:46:32.737847 | mon1 | ] 2026-06-25 19:46:32.738033 | mon1 | } 2026-06-25 19:46:32.738266 | mon1 | } 2026-06-25 19:46:32.738564 | mon1 | 2026-06-25 19:46:32.738768 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-06-25 19:46:32.739012 | mon1 | Thursday 25 June 2026 19:46:32 +0000 (0:00:00.028) 0:00:11.384 ********* 2026-06-25 19:46:32.756910 | mon1 | ok: [mon1] => { 2026-06-25 19:46:32.757108 | mon1 | "changed": false, 2026-06-25 19:46:32.757327 | mon1 | "msg": "All assertions passed" 2026-06-25 19:46:32.757554 | mon1 | } 2026-06-25 19:46:32.757747 | mon1 | 2026-06-25 19:46:32.757963 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-06-25 19:46:32.758178 | mon1 | Thursday 25 June 2026 19:46:32 +0000 (0:00:00.024) 0:00:11.408 ********* 2026-06-25 19:46:39.551011 | mon1 | changed: [mon1] 2026-06-25 19:46:39.551086 | mon1 | 2026-06-25 19:46:39.551116 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-06-25 19:46:39.551124 | mon1 | Thursday 25 June 2026 19:46:39 +0000 (0:00:06.793) 0:00:18.201 ********* 2026-06-25 19:46:41.638262 | mon1 | changed: [mon1] 2026-06-25 19:46:41.638381 | mon1 | 2026-06-25 19:46:41.638740 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-06-25 19:46:41.638768 | mon1 | Thursday 25 June 2026 19:46:41 +0000 (0:00:02.087) 0:00:20.289 ********* 2026-06-25 19:46:42.691595 | mon1 | ok: [mon1] 2026-06-25 19:46:42.691793 | mon1 | 2026-06-25 19:46:42.692056 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-06-25 19:46:42.692082 | mon1 | Thursday 25 June 2026 19:46:42 +0000 (0:00:01.053) 0:00:21.343 ********* 2026-06-25 19:46:42.730868 | mon1 | ok: [mon1] => { 2026-06-25 19:46:42.731188 | mon1 | "changed": false, 2026-06-25 19:46:42.731251 | mon1 | "msg": "All assertions passed" 2026-06-25 19:46:42.731272 | mon1 | } 2026-06-25 19:46:42.731789 | mon1 | 2026-06-25 19:46:42.731813 | mon1 | TASK [Retrieve info for the test Ceph key using the legacy key module] ********* 2026-06-25 19:46:42.731821 | mon1 | Thursday 25 June 2026 19:46:42 +0000 (0:00:00.039) 0:00:21.382 ********* 2026-06-25 19:46:43.697833 | mon1 | ok: [mon1] 2026-06-25 19:46:43.697948 | mon1 | 2026-06-25 19:46:43.698106 | mon1 | TASK [Assert that the legacy key module info state returns the correct key] **** 2026-06-25 19:46:43.698288 | mon1 | Thursday 25 June 2026 19:46:43 +0000 (0:00:00.966) 0:00:22.349 ********* 2026-06-25 19:46:43.730534 | mon1 | ok: [mon1] => { 2026-06-25 19:46:43.731765 | mon1 | "changed": false, 2026-06-25 19:46:43.731823 | mon1 | "msg": "All assertions passed" 2026-06-25 19:46:43.731831 | mon1 | } 2026-06-25 19:46:43.731838 | mon1 | 2026-06-25 19:46:43.731849 | mon1 | PLAY RECAP ********************************************************************* 2026-06-25 19:46:43.735401 | mon1 | mon1 : ok=10 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-06-25 19:46:43.735453 | mon1 | 2026-06-25 19:46:43.735472 | mon1 | 2026-06-25 19:46:43.735485 | mon1 | TASKS RECAP ******************************************************************** 2026-06-25 19:46:43.735498 | mon1 | Thursday 25 June 2026 19:46:43 +0000 (0:00:00.032) 0:00:22.382 ********* 2026-06-25 19:46:43.735510 | mon1 | =============================================================================== 2026-06-25 19:46:43.735522 | mon1 | Get cluster health status ---------------------------------------------- 10.23s 2026-06-25 19:46:43.735535 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.79s 2026-06-25 19:46:43.735547 | mon1 | Create a test Ceph key -------------------------------------------------- 2.09s 2026-06-25 19:46:43.735559 | mon1 | Gathering Facts --------------------------------------------------------- 1.12s 2026-06-25 19:46:43.735571 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.05s 2026-06-25 19:46:43.735583 | mon1 | Retrieve info for the test Ceph key using the legacy key module --------- 0.97s 2026-06-25 19:46:43.735596 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s 2026-06-25 19:46:43.735608 | mon1 | Assert that the legacy key module info state returns the correct key ---- 0.03s 2026-06-25 19:46:43.735621 | mon1 | Print cluster health status --------------------------------------------- 0.03s 2026-06-25 19:46:43.735633 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.02s 2026-06-25 19:46:43.806908 | mon1 | INFO [default > verify] Executed: Successful 2026-06-25 19:46:43.817910 | mon1 | INFO [default > cleanup] Executing 2026-06-25 19:46:43.818279 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-06-25 19:46:43.823332 | mon1 | INFO [default > destroy] Executing 2026-06-25 19:46:43.823442 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-06-25 19:46:43.823543 | mon1 | INFO [default > destroy] Executed: Successful 2026-06-25 19:46:43.823950 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-06-25 19:46:54.210918 | mon1 | ok: Runtime: 0:12:42.196248 2026-06-25 19:46:54.227837 | 2026-06-25 19:46:54.227895 | PLAY RECAP 2026-06-25 19:46:54.227944 | mon1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-06-25 19:46:54.227967 | 2026-06-25 19:46:54.381252 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-06-25 19:46:54.386440 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-06-25 19:46:55.160045 | 2026-06-25 19:46:55.160234 | PLAY [all] 2026-06-25 19:46:55.174982 | 2026-06-25 19:46:55.175149 | TASK [fetch-output : Set log path for multiple nodes] 2026-06-25 19:46:55.231029 | mon1 | ok 2026-06-25 19:46:55.247866 | osd1 | ok 2026-06-25 19:46:55.254344 | 2026-06-25 19:46:55.254484 | TASK [fetch-output : Set log path for single node] 2026-06-25 19:46:55.282577 | mon1 | skipping: Conditional result was False 2026-06-25 19:46:55.294097 | osd1 | skipping: Conditional result was False 2026-06-25 19:46:55.304733 | 2026-06-25 19:46:55.304809 | LOOP [fetch-output : Ensure local output dirs] 2026-06-25 19:46:55.979908 | mon1 -> localhost | changed: "/var/lib/zuul/builds/0a641963566640c89e2464eb511edae1/work/logs/mon1" 2026-06-25 19:46:55.982212 | osd1 -> localhost | changed: "/var/lib/zuul/builds/0a641963566640c89e2464eb511edae1/work/logs/osd1" 2026-06-25 19:46:56.203073 | osd1 -> localhost | changed: "/var/lib/zuul/builds/0a641963566640c89e2464eb511edae1/work/artifacts" 2026-06-25 19:46:56.215271 | mon1 -> localhost | ok: "/var/lib/zuul/builds/0a641963566640c89e2464eb511edae1/work/artifacts" 2026-06-25 19:46:56.452268 | osd1 -> localhost | changed: "/var/lib/zuul/builds/0a641963566640c89e2464eb511edae1/work/docs" 2026-06-25 19:46:56.457130 | mon1 -> localhost | ok: "/var/lib/zuul/builds/0a641963566640c89e2464eb511edae1/work/docs" 2026-06-25 19:46:56.475718 | 2026-06-25 19:46:56.475871 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-06-25 19:46:57.212698 | mon1 | changed: .d..t...... ./ 2026-06-25 19:46:57.213265 | mon1 | changed: All items complete 2026-06-25 19:46:57.213330 | 2026-06-25 19:46:57.223528 | osd1 | changed: .d..t...... ./ 2026-06-25 19:46:57.739937 | mon1 | changed: .d..t...... ./ 2026-06-25 19:46:57.750632 | osd1 | ok 2026-06-25 19:46:58.232057 | osd1 | changed: .d..t...... ./ 2026-06-25 19:46:58.237822 | mon1 | ok 2026-06-25 19:46:58.263694 | 2026-06-25 19:46:58.263849 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-06-25 19:46:58.732559 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008742 2026-06-25 19:46:58.732838 | mon1 -> localhost | changed: All items complete 2026-06-25 19:46:58.732878 | 2026-06-25 19:46:58.994121 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.008682 2026-06-25 19:46:59.019982 | 2026-06-25 19:46:59.020176 | PLAY [all] 2026-06-25 19:46:59.030367 | 2026-06-25 19:46:59.030470 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-06-25 19:46:59.799652 | mon1 | changed 2026-06-25 19:47:00.005634 | osd1 | changed 2026-06-25 19:47:00.016632 | 2026-06-25 19:47:00.016749 | PLAY RECAP 2026-06-25 19:47:00.016798 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-06-25 19:47:00.016829 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-06-25 19:47:00.016849 | 2026-06-25 19:47:00.164091 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-06-25 19:47:00.169010 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-06-25 19:47:02.418103 | 2026-06-25 19:47:02.418238 | PLAY [localhost] 2026-06-25 19:47:02.428595 | 2026-06-25 19:47:02.428673 | TASK [Generate Zuul manifest] 2026-06-25 19:47:02.447663 | localhost | ok 2026-06-25 19:47:03.186700 | 2026-06-25 19:47:03.186866 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-06-25 19:47:03.892217 | localhost | changed 2026-06-25 19:47:03.904548 | 2026-06-25 19:47:03.904628 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-06-25 19:47:04.411555 | localhost | ok 2026-06-25 19:47:04.420882 | 2026-06-25 19:47:04.420954 | TASK [Upload logs] 2026-06-25 19:47:04.445587 | localhost | ok 2026-06-25 19:47:05.224073 | 2026-06-25 19:47:05.224215 | TASK [Set zuul-log-path fact] 2026-06-25 19:47:05.245770 | localhost | ok 2026-06-25 19:47:05.984536 | 2026-06-25 19:47:06.705888 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-06-25 19:47:06.740631 | localhost | ok 2026-06-25 19:47:06.749189 | 2026-06-25 19:47:06.749284 | TASK [upload-logs : Create log directories] 2026-06-25 19:47:07.221278 | localhost | changed 2026-06-25 19:47:07.228273 | 2026-06-25 19:47:07.228383 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-06-25 19:47:07.692799 | localhost -> localhost | ok: Runtime: 0:00:00.006821 2026-06-25 19:47:07.700668 | 2026-06-25 19:47:07.700828 | TASK [upload-logs : Upload logs to log server] 2026-06-25 19:47:08.983363 | localhost | Output suppressed because no_log was given 2026-06-25 19:47:08.989206 | 2026-06-25 19:47:08.989304 | LOOP [upload-logs : Compress console log and json output] 2026-06-25 19:47:09.084794 | localhost | skipping: Conditional result was False 2026-06-25 19:47:09.093058 | localhost | skipping: Conditional result was False 2026-06-25 19:47:09.105138 | 2026-06-25 19:47:09.105328 | LOOP [upload-logs : Upload compressed console log and json output] 2026-06-25 19:47:09.208923 | localhost | skipping: Conditional result was False 2026-06-25 19:47:09.209309 | 2026-06-25 19:47:09.213296 | localhost | skipping: Conditional result was False 2026-06-25 19:47:09.263922 | 2026-06-25 19:47:09.264094 | LOOP [upload-logs : Upload console log and json output]