2026-07-06 02:23:03.885270 | Job console starting
2026-07-06 02:23:03.915252 | Updating git repos
2026-07-06 02:23:03.962507 | Cloning repos into workspace
2026-07-06 02:23:04.037603 | Restoring repo states
2026-07-06 02:23:04.047072 | Merging changes
2026-07-06 02:23:04.454348 | Checking out repos
2026-07-06 02:23:04.509142 | Preparing playbooks
2026-07-06 02:23:05.992671 | Running Ansible setup
2026-07-06 02:23:10.515988 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-07-06 02:23:11.136850 | 
2026-07-06 02:23:11.137031 | PLAY [localhost]
2026-07-06 02:23:11.144797 | 
2026-07-06 02:23:11.144872 | TASK [Gathering Facts]
2026-07-06 02:23:12.007001 | localhost | ok
2026-07-06 02:23:12.017430 | 
2026-07-06 02:23:12.017561 | TASK [Setup log path fact]
2026-07-06 02:23:12.039760 | localhost | ok
2026-07-06 02:23:12.049773 | 
2026-07-06 02:23:12.049871 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-07-06 02:23:12.080683 | localhost | ok
2026-07-06 02:23:12.090366 | 
2026-07-06 02:23:12.090494 | TASK [emit-job-header : Print job information]
2026-07-06 02:23:12.133002 | # Job Information
2026-07-06 02:23:12.133290 | Ansible Version: 2.16.18
2026-07-06 02:23:12.133367 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble
2026-07-06 02:23:12.133419 | Pipeline: check
2026-07-06 02:23:12.133466 | Executor: 2d72f0692154
2026-07-06 02:23:12.133511 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/111
2026-07-06 02:23:12.133562 | Event ID: 789ee510-78e1-11f1-8241-e0f109c4bf88
2026-07-06 02:23:12.137530 | 
2026-07-06 02:23:12.137596 | LOOP [emit-job-header : Print node information]
2026-07-06 02:23:12.248988 | localhost | ok:
2026-07-06 02:23:12.249281 | localhost | # Node Information
2026-07-06 02:23:12.249327 | localhost | Inventory Hostname: mon1
2026-07-06 02:23:12.249360 | localhost | Hostname: np0000184138
2026-07-06 02:23:12.249392 | localhost | Username: zuul
2026-07-06 02:23:12.249436 | localhost | Distro: Ubuntu 24.04
2026-07-06 02:23:12.249473 | localhost | Provider: yul1
2026-07-06 02:23:12.249507 | localhost | Region: ca-ymq-1
2026-07-06 02:23:12.249538 | localhost | Label: ubuntu-noble
2026-07-06 02:23:12.249570 | localhost | Product Name: OpenStack Nova
2026-07-06 02:23:12.249604 | localhost | Interface IP: 199.19.213.95
2026-07-06 02:23:12.301180 | localhost | ok:
2026-07-06 02:23:12.301396 | localhost | # Node Information
2026-07-06 02:23:12.301439 | localhost | Inventory Hostname: osd1
2026-07-06 02:23:12.301472 | localhost | Hostname: np0000184139
2026-07-06 02:23:12.301502 | localhost | Username: zuul
2026-07-06 02:23:12.301529 | localhost | Distro: Ubuntu 24.04
2026-07-06 02:23:12.301556 | localhost | Provider: yul1
2026-07-06 02:23:12.301582 | localhost | Region: ca-ymq-1
2026-07-06 02:23:12.301608 | localhost | Label: ubuntu-noble
2026-07-06 02:23:12.301633 | localhost | Product Name: OpenStack Nova
2026-07-06 02:23:12.301662 | localhost | Interface IP: 199.19.213.76
2026-07-06 02:23:12.320936 | 
2026-07-06 02:23:12.321106 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-07-06 02:23:12.700293 | localhost -> localhost | changed
2026-07-06 02:23:12.709791 | 
2026-07-06 02:23:12.710276 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-07-06 02:23:13.565684 | localhost -> localhost | changed
2026-07-06 02:23:13.576116 | 
2026-07-06 02:23:13.576169 | PLAY [all]
2026-07-06 02:23:13.584649 | 
2026-07-06 02:23:13.584711 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-07-06 02:23:13.807613 | mon1 -> localhost | ok
2026-07-06 02:23:13.817480 | 
2026-07-06 02:23:13.817552 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-07-06 02:23:13.848102 | mon1 | ok
2026-07-06 02:23:13.865640 | osd1 | ok
2026-07-06 02:23:13.885749 | mon1 | included: /var/lib/zuul/builds/3c252cc302b049b2aa606f802c1d5e33/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-07-06 02:23:13.885807 | osd1 | included: /var/lib/zuul/builds/3c252cc302b049b2aa606f802c1d5e33/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-07-06 02:23:13.892754 | 
2026-07-06 02:23:13.892815 | TASK [add-build-sshkey : Create Temp SSH key]
2026-07-06 02:23:15.832173 | mon1 -> localhost | Generating public/private rsa key pair.
2026-07-06 02:23:15.832466 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/3c252cc302b049b2aa606f802c1d5e33/work/3c252cc302b049b2aa606f802c1d5e33_id_rsa
2026-07-06 02:23:15.832536 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/3c252cc302b049b2aa606f802c1d5e33/work/3c252cc302b049b2aa606f802c1d5e33_id_rsa.pub
2026-07-06 02:23:15.832589 | mon1 -> localhost | The key fingerprint is:
2026-07-06 02:23:15.832638 | mon1 -> localhost | SHA256:Rgnmf2I/q89ccGwiyz1KP2HvQ8L1VMdSA0tVsRBhgWE zuul-build-sshkey
2026-07-06 02:23:15.832685 | mon1 -> localhost | The key's randomart image is:
2026-07-06 02:23:15.832732 | mon1 -> localhost | +---[RSA 3072]----+
2026-07-06 02:23:15.832778 | mon1 -> localhost | |      o    EoO**=|
2026-07-06 02:23:15.832832 | mon1 -> localhost | |     o . ...o + *|
2026-07-06 02:23:15.832861 | mon1 -> localhost | |      . o    . +.|
2026-07-06 02:23:15.832887 | mon1 -> localhost | |       o   .. .  |
2026-07-06 02:23:15.832911 | mon1 -> localhost | |        S.+.+o   |
2026-07-06 02:23:15.832935 | mon1 -> localhost | |       + B==. .  |
2026-07-06 02:23:15.833001 | mon1 -> localhost | |        +.==.    |
2026-07-06 02:23:15.833032 | mon1 -> localhost | |       . =.=o    |
2026-07-06 02:23:15.833053 | mon1 -> localhost | |        oo*o..   |
2026-07-06 02:23:15.833073 | mon1 -> localhost | +----[SHA256]-----+
2026-07-06 02:23:15.833121 | mon1 -> localhost | ok: Runtime: 0:00:01.536378
2026-07-06 02:23:15.839461 | 
2026-07-06 02:23:15.839527 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-07-06 02:23:15.876238 | mon1 | ok
2026-07-06 02:23:15.880680 | osd1 | ok
2026-07-06 02:23:15.893974 | mon1 | included: /var/lib/zuul/builds/3c252cc302b049b2aa606f802c1d5e33/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-07-06 02:23:15.894030 | osd1 | included: /var/lib/zuul/builds/3c252cc302b049b2aa606f802c1d5e33/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-07-06 02:23:15.905329 | 
2026-07-06 02:23:15.905409 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-07-06 02:23:15.931398 | mon1 | skipping: Conditional result was False
2026-07-06 02:23:15.942954 | osd1 | skipping: Conditional result was False
2026-07-06 02:23:15.953267 | 
2026-07-06 02:23:15.953357 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-07-06 02:23:16.507732 | mon1 | changed
2026-07-06 02:23:16.517501 | osd1 | changed
2026-07-06 02:23:16.523466 | 
2026-07-06 02:23:16.523582 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-07-06 02:23:16.765646 | mon1 | ok
2026-07-06 02:23:16.784055 | osd1 | ok
2026-07-06 02:23:16.792714 | 
2026-07-06 02:23:16.792850 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-07-06 02:23:17.390600 | mon1 | changed
2026-07-06 02:23:17.482864 | osd1 | changed
2026-07-06 02:23:17.490510 | 
2026-07-06 02:23:17.490614 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-07-06 02:23:18.082881 | mon1 | changed
2026-07-06 02:23:18.100038 | osd1 | changed
2026-07-06 02:23:18.107474 | 
2026-07-06 02:23:18.107565 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-07-06 02:23:18.133644 | mon1 | skipping: Conditional result was False
2026-07-06 02:23:18.144726 | osd1 | skipping: Conditional result was False
2026-07-06 02:23:18.157400 | 
2026-07-06 02:23:18.157473 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-07-06 02:23:18.474003 | mon1 -> localhost | changed
2026-07-06 02:23:18.494476 | 
2026-07-06 02:23:18.494591 | TASK [add-build-sshkey : Add back temp key]
2026-07-06 02:23:18.803273 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/3c252cc302b049b2aa606f802c1d5e33/work/3c252cc302b049b2aa606f802c1d5e33_id_rsa (zuul-build-sshkey)
2026-07-06 02:23:18.803507 | mon1 -> localhost | ok: Runtime: 0:00:00.016456
2026-07-06 02:23:18.811210 | 
2026-07-06 02:23:18.811296 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-07-06 02:23:19.144316 | osd1 | ok
2026-07-06 02:23:19.168095 | mon1 | ok
2026-07-06 02:23:19.173557 | 
2026-07-06 02:23:19.173622 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-07-06 02:23:19.197335 | mon1 | skipping: Conditional result was False
2026-07-06 02:23:19.208585 | osd1 | skipping: Conditional result was False
2026-07-06 02:23:19.229494 | 
2026-07-06 02:23:19.229570 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-07-06 02:23:19.551341 | mon1 | ok
2026-07-06 02:23:19.557586 | osd1 | ok
2026-07-06 02:23:19.563504 | 
2026-07-06 02:23:19.563567 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-07-06 02:23:20.420432 | mon1 | Output suppressed because no_log was given
2026-07-06 02:23:20.425141 | osd1 | Output suppressed because no_log was given
2026-07-06 02:23:20.439349 | 
2026-07-06 02:23:20.439424 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-07-06 02:23:20.686524 | mon1 | ok: "logs"
2026-07-06 02:23:20.686773 | mon1 | ok: All items complete
2026-07-06 02:23:20.686802 | 
2026-07-06 02:23:20.691666 | osd1 | ok: "logs"
2026-07-06 02:23:20.895650 | osd1 | ok: "artifacts"
2026-07-06 02:23:20.905170 | mon1 | ok: "artifacts"
2026-07-06 02:23:21.110950 | osd1 | ok: "docs"
2026-07-06 02:23:21.116296 | mon1 | ok: "docs"
2026-07-06 02:23:21.130580 | 
2026-07-06 02:23:21.130747 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-07-06 02:23:21.355567 | mon1 | changed: "logs"
2026-07-06 02:23:21.355803 | mon1 | ok: All items complete
2026-07-06 02:23:21.355832 | 
2026-07-06 02:23:21.373938 | osd1 | changed: "logs"
2026-07-06 02:23:21.557683 | mon1 | changed: "artifacts"
2026-07-06 02:23:21.568592 | osd1 | changed: "artifacts"
2026-07-06 02:23:21.749420 | mon1 | changed: "docs"
2026-07-06 02:23:21.776502 | osd1 | changed: "docs"
2026-07-06 02:23:21.806736 | 
2026-07-06 02:23:21.806866 | PLAY RECAP
2026-07-06 02:23:21.806916 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-07-06 02:23:21.806952 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-07-06 02:23:21.806980 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-07-06 02:23:21.807000 | 
2026-07-06 02:23:21.970080 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-07-06 02:23:21.972777 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-07-06 02:23:22.645094 | 
2026-07-06 02:23:22.645243 | PLAY [all]
2026-07-06 02:23:22.657254 | 
2026-07-06 02:23:22.657345 | TASK [setup-uv : Extract archive]
2026-07-06 02:23:25.252277 | mon1 | changed
2026-07-06 02:23:25.353576 | osd1 | changed
2026-07-06 02:23:25.362082 | 
2026-07-06 02:23:25.362172 | TASK [setup-uv : Print version]
2026-07-06 02:23:24.845275 | mon1 | uv 0.8.13
2026-07-06 02:23:24.913709 | osd1 | uv 0.8.13
2026-07-06 02:23:25.926250 | mon1 | ok: Runtime: 0:00:00.016863
2026-07-06 02:23:25.936546 | osd1 | ok: Runtime: 0:00:00.015428
2026-07-06 02:23:25.950636 | 
2026-07-06 02:23:25.950742 | TASK [Install Ansible collection siblings]
2026-07-06 02:23:26.392313 | mon1 | ok:
2026-07-06 02:23:26.392482 | mon1 | Skipping community.general: no checked-out sibling
2026-07-06 02:23:26.392511 | mon1 | Skipping ansible.utils: no checked-out sibling
2026-07-06 02:23:26.392533 | mon1 | Skipping vexxhost.containers: no checked-out sibling
2026-07-06 02:23:26.394206 | 
2026-07-06 02:23:26.394250 | PLAY RECAP
2026-07-06 02:23:26.394296 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-07-06 02:23:26.394354 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-07-06 02:23:26.394374 | 
2026-07-06 02:23:26.523599 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-07-06 02:23:26.529334 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-07-06 02:23:27.142957 | 
2026-07-06 02:23:27.143125 | PLAY [all]
2026-07-06 02:23:27.156737 | 
2026-07-06 02:23:27.156893 | LOOP [Check inventory directories]
2026-07-06 02:23:27.548077 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph"
2026-07-06 02:23:27.738204 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory"
2026-07-06 02:23:27.938696 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory"
2026-07-06 02:23:27.954010 | 
2026-07-06 02:23:27.954214 | LOOP [Copy inventory file for Zuul]
2026-07-06 02:23:28.873164 | mon1 | changed:
2026-07-06 02:23:28.873431 | mon1 | {
2026-07-06 02:23:28.873481 | mon1 |   "ansible_loop_var": "item",
2026-07-06 02:23:28.873522 | mon1 |   "changed": false,
2026-07-06 02:23:28.873557 | mon1 |   "failed": false,
2026-07-06 02:23:28.873595 | mon1 |   "invocation": {
2026-07-06 02:23:28.873629 | mon1 |     "module_args": {
2026-07-06 02:23:28.873660 | mon1 |       "checksum_algorithm": "sha1",
2026-07-06 02:23:28.873712 | mon1 |       "follow": true,
2026-07-06 02:23:28.873744 | mon1 |       "get_attributes": true,
2026-07-06 02:23:28.873777 | mon1 |       "get_checksum": true,
2026-07-06 02:23:28.873809 | mon1 |       "get_mime": true,
2026-07-06 02:23:28.873839 | mon1 |       "path": "src/github.com/vexxhost/ansible-collection-ceph"
2026-07-06 02:23:28.873869 | mon1 |     }
2026-07-06 02:23:28.873926 | mon1 |   },
2026-07-06 02:23:28.873983 | mon1 |   "item": "src/github.com/vexxhost/ansible-collection-ceph",
2026-07-06 02:23:28.874017 | mon1 |   "stat": {
2026-07-06 02:23:28.874048 | mon1 |     "atime": 1783304599.393,
2026-07-06 02:23:28.874079 | mon1 |     "attr_flags": "e",
2026-07-06 02:23:28.874109 | mon1 |     "attributes": [
2026-07-06 02:23:28.874139 | mon1 |       "extents"
2026-07-06 02:23:28.874167 | mon1 |     ],
2026-07-06 02:23:28.874196 | mon1 |     "block_size": 4096,
2026-07-06 02:23:28.874225 | mon1 |     "blocks": 8,
2026-07-06 02:23:28.874255 | mon1 |     "charset": "unknown",
2026-07-06 02:23:28.874287 | mon1 |     "ctime": 1783304599.408,
2026-07-06 02:23:28.874318 | mon1 |     "dev": 64769,
2026-07-06 02:23:28.874347 | mon1 |     "device_type": 0,
2026-07-06 02:23:28.874377 | mon1 |     "executable": true,
2026-07-06 02:23:28.874405 | mon1 |     "exists": true,
2026-07-06 02:23:28.874434 | mon1 |     "gid": 1000,
2026-07-06 02:23:28.874465 | mon1 |     "gr_name": "zuul",
2026-07-06 02:23:28.874594 | mon1 |     "inode": 1023012,
2026-07-06 02:23:28.874633 | mon1 |     "isblk": false,
2026-07-06 02:23:28.874660 | mon1 |     "ischr": false,
2026-07-06 02:23:28.874684 | mon1 |     "isdir": true,
2026-07-06 02:23:28.874708 | mon1 |     "isfifo": false,
2026-07-06 02:23:28.874731 | mon1 |     "isgid": false,
2026-07-06 02:23:28.874753 | mon1 |     "islnk": false,
2026-07-06 02:23:28.874776 | mon1 |     "isreg": false,
2026-07-06 02:23:28.874799 | mon1 |     "issock": false,
2026-07-06 02:23:28.874821 | mon1 |     "isuid": false,
2026-07-06 02:23:28.874844 | mon1 |     "mimetype": "unknown",
2026-07-06 02:23:28.874866 | mon1 |     "mode": "0755",
2026-07-06 02:23:28.874889 | mon1 |     "mtime": 1783304584.1357663,
2026-07-06 02:23:28.874916 | mon1 |     "nlink": 10,
2026-07-06 02:23:28.874948 | mon1 |     "path": "src/github.com/vexxhost/ansible-collection-ceph",
2026-07-06 02:23:28.874973 | mon1 |     "pw_name": "zuul",
2026-07-06 02:23:28.874999 | mon1 |     "readable": true,
2026-07-06 02:23:28.875023 | mon1 |     "rgrp": true,
2026-07-06 02:23:28.875046 | mon1 |     "roth": true,
2026-07-06 02:23:28.875070 | mon1 |     "rusr": true,
2026-07-06 02:23:28.875093 | mon1 |     "size": 4096,
2026-07-06 02:23:28.875133 | mon1 |     "uid": 1000,
2026-07-06 02:23:28.875158 | mon1 |     "version": "2567120590",
2026-07-06 02:23:28.875182 | mon1 |     "wgrp": false,
2026-07-06 02:23:28.875203 | mon1 |     "woth": false,
2026-07-06 02:23:28.875220 | mon1 |     "writeable": true,
2026-07-06 02:23:28.875237 | mon1 |     "wusr": true,
2026-07-06 02:23:28.875254 | mon1 |     "xgrp": true,
2026-07-06 02:23:28.875270 | mon1 |     "xoth": true,
2026-07-06 02:23:28.875286 | mon1 |     "xusr": true
2026-07-06 02:23:28.875302 | mon1 |   }
2026-07-06 02:23:28.875319 | mon1 | }
2026-07-06 02:23:28.875359 | mon1 | ok: All items complete
2026-07-06 02:23:28.875381 | 
2026-07-06 02:23:28.876750 | mon1 | skipping: Conditional result was False
2026-07-06 02:23:28.877395 | mon1 | skipping: Conditional result was False
2026-07-06 02:23:28.898570 | 
2026-07-06 02:23:28.898750 | LOOP [Switch "ansible_host" to private IP]
2026-07-06 02:23:29.293494 | mon1 | changed: 2 replacements made
2026-07-06 02:23:29.295019 | mon1 | skipping: Conditional result was False
2026-07-06 02:23:29.295616 | mon1 | skipping: Conditional result was False
2026-07-06 02:23:29.314240 | 
2026-07-06 02:23:29.314427 | TASK [Run Molecule scenario]
2026-07-06 02:23:28.911858 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3
2026-07-06 02:23:28.912006 | mon1 | Creating virtual environment at: .venv
2026-07-06 02:23:29.932603 | mon1 | Downloading pygments (1.2MiB)
2026-07-06 02:23:29.938066 | mon1 | Downloading ansible-core (2.1MiB)
2026-07-06 02:23:29.938488 | mon1 | Downloading netaddr (2.2MiB)
2026-07-06 02:23:29.941533 | mon1 | Downloading cryptography (4.3MiB)
2026-07-06 02:23:30.385557 | mon1 |  Downloading netaddr
2026-07-06 02:23:30.385627 | mon1 |  Downloading pygments
2026-07-06 02:23:30.491208 | mon1 |  Downloading cryptography
2026-07-06 02:23:30.536052 | mon1 |  Downloading ansible-core
2026-07-06 02:23:30.578612 | mon1 | Installed 37 packages in 41ms
2026-07-06 02:23:31.404788 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-07-06 02:23:31.404889 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-07-06 02:23:33.028796 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-07-06 02:23:33.028885 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-07-06 02:23:48.312124 | mon1 | INFO     [default > dependency] Executing
2026-07-06 02:23:48.312401 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-07-06 02:23:48.312753 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-07-06 02:23:48.312878 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-07-06 02:23:48.320284 | mon1 | INFO     [default > cleanup] Executing
2026-07-06 02:23:48.320642 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-07-06 02:23:48.326583 | mon1 | INFO     [default > destroy] Executing
2026-07-06 02:23:48.326622 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-07-06 02:23:48.326695 | mon1 | INFO     [default > destroy] Executed: Successful
2026-07-06 02:23:48.332401 | mon1 | INFO     [default > syntax] Executing
2026-07-06 02:23:49.478351 | mon1 |
2026-07-06 02:23:49.478750 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-07-06 02:23:49.534595 | mon1 | INFO     [default > syntax] Executed: Successful
2026-07-06 02:23:49.543721 | mon1 | INFO     [default > create] Executing
2026-07-06 02:23:49.545346 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-07-06 02:23:49.551130 | mon1 | INFO     [default > prepare] Executing
2026-07-06 02:23:50.378439 | mon1 |
2026-07-06 02:23:50.378700 | mon1 | PLAY [Prepare] *****************************************************************
2026-07-06 02:23:50.379010 | mon1 |
2026-07-06 02:23:50.379292 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-06 02:23:50.379618 | mon1 | Monday 06 July 2026  02:23:50 +0000 (0:00:00.038)       0:00:00.038 ***********
2026-07-06 02:23:51.648138 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-07-06 02:23:51.648344 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-07-06 02:23:51.648636 | mon1 | interpreter could change the meaning of that path. See
2026-07-06 02:23:51.648882 | mon1 | https://docs.ansible.com/ansible-
2026-07-06 02:23:51.649145 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-06 02:23:51.723936 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-07-06 02:23:51.724180 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-07-06 02:23:51.724478 | mon1 | interpreter could change the meaning of that path. See
2026-07-06 02:23:51.724780 | mon1 | https://docs.ansible.com/ansible-
2026-07-06 02:23:51.725112 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-06 02:23:51.734489 | mon1 | ok: [mon1]
2026-07-06 02:23:51.734624 | mon1 | ok: [osd1]
2026-07-06 02:23:51.734774 | mon1 |
2026-07-06 02:23:51.734931 | mon1 | TASK [Configure short hostname] ************************************************
2026-07-06 02:23:51.735086 | mon1 | Monday 06 July 2026  02:23:51 +0000 (0:00:01.356)       0:00:01.394 ***********
2026-07-06 02:23:52.754424 | mon1 | changed: [mon1]
2026-07-06 02:23:52.754461 | mon1 | changed: [osd1]
2026-07-06 02:23:52.754472 | mon1 |
2026-07-06 02:23:52.754694 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-07-06 02:23:52.754972 | mon1 | Monday 06 July 2026  02:23:52 +0000 (0:00:01.018)       0:00:02.413 ***********
2026-07-06 02:23:53.066650 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-07-06 02:23:53.066945 | mon1 | with a mode of 0700, this may cause issues when running as another user. To
2026-07-06 02:23:53.067271 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-07-06 02:23:53.104486 | mon1 | changed: [mon1]
2026-07-06 02:23:53.104551 | mon1 | changed: [osd1]
2026-07-06 02:23:53.104562 | mon1 |
2026-07-06 02:23:53.104571 | mon1 | TASK [Update apt cache] ********************************************************
2026-07-06 02:23:53.104581 | mon1 | Monday 06 July 2026  02:23:53 +0000 (0:00:00.349)       0:00:02.762 ***********
2026-07-06 02:23:59.478429 | mon1 | changed: [osd1]
2026-07-06 02:23:59.478686 | mon1 | changed: [mon1]
2026-07-06 02:23:59.478917 | mon1 |
2026-07-06 02:23:59.479170 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-07-06 02:23:59.479394 | mon1 |
2026-07-06 02:23:59.479664 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-06 02:23:59.479910 | mon1 | Monday 06 July 2026  02:23:59 +0000 (0:00:06.375)       0:00:09.138 ***********
2026-07-06 02:24:00.286584 | mon1 | ok: [osd1]
2026-07-06 02:24:00.286689 | mon1 |
2026-07-06 02:24:00.286878 | mon1 | TASK [Install depedencies] *****************************************************
2026-07-06 02:24:00.287061 | mon1 | Monday 06 July 2026  02:24:00 +0000 (0:00:00.808)       0:00:09.946 ***********
2026-07-06 02:24:23.142841 | mon1 | changed: [osd1]
2026-07-06 02:24:23.143035 | mon1 |
2026-07-06 02:24:23.143409 | mon1 | TASK [Start up service] ********************************************************
2026-07-06 02:24:23.143697 | mon1 | Monday 06 July 2026  02:24:23 +0000 (0:00:22.855)       0:00:32.802 ***********
2026-07-06 02:24:23.839786 | mon1 | ok: [osd1]
2026-07-06 02:24:23.839984 | mon1 |
2026-07-06 02:24:23.840279 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-07-06 02:24:23.840596 | mon1 | Monday 06 July 2026  02:24:23 +0000 (0:00:00.696)       0:00:33.499 ***********
2026-07-06 02:24:24.199306 | mon1 | ok: [osd1]
2026-07-06 02:24:24.199616 | mon1 |
2026-07-06 02:24:24.199886 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-07-06 02:24:24.200257 | mon1 | Monday 06 July 2026  02:24:24 +0000 (0:00:00.360)       0:00:33.859 ***********
2026-07-06 02:24:25.008525 | mon1 | changed: [osd1]
2026-07-06 02:24:25.008684 | mon1 |
2026-07-06 02:24:25.008944 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-07-06 02:24:25.009113 | mon1 | Monday 06 July 2026  02:24:25 +0000 (0:00:00.809)       0:00:34.668 ***********
2026-07-06 02:24:25.281444 | mon1 | ok: [osd1]
2026-07-06 02:24:25.281680 | mon1 |
2026-07-06 02:24:25.282009 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-07-06 02:24:25.282264 | mon1 | Monday 06 July 2026  02:24:25 +0000 (0:00:00.272)       0:00:34.941 ***********
2026-07-06 02:24:25.308907 | mon1 | skipping: [osd1]
2026-07-06 02:24:25.309189 | mon1 |
2026-07-06 02:24:25.309521 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-07-06 02:24:25.309777 | mon1 | Monday 06 July 2026  02:24:25 +0000 (0:00:00.027)       0:00:34.968 ***********
2026-07-06 02:24:26.034882 | mon1 | changed: [osd1] => (item=osd0)
2026-07-06 02:24:26.035100 | mon1 | changed: [osd1] => (item=osd1)
2026-07-06 02:24:26.035358 | mon1 | changed: [osd1] => (item=osd2)
2026-07-06 02:24:26.035640 | mon1 |
2026-07-06 02:24:26.035910 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-07-06 02:24:26.036191 | mon1 | Monday 06 July 2026  02:24:26 +0000 (0:00:00.725)       0:00:35.694 ***********
2026-07-06 02:24:26.831388 | mon1 | changed: [osd1] => (item=osd0)
2026-07-06 02:24:26.831655 | mon1 | changed: [osd1] => (item=osd1)
2026-07-06 02:24:26.831911 | mon1 | changed: [osd1] => (item=osd2)
2026-07-06 02:24:26.832144 | mon1 |
2026-07-06 02:24:26.832437 | mon1 | TASK [Start loop devices] ******************************************************
2026-07-06 02:24:26.832689 | mon1 | Monday 06 July 2026  02:24:26 +0000 (0:00:00.796)       0:00:36.490 ***********
2026-07-06 02:24:27.715130 | mon1 | changed: [osd1] => (item=osd0)
2026-07-06 02:24:27.715469 | mon1 | changed: [osd1] => (item=osd1)
2026-07-06 02:24:27.716695 | mon1 | changed: [osd1] => (item=osd2)
2026-07-06 02:24:27.716735 | mon1 |
2026-07-06 02:24:27.716747 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-07-06 02:24:27.716759 | mon1 | Monday 06 July 2026  02:24:27 +0000 (0:00:00.883)       0:00:37.374 ***********
2026-07-06 02:24:29.135497 | mon1 | changed: [osd1] => (item=osd0)
2026-07-06 02:24:29.135572 | mon1 | changed: [osd1] => (item=osd1)
2026-07-06 02:24:29.135803 | mon1 | changed: [osd1] => (item=osd2)
2026-07-06 02:24:29.135887 | mon1 |
2026-07-06 02:24:29.136059 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-07-06 02:24:29.136207 | mon1 | Monday 06 July 2026  02:24:29 +0000 (0:00:01.420)       0:00:38.795 ***********
2026-07-06 02:24:30.523833 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-07-06 02:24:30.523908 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-07-06 02:24:30.524008 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-07-06 02:24:30.524109 | mon1 |
2026-07-06 02:24:30.524220 | mon1 | PLAY RECAP *********************************************************************
2026-07-06 02:24:30.525190 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-07-06 02:24:30.525225 | mon1 | osd1                       : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-07-06 02:24:30.525237 | mon1 |
2026-07-06 02:24:30.525246 | mon1 |
2026-07-06 02:24:30.525255 | mon1 | TASKS RECAP ********************************************************************
2026-07-06 02:24:30.525264 | mon1 | Monday 06 July 2026  02:24:30 +0000 (0:00:01.388)       0:00:40.183 ***********
2026-07-06 02:24:30.525274 | mon1 | ===============================================================================
2026-07-06 02:24:30.525288 | mon1 | Install depedencies ---------------------------------------------------- 22.86s
2026-07-06 02:24:30.525297 | mon1 | Update apt cache -------------------------------------------------------- 6.38s
2026-07-06 02:24:30.525434 | mon1 | Create a volume group for each loop device ------------------------------ 1.42s
2026-07-06 02:24:30.525540 | mon1 | Create a logical volume for each loop device ---------------------------- 1.39s
2026-07-06 02:24:30.525645 | mon1 | Gathering Facts --------------------------------------------------------- 1.36s
2026-07-06 02:24:30.525752 | mon1 | Configure short hostname ------------------------------------------------ 1.02s
2026-07-06 02:24:30.525872 | mon1 | Start loop devices ------------------------------------------------------ 0.88s
2026-07-06 02:24:30.525969 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.81s
2026-07-06 02:24:30.526074 | mon1 | Gathering Facts --------------------------------------------------------- 0.81s
2026-07-06 02:24:30.526212 | mon1 | Set permissions on loopback devices ------------------------------------- 0.80s
2026-07-06 02:24:30.526297 | mon1 | Create devices for Ceph ------------------------------------------------- 0.73s
2026-07-06 02:24:30.526415 | mon1 | Start up service -------------------------------------------------------- 0.70s
2026-07-06 02:24:30.526515 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.36s
2026-07-06 02:24:30.526623 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.35s
2026-07-06 02:24:30.526758 | mon1 | Get list of all loopback devices ---------------------------------------- 0.27s
2026-07-06 02:24:30.526858 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s
2026-07-06 02:24:30.634697 | mon1 | INFO     [default > prepare] Executed: Successful
2026-07-06 02:24:30.643920 | mon1 | INFO     [default > converge] Executing
2026-07-06 02:24:31.771054 | mon1 |
2026-07-06 02:24:31.771453 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-07-06 02:24:31.771751 | mon1 |
2026-07-06 02:24:31.772008 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-06 02:24:31.772263 | mon1 | Monday 06 July 2026  02:24:31 +0000 (0:00:00.052)       0:00:00.052 ***********
2026-07-06 02:24:32.829201 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-07-06 02:24:32.829587 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-07-06 02:24:32.829895 | mon1 | interpreter could change the meaning of that path. See
2026-07-06 02:24:32.830166 | mon1 | https://docs.ansible.com/ansible-
2026-07-06 02:24:32.830498 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-06 02:24:32.844660 | mon1 | ok: [mon1]
2026-07-06 02:24:32.844888 | mon1 |
2026-07-06 02:24:32.845146 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:24:32.845434 | mon1 | Monday 06 July 2026  02:24:32 +0000 (0:00:01.073)       0:00:01.126 ***********
2026-07-06 02:24:33.176819 | mon1 | ok: [mon1]
2026-07-06 02:24:33.177033 | mon1 |
2026-07-06 02:24:33.177294 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:24:33.177580 | mon1 | Monday 06 July 2026  02:24:33 +0000 (0:00:00.332)       0:00:01.458 ***********
2026-07-06 02:24:33.222449 | mon1 | skipping: [mon1]
2026-07-06 02:24:33.222663 | mon1 |
2026-07-06 02:24:33.222913 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-07-06 02:24:33.223151 | mon1 | Monday 06 July 2026  02:24:33 +0000 (0:00:00.045)       0:00:01.504 ***********
2026-07-06 02:24:33.657032 | mon1 | changed: [mon1]
2026-07-06 02:24:33.657218 | mon1 |
2026-07-06 02:24:33.657515 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:24:33.657762 | mon1 | Monday 06 July 2026  02:24:33 +0000 (0:00:00.434)       0:00:01.938 ***********
2026-07-06 02:24:33.781010 | mon1 | ok: [mon1] => {
2026-07-06 02:24:33.781064 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-07-06 02:24:33.781074 | mon1 | }
2026-07-06 02:24:33.781082 | mon1 |
2026-07-06 02:24:33.781089 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:24:33.781097 | mon1 | Monday 06 July 2026  02:24:33 +0000 (0:00:00.104)       0:00:02.042 ***********
2026-07-06 02:24:34.518498 | mon1 | changed: [mon1]
2026-07-06 02:24:34.518573 | mon1 |
2026-07-06 02:24:34.518588 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:24:34.518600 | mon1 | Monday 06 July 2026  02:24:34 +0000 (0:00:00.749)       0:00:02.792 ***********
2026-07-06 02:24:34.560857 | mon1 | skipping: [mon1]
2026-07-06 02:24:34.561092 | mon1 |
2026-07-06 02:24:34.561337 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:24:34.561611 | mon1 | Monday 06 July 2026  02:24:34 +0000 (0:00:00.050)       0:00:02.842 ***********
2026-07-06 02:24:34.606600 | mon1 | skipping: [mon1]
2026-07-06 02:24:34.606807 | mon1 |
2026-07-06 02:24:34.607093 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:24:34.607411 | mon1 | Monday 06 July 2026  02:24:34 +0000 (0:00:00.045)       0:00:02.888 ***********
2026-07-06 02:24:34.865920 | mon1 | ok: [mon1]
2026-07-06 02:24:34.866105 | mon1 |
2026-07-06 02:24:34.866419 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:24:34.866657 | mon1 | Monday 06 July 2026  02:24:34 +0000 (0:00:00.259)       0:00:03.147 ***********
2026-07-06 02:24:36.070403 | mon1 | ok: [mon1]
2026-07-06 02:24:36.070621 | mon1 |
2026-07-06 02:24:36.070894 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:24:36.071153 | mon1 | Monday 06 July 2026  02:24:36 +0000 (0:00:01.204)       0:00:04.351 ***********
2026-07-06 02:24:36.268353 | mon1 | ok: [mon1] => {
2026-07-06 02:24:36.268514 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-07-06 02:24:36.268657 | mon1 | }
2026-07-06 02:24:36.268793 | mon1 |
2026-07-06 02:24:36.268952 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:24:36.269113 | mon1 | Monday 06 July 2026  02:24:36 +0000 (0:00:00.197)       0:00:04.549 ***********
2026-07-06 02:24:37.385498 | mon1 | changed: [mon1]
2026-07-06 02:24:37.386183 | mon1 |
2026-07-06 02:24:37.386266 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:24:37.386282 | mon1 | Monday 06 July 2026  02:24:37 +0000 (0:00:01.116)       0:00:05.665 ***********
2026-07-06 02:24:41.687024 | mon1 | changed: [mon1]
2026-07-06 02:24:41.687105 | mon1 |
2026-07-06 02:24:41.687119 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-07-06 02:24:41.687133 | mon1 | Monday 06 July 2026  02:24:41 +0000 (0:00:04.300)       0:00:09.966 ***********
2026-07-06 02:24:41.722519 | mon1 | skipping: [mon1]
2026-07-06 02:24:41.722574 | mon1 |
2026-07-06 02:24:41.722580 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-07-06 02:24:41.722687 | mon1 | Monday 06 July 2026  02:24:41 +0000 (0:00:00.036)       0:00:10.003 ***********
2026-07-06 02:24:41.758515 | mon1 | skipping: [mon1]
2026-07-06 02:24:41.758569 | mon1 |
2026-07-06 02:24:41.758578 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-07-06 02:24:41.758739 | mon1 | Monday 06 July 2026  02:24:41 +0000 (0:00:00.035)       0:00:10.038 ***********
2026-07-06 02:24:41.794503 | mon1 | skipping: [mon1]
2026-07-06 02:24:41.794558 | mon1 |
2026-07-06 02:24:41.795220 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-07-06 02:24:41.795287 | mon1 | Monday 06 July 2026  02:24:41 +0000 (0:00:00.036)       0:00:10.074 ***********
2026-07-06 02:24:49.107946 | mon1 | changed: [mon1]
2026-07-06 02:24:49.107995 | mon1 |
2026-07-06 02:24:49.108008 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-07-06 02:24:49.108021 | mon1 | Monday 06 July 2026  02:24:49 +0000 (0:00:07.312)       0:00:17.387 ***********
2026-07-06 02:24:49.768097 | mon1 | changed: [mon1]
2026-07-06 02:24:49.768162 | mon1 |
2026-07-06 02:24:49.768177 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-07-06 02:24:49.768190 | mon1 | Monday 06 July 2026  02:24:49 +0000 (0:00:00.659)       0:00:18.047 ***********
2026-07-06 02:24:50.879469 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'})
2026-07-06 02:24:50.880560 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-07-06 02:24:50.880622 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-07-06 02:24:50.880631 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-07-06 02:24:50.880646 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-07-06 02:24:50.881434 | mon1 |
2026-07-06 02:24:50.881476 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-07-06 02:24:50.881483 | mon1 | Monday 06 July 2026  02:24:50 +0000 (0:00:01.112)       0:00:19.159 ***********
2026-07-06 02:24:51.595556 | mon1 | changed: [mon1]
2026-07-06 02:24:51.595613 | mon1 |
2026-07-06 02:24:51.596541 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-07-06 02:24:51.596596 | mon1 | Monday 06 July 2026  02:24:51 +0000 (0:00:00.708)       0:00:19.867 ***********
2026-07-06 02:24:51.596604 | mon1 |
2026-07-06 02:24:51.596976 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-07-06 02:24:51.597033 | mon1 | Monday 06 July 2026  02:24:51 +0000 (0:00:00.008)       0:00:19.876 ***********
2026-07-06 02:24:52.687899 | mon1 | ok: [mon1]
2026-07-06 02:24:52.687954 | mon1 |
2026-07-06 02:24:52.687968 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-07-06 02:24:52.687981 | mon1 | Monday 06 July 2026  02:24:52 +0000 (0:00:01.091)       0:00:20.968 ***********
2026-07-06 02:24:53.250074 | mon1 | changed: [mon1]
2026-07-06 02:24:53.250174 | mon1 |
2026-07-06 02:24:53.250185 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-07-06 02:24:53.250195 | mon1 | Monday 06 July 2026  02:24:53 +0000 (0:00:00.562)       0:00:21.530 ***********
2026-07-06 02:24:53.977942 | mon1 | changed: [mon1]
2026-07-06 02:24:53.977998 | mon1 |
2026-07-06 02:24:53.978008 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:24:53.978018 | mon1 | Monday 06 July 2026  02:24:53 +0000 (0:00:00.728)       0:00:22.258 ***********
2026-07-06 02:24:54.247704 | mon1 | ok: [mon1]
2026-07-06 02:24:54.247736 | mon1 |
2026-07-06 02:24:54.247741 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:24:54.247745 | mon1 | Monday 06 July 2026  02:24:54 +0000 (0:00:00.267)       0:00:22.525 ***********
2026-07-06 02:24:54.330479 | mon1 | ok: [mon1] => {
2026-07-06 02:24:54.330952 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-07-06 02:24:54.332087 | mon1 | }
2026-07-06 02:24:54.332109 | mon1 |
2026-07-06 02:24:54.332114 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:24:54.332121 | mon1 | Monday 06 July 2026  02:24:54 +0000 (0:00:00.084)       0:00:22.610 ***********
2026-07-06 02:24:55.395965 | mon1 | changed: [mon1]
2026-07-06 02:24:55.396043 | mon1 |
2026-07-06 02:24:55.396131 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:24:55.396261 | mon1 | Monday 06 July 2026  02:24:55 +0000 (0:00:01.065)       0:00:23.676 ***********
2026-07-06 02:25:00.034393 | mon1 | changed: [mon1]
2026-07-06 02:25:00.034426 | mon1 |
2026-07-06 02:25:00.034431 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-07-06 02:25:00.034435 | mon1 | Monday 06 July 2026  02:25:00 +0000 (0:00:04.637)       0:00:28.314 ***********
2026-07-06 02:25:00.937059 | mon1 | ok: [mon1]
2026-07-06 02:25:00.937484 | mon1 |
2026-07-06 02:25:00.937882 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-07-06 02:25:00.938224 | mon1 | Monday 06 July 2026  02:25:00 +0000 (0:00:00.903)       0:00:29.218 ***********
2026-07-06 02:25:01.307895 | mon1 | changed: [mon1]
2026-07-06 02:25:01.307971 | mon1 |
2026-07-06 02:25:01.308151 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-07-06 02:25:01.308407 | mon1 | Monday 06 July 2026  02:25:01 +0000 (0:00:00.370)       0:00:29.588 ***********
2026-07-06 02:25:01.877900 | mon1 | changed: [mon1]
2026-07-06 02:25:01.877952 | mon1 |
2026-07-06 02:25:01.877962 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-07-06 02:25:01.877972 | mon1 | Monday 06 July 2026  02:25:01 +0000 (0:00:00.569)       0:00:30.158 ***********
2026-07-06 02:25:02.567418 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'})
2026-07-06 02:25:02.567451 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-07-06 02:25:02.567456 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-07-06 02:25:02.567460 | mon1 |
2026-07-06 02:25:02.567465 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-07-06 02:25:02.567535 | mon1 | Monday 06 July 2026  02:25:02 +0000 (0:00:00.688)       0:00:30.846 ***********
2026-07-06 02:25:03.135756 | mon1 | changed: [mon1]
2026-07-06 02:25:03.135833 | mon1 |
2026-07-06 02:25:03.135950 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-07-06 02:25:03.136065 | mon1 | Monday 06 July 2026  02:25:03 +0000 (0:00:00.569)       0:00:31.415 ***********
2026-07-06 02:25:03.715004 | mon1 | changed: [mon1]
2026-07-06 02:25:03.715057 | mon1 |
2026-07-06 02:25:03.716398 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-07-06 02:25:03.716416 | mon1 | Monday 06 July 2026  02:25:03 +0000 (0:00:00.573)       0:00:31.988 ***********
2026-07-06 02:25:03.716421 | mon1 |
2026-07-06 02:25:03.716426 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-07-06 02:25:03.716430 | mon1 | Monday 06 July 2026  02:25:03 +0000 (0:00:00.008)       0:00:31.996 ***********
2026-07-06 02:25:04.610554 | mon1 | ok: [mon1]
2026-07-06 02:25:04.610634 | mon1 |
2026-07-06 02:25:04.610650 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-07-06 02:25:04.610672 | mon1 | Monday 06 July 2026  02:25:04 +0000 (0:00:00.894)       0:00:32.891 ***********
2026-07-06 02:25:07.512996 | mon1 | changed: [mon1]
2026-07-06 02:25:07.513239 | mon1 |
2026-07-06 02:25:07.513529 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-07-06 02:25:07.513769 | mon1 | Monday 06 July 2026  02:25:07 +0000 (0:00:02.903)       0:00:35.794 ***********
2026-07-06 02:25:08.212517 | mon1 | changed: [mon1]
2026-07-06 02:25:08.212769 | mon1 |
2026-07-06 02:25:08.213047 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-07-06 02:25:08.213308 | mon1 | Monday 06 July 2026  02:25:08 +0000 (0:00:00.699)       0:00:36.493 ***********
2026-07-06 02:25:08.270168 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-07-06 02:25:08.270376 | mon1 |
2026-07-06 02:25:08.270668 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-07-06 02:25:08.270917 | mon1 | Monday 06 July 2026  02:25:08 +0000 (0:00:00.057)       0:00:36.551 ***********
2026-07-06 02:25:27.958934 | mon1 | changed: [mon1]
2026-07-06 02:25:27.959189 | mon1 |
2026-07-06 02:25:27.959515 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-07-06 02:25:27.959778 | mon1 | Monday 06 July 2026  02:25:27 +0000 (0:00:19.688)       0:00:56.239 ***********
2026-07-06 02:25:28.821085 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-07-06 02:25:28.821303 | mon1 | ok: [mon1] => (item=ssh)
2026-07-06 02:25:28.821634 | mon1 |
2026-07-06 02:25:28.821902 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-07-06 02:25:28.822155 | mon1 | Monday 06 July 2026  02:25:28 +0000 (0:00:00.862)       0:00:57.102 ***********
2026-07-06 02:25:29.524543 | mon1 | changed: [mon1]
2026-07-06 02:25:29.524637 | mon1 |
2026-07-06 02:25:29.525077 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-07-06 02:25:29.525134 | mon1 | Monday 06 July 2026  02:25:29 +0000 (0:00:00.703)       0:00:57.805 ***********
2026-07-06 02:25:29.781380 | mon1 | ok: [mon1]
2026-07-06 02:25:29.781419 | mon1 |
2026-07-06 02:25:29.781427 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-07-06 02:25:29.781435 | mon1 | Monday 06 July 2026  02:25:29 +0000 (0:00:00.255)       0:00:58.061 ***********
2026-07-06 02:25:30.295459 | mon1 | changed: [mon1]
2026-07-06 02:25:30.295517 | mon1 |
2026-07-06 02:25:30.295908 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-07-06 02:25:30.295965 | mon1 | Monday 06 July 2026  02:25:30 +0000 (0:00:00.514)       0:00:58.575 ***********
2026-07-06 02:25:30.644447 | mon1 | changed: [mon1]
2026-07-06 02:25:30.644505 | mon1 |
2026-07-06 02:25:30.644540 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-07-06 02:25:30.644585 | mon1 | Monday 06 July 2026  02:25:30 +0000 (0:00:00.349)       0:00:58.925 ***********
2026-07-06 02:25:30.772908 | mon1 | ok: [mon1]
2026-07-06 02:25:30.772970 | mon1 |
2026-07-06 02:25:30.772984 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-07-06 02:25:30.772997 | mon1 | Monday 06 July 2026  02:25:30 +0000 (0:00:00.127)       0:00:59.053 ***********
2026-07-06 02:25:31.039478 | mon1 | ok: [mon1] => (item=mon1)
2026-07-06 02:25:31.039535 | mon1 |
2026-07-06 02:25:31.039577 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-07-06 02:25:31.039879 | mon1 | Monday 06 July 2026  02:25:31 +0000 (0:00:00.267)       0:00:59.320 ***********
2026-07-06 02:25:31.091790 | mon1 | ok: [mon1]
2026-07-06 02:25:31.091844 | mon1 |
2026-07-06 02:25:31.091858 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-07-06 02:25:31.091871 | mon1 | Monday 06 July 2026  02:25:31 +0000 (0:00:00.051)       0:00:59.371 ***********
2026-07-06 02:25:31.179772 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1
2026-07-06 02:25:31.179832 | mon1 |
2026-07-06 02:25:31.179843 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-07-06 02:25:31.179852 | mon1 | Monday 06 July 2026  02:25:31 +0000 (0:00:00.088)       0:00:59.460 ***********
2026-07-06 02:25:31.492401 | mon1 | changed: [mon1]
2026-07-06 02:25:31.492432 | mon1 |
2026-07-06 02:25:31.492437 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-07-06 02:25:31.492497 | mon1 | Monday 06 July 2026  02:25:31 +0000 (0:00:00.311)       0:00:59.771 ***********
2026-07-06 02:25:32.263445 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-07-06 02:25:32.264508 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-07-06 02:25:32.264809 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10})
2026-07-06 02:25:32.265063 | mon1 |
2026-07-06 02:25:32.265358 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-07-06 02:25:32.265701 | mon1 | Monday 06 July 2026  02:25:32 +0000 (0:00:00.772)       0:01:00.544 ***********
2026-07-06 02:27:27.685679 | mon1 | ok: [mon1]
2026-07-06 02:27:27.685736 | mon1 |
2026-07-06 02:27:27.685750 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-07-06 02:27:27.685763 | mon1 | Monday 06 July 2026  02:27:27 +0000 (0:01:55.421)       0:02:55.966 ***********
2026-07-06 02:27:27.941164 | mon1 | changed: [mon1]
2026-07-06 02:27:27.941231 | mon1 |
2026-07-06 02:27:27.941246 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-07-06 02:27:27.941259 | mon1 | Monday 06 July 2026  02:27:27 +0000 (0:00:00.255)       0:02:56.221 ***********
2026-07-06 02:27:27.979909 | mon1 | ok: [mon1]
2026-07-06 02:27:27.979961 | mon1 |
2026-07-06 02:27:27.979977 | mon1 | TASK [Install Ceph host] *******************************************************
2026-07-06 02:27:27.979990 | mon1 | Monday 06 July 2026  02:27:27 +0000 (0:00:00.038)       0:02:56.259 ***********
2026-07-06 02:27:28.044416 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-07-06 02:27:28.044453 | mon1 |
2026-07-06 02:27:28.044470 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-07-06 02:27:28.044478 | mon1 | Monday 06 July 2026  02:27:28 +0000 (0:00:00.065)       0:02:56.325 ***********
2026-07-06 02:27:33.536820 | mon1 | ok: [mon1]
2026-07-06 02:27:33.536877 | mon1 |
2026-07-06 02:27:33.536891 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-07-06 02:27:33.536903 | mon1 | Monday 06 July 2026  02:27:33 +0000 (0:00:05.490)       0:03:01.816 ***********
2026-07-06 02:27:33.604483 | mon1 | ok: [mon1] => (item=mon1)
2026-07-06 02:27:33.604546 | mon1 |
2026-07-06 02:27:33.604569 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-07-06 02:27:33.604823 | mon1 | Monday 06 July 2026  02:27:33 +0000 (0:00:00.069)       0:03:01.885 ***********
2026-07-06 02:27:34.044139 | mon1 | ok: [mon1]
2026-07-06 02:27:34.044394 | mon1 |
2026-07-06 02:27:34.044825 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-07-06 02:27:34.045403 | mon1 | Monday 06 July 2026  02:27:34 +0000 (0:00:00.439)       0:03:02.325 ***********
2026-07-06 02:27:40.991235 | mon1 | ok: [mon1]
2026-07-06 02:27:40.991502 | mon1 |
2026-07-06 02:27:40.991805 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-07-06 02:27:40.992064 | mon1 | Monday 06 July 2026  02:27:40 +0000 (0:00:06.946)       0:03:09.272 ***********
2026-07-06 02:27:52.862568 | mon1 | changed: [mon1]
2026-07-06 02:27:52.862625 | mon1 |
2026-07-06 02:27:52.862639 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-07-06 02:27:52.862652 | mon1 | Monday 06 July 2026  02:27:52 +0000 (0:00:11.870)       0:03:21.143 ***********
2026-07-06 02:28:07.260858 | mon1 | ok: [mon1]
2026-07-06 02:28:07.261006 | mon1 |
2026-07-06 02:28:07.261026 | mon1 | TASK [Install Ceph host] *******************************************************
2026-07-06 02:28:07.261156 | mon1 | Monday 06 July 2026  02:28:07 +0000 (0:00:14.399)       0:03:35.542 ***********
2026-07-06 02:28:07.335457 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-07-06 02:28:07.335513 | mon1 |
2026-07-06 02:28:07.335876 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-07-06 02:28:07.336197 | mon1 | Monday 06 July 2026  02:28:07 +0000 (0:00:00.073)       0:03:35.615 ***********
2026-07-06 02:28:07.385063 | mon1 | skipping: [mon1]
2026-07-06 02:28:07.385455 | mon1 |
2026-07-06 02:28:07.386116 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-07-06 02:28:07.386137 | mon1 | Monday 06 July 2026  02:28:07 +0000 (0:00:00.049)       0:03:35.665 ***********
2026-07-06 02:28:07.440591 | mon1 | skipping: [mon1] => (item=mon1)
2026-07-06 02:28:07.440657 | mon1 | skipping: [mon1]
2026-07-06 02:28:07.440671 | mon1 |
2026-07-06 02:28:07.440681 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-07-06 02:28:07.440690 | mon1 | Monday 06 July 2026  02:28:07 +0000 (0:00:00.054)       0:03:35.720 ***********
2026-07-06 02:28:07.756497 | mon1 | ok: [mon1]
2026-07-06 02:28:07.756587 | mon1 |
2026-07-06 02:28:07.757010 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-07-06 02:28:07.757052 | mon1 | Monday 06 July 2026  02:28:07 +0000 (0:00:00.316)       0:03:36.037 ***********
2026-07-06 02:28:14.695468 | mon1 | ok: [mon1]
2026-07-06 02:28:14.695570 | mon1 |
2026-07-06 02:28:14.695579 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-07-06 02:28:14.695588 | mon1 | Monday 06 July 2026  02:28:14 +0000 (0:00:06.938)       0:03:42.975 ***********
2026-07-06 02:28:27.077608 | mon1 | changed: [mon1]
2026-07-06 02:28:27.077671 | mon1 |
2026-07-06 02:28:27.077765 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-07-06 02:28:27.077878 | mon1 | Monday 06 July 2026  02:28:27 +0000 (0:00:12.384)       0:03:55.359 ***********
2026-07-06 02:28:33.388966 | mon1 | ok: [mon1]
2026-07-06 02:28:33.389032 | mon1 |
2026-07-06 02:28:33.389046 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-07-06 02:28:33.389058 | mon1 | Monday 06 July 2026  02:28:33 +0000 (0:00:06.309)       0:04:01.669 ***********
2026-07-06 02:28:39.199675 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'})
2026-07-06 02:28:39.199716 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-07-06 02:28:39.199722 | mon1 | changed: [mon1] => (item={'name': 'prometheus'})
2026-07-06 02:28:39.199727 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-07-06 02:28:39.199733 | mon1 |
2026-07-06 02:28:39.199738 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-07-06 02:28:39.199744 | mon1 |
2026-07-06 02:28:39.199749 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-06 02:28:39.199754 | mon1 | Monday 06 July 2026  02:28:39 +0000 (0:00:05.808)       0:04:07.477 ***********
2026-07-06 02:28:40.439247 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-07-06 02:28:40.443426 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-07-06 02:28:40.443449 | mon1 | interpreter could change the meaning of that path. See
2026-07-06 02:28:40.443457 | mon1 | https://docs.ansible.com/ansible-
2026-07-06 02:28:40.443466 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-06 02:28:40.454807 | mon1 | ok: [osd1]
2026-07-06 02:28:40.454838 | mon1 |
2026-07-06 02:28:40.454847 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:28:40.454855 | mon1 | Monday 06 July 2026  02:28:40 +0000 (0:00:01.258)       0:04:08.736 ***********
2026-07-06 02:28:40.725240 | mon1 | ok: [osd1]
2026-07-06 02:28:40.725278 | mon1 |
2026-07-06 02:28:40.725287 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:28:40.725294 | mon1 | Monday 06 July 2026  02:28:40 +0000 (0:00:00.267)       0:04:09.003 ***********
2026-07-06 02:28:40.763600 | mon1 | skipping: [osd1]
2026-07-06 02:28:40.763767 | mon1 |
2026-07-06 02:28:40.763920 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-07-06 02:28:40.764088 | mon1 | Monday 06 July 2026  02:28:40 +0000 (0:00:00.042)       0:04:09.045 ***********
2026-07-06 02:28:41.023515 | mon1 | changed: [osd1]
2026-07-06 02:28:41.024512 | mon1 |
2026-07-06 02:28:41.024662 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:28:41.024802 | mon1 | Monday 06 July 2026  02:28:41 +0000 (0:00:00.259)       0:04:09.305 ***********
2026-07-06 02:28:41.086803 | mon1 | ok: [osd1] => {
2026-07-06 02:28:41.086979 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-07-06 02:28:41.088830 | mon1 | }
2026-07-06 02:28:41.088843 | mon1 |
2026-07-06 02:28:41.088847 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:28:41.088852 | mon1 | Monday 06 July 2026  02:28:41 +0000 (0:00:00.063)       0:04:09.368 ***********
2026-07-06 02:28:41.733963 | mon1 | changed: [osd1]
2026-07-06 02:28:41.734402 | mon1 |
2026-07-06 02:28:41.734752 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:28:41.735070 | mon1 | Monday 06 July 2026  02:28:41 +0000 (0:00:00.645)       0:04:10.013 ***********
2026-07-06 02:28:41.782121 | mon1 | skipping: [osd1]
2026-07-06 02:28:41.782159 | mon1 |
2026-07-06 02:28:41.782164 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:28:41.782169 | mon1 | Monday 06 July 2026  02:28:41 +0000 (0:00:00.047)       0:04:10.061 ***********
2026-07-06 02:28:41.829823 | mon1 | skipping: [osd1]
2026-07-06 02:28:41.832387 | mon1 |
2026-07-06 02:28:41.832401 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:28:41.832406 | mon1 | Monday 06 July 2026  02:28:41 +0000 (0:00:00.049)       0:04:10.111 ***********
2026-07-06 02:28:42.090514 | mon1 | ok: [osd1]
2026-07-06 02:28:42.092751 | mon1 |
2026-07-06 02:28:42.092766 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:28:42.092770 | mon1 | Monday 06 July 2026  02:28:42 +0000 (0:00:00.260)       0:04:10.372 ***********
2026-07-06 02:28:43.063327 | mon1 | ok: [osd1]
2026-07-06 02:28:43.064506 | mon1 |
2026-07-06 02:28:43.064659 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:28:43.064799 | mon1 | Monday 06 July 2026  02:28:43 +0000 (0:00:00.973)       0:04:11.345 ***********
2026-07-06 02:28:43.143772 | mon1 | ok: [osd1] => {
2026-07-06 02:28:43.144079 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-07-06 02:28:43.147147 | mon1 | }
2026-07-06 02:28:43.147167 | mon1 |
2026-07-06 02:28:43.147181 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:28:43.147187 | mon1 | Monday 06 July 2026  02:28:43 +0000 (0:00:00.080)       0:04:11.425 ***********
2026-07-06 02:28:43.989937 | mon1 | changed: [osd1]
2026-07-06 02:28:43.991516 | mon1 |
2026-07-06 02:28:43.991701 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:28:43.991859 | mon1 | Monday 06 July 2026  02:28:43 +0000 (0:00:00.846)       0:04:12.271 ***********
2026-07-06 02:28:46.904343 | mon1 | changed: [osd1]
2026-07-06 02:28:46.904541 | mon1 |
2026-07-06 02:28:46.904695 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-07-06 02:28:46.904840 | mon1 | Monday 06 July 2026  02:28:46 +0000 (0:00:02.914)       0:04:15.186 ***********
2026-07-06 02:28:46.938813 | mon1 | skipping: [osd1]
2026-07-06 02:28:46.940834 | mon1 |
2026-07-06 02:28:46.940848 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-07-06 02:28:46.940855 | mon1 | Monday 06 July 2026  02:28:46 +0000 (0:00:00.034)       0:04:15.220 ***********
2026-07-06 02:28:46.976047 | mon1 | skipping: [osd1]
2026-07-06 02:28:46.976081 | mon1 |
2026-07-06 02:28:46.976087 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-07-06 02:28:46.976092 | mon1 | Monday 06 July 2026  02:28:46 +0000 (0:00:00.034)       0:04:15.255 ***********
2026-07-06 02:28:47.009953 | mon1 | skipping: [osd1]
2026-07-06 02:28:47.012784 | mon1 |
2026-07-06 02:28:47.012800 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-07-06 02:28:47.012817 | mon1 | Monday 06 July 2026  02:28:47 +0000 (0:00:00.036)       0:04:15.291 ***********
2026-07-06 02:28:55.267165 | mon1 | changed: [osd1]
2026-07-06 02:28:55.267299 | mon1 |
2026-07-06 02:28:55.267737 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-07-06 02:28:55.267776 | mon1 | Monday 06 July 2026  02:28:55 +0000 (0:00:08.257)       0:04:23.548 ***********
2026-07-06 02:28:55.865468 | mon1 | changed: [osd1]
2026-07-06 02:28:55.865525 | mon1 |
2026-07-06 02:28:55.865972 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-07-06 02:28:55.866007 | mon1 | Monday 06 July 2026  02:28:55 +0000 (0:00:00.597)       0:04:24.145 ***********
2026-07-06 02:28:57.026495 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'})
2026-07-06 02:28:57.026554 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-07-06 02:28:57.026567 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-07-06 02:28:57.026579 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-07-06 02:28:57.026591 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-07-06 02:28:57.026603 | mon1 |
2026-07-06 02:28:57.027091 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-07-06 02:28:57.027335 | mon1 | Monday 06 July 2026  02:28:57 +0000 (0:00:01.159)       0:04:25.304 ***********
2026-07-06 02:28:57.808916 | mon1 | changed: [osd1]
2026-07-06 02:28:57.808964 | mon1 |
2026-07-06 02:28:57.808972 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-07-06 02:28:57.808980 | mon1 | Monday 06 July 2026  02:28:57 +0000 (0:00:00.777)       0:04:26.082 ***********
2026-07-06 02:28:57.808987 | mon1 |
2026-07-06 02:28:57.808994 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-07-06 02:28:57.809001 | mon1 | Monday 06 July 2026  02:28:57 +0000 (0:00:00.006)       0:04:26.089 ***********
2026-07-06 02:28:58.728511 | mon1 | ok: [osd1]
2026-07-06 02:28:58.728554 | mon1 |
2026-07-06 02:28:58.728562 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-07-06 02:28:58.728570 | mon1 | Monday 06 July 2026  02:28:58 +0000 (0:00:00.919)       0:04:27.008 ***********
2026-07-06 02:28:59.322515 | mon1 | changed: [osd1]
2026-07-06 02:28:59.322563 | mon1 |
2026-07-06 02:28:59.322571 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-07-06 02:28:59.322578 | mon1 | Monday 06 July 2026  02:28:59 +0000 (0:00:00.594)       0:04:27.603 ***********
2026-07-06 02:29:00.051957 | mon1 | changed: [osd1]
2026-07-06 02:29:00.052016 | mon1 |
2026-07-06 02:29:00.052029 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:29:00.052041 | mon1 | Monday 06 July 2026  02:29:00 +0000 (0:00:00.728)       0:04:28.331 ***********
2026-07-06 02:29:00.306525 | mon1 | ok: [osd1]
2026-07-06 02:29:00.306573 | mon1 |
2026-07-06 02:29:00.306582 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:29:00.306763 | mon1 | Monday 06 July 2026  02:29:00 +0000 (0:00:00.255)       0:04:28.587 ***********
2026-07-06 02:29:00.365751 | mon1 | ok: [osd1] => {
2026-07-06 02:29:00.366820 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-07-06 02:29:00.367016 | mon1 | }
2026-07-06 02:29:00.367159 | mon1 |
2026-07-06 02:29:00.367540 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:29:00.367693 | mon1 | Monday 06 July 2026  02:29:00 +0000 (0:00:00.059)       0:04:28.647 ***********
2026-07-06 02:29:01.240901 | mon1 | changed: [osd1]
2026-07-06 02:29:01.241011 | mon1 |
2026-07-06 02:29:01.241220 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:29:01.241441 | mon1 | Monday 06 July 2026  02:29:01 +0000 (0:00:00.874)       0:04:29.521 ***********
2026-07-06 02:29:05.906707 | mon1 | changed: [osd1]
2026-07-06 02:29:05.906976 | mon1 |
2026-07-06 02:29:05.907246 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-07-06 02:29:05.907536 | mon1 | Monday 06 July 2026  02:29:05 +0000 (0:00:04.666)       0:04:34.188 ***********
2026-07-06 02:29:06.963187 | mon1 | ok: [osd1]
2026-07-06 02:29:06.963229 | mon1 |
2026-07-06 02:29:06.963236 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-07-06 02:29:06.963243 | mon1 | Monday 06 July 2026  02:29:06 +0000 (0:00:01.056)       0:04:35.244 ***********
2026-07-06 02:29:07.269774 | mon1 | changed: [osd1]
2026-07-06 02:29:07.269888 | mon1 |
2026-07-06 02:29:07.270036 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-07-06 02:29:07.270186 | mon1 | Monday 06 July 2026  02:29:07 +0000 (0:00:00.306)       0:04:35.551 ***********
2026-07-06 02:29:07.878981 | mon1 | changed: [osd1]
2026-07-06 02:29:07.879033 | mon1 |
2026-07-06 02:29:07.879046 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-07-06 02:29:07.879059 | mon1 | Monday 06 July 2026  02:29:07 +0000 (0:00:00.607)       0:04:36.158 ***********
2026-07-06 02:29:08.588528 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'})
2026-07-06 02:29:08.588576 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-07-06 02:29:08.588590 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-07-06 02:29:08.588602 | mon1 |
2026-07-06 02:29:08.588614 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-07-06 02:29:08.588626 | mon1 | Monday 06 July 2026  02:29:08 +0000 (0:00:00.709)       0:04:36.868 ***********
2026-07-06 02:29:09.175135 | mon1 | changed: [osd1]
2026-07-06 02:29:09.176026 | mon1 |
2026-07-06 02:29:09.176056 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-07-06 02:29:09.176069 | mon1 | Monday 06 July 2026  02:29:09 +0000 (0:00:00.587)       0:04:37.456 ***********
2026-07-06 02:29:09.778394 | mon1 | changed: [osd1]
2026-07-06 02:29:09.778426 | mon1 |
2026-07-06 02:29:09.778432 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-07-06 02:29:09.778438 | mon1 | Monday 06 July 2026  02:29:09 +0000 (0:00:00.596)       0:04:38.052 ***********
2026-07-06 02:29:09.778443 | mon1 |
2026-07-06 02:29:09.778448 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-07-06 02:29:09.778454 | mon1 | Monday 06 July 2026  02:29:09 +0000 (0:00:00.006)       0:04:38.058 ***********
2026-07-06 02:29:10.698564 | mon1 | ok: [osd1]
2026-07-06 02:29:10.698621 | mon1 |
2026-07-06 02:29:10.698636 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-07-06 02:29:10.698735 | mon1 | Monday 06 July 2026  02:29:10 +0000 (0:00:00.920)       0:04:38.979 ***********
2026-07-06 02:29:12.546586 | mon1 | changed: [osd1]
2026-07-06 02:29:12.546675 | mon1 |
2026-07-06 02:29:12.546696 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-07-06 02:29:12.546900 | mon1 | Monday 06 July 2026  02:29:12 +0000 (0:00:01.847)       0:04:40.827 ***********
2026-07-06 02:29:13.292391 | mon1 | changed: [osd1]
2026-07-06 02:29:13.292434 | mon1 |
2026-07-06 02:29:13.292443 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-07-06 02:29:13.292451 | mon1 | Monday 06 July 2026  02:29:13 +0000 (0:00:00.746)       0:04:41.573 ***********
2026-07-06 02:29:13.367825 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-07-06 02:29:13.367897 | mon1 |
2026-07-06 02:29:13.371416 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-07-06 02:29:13.371450 | mon1 | Monday 06 July 2026  02:29:13 +0000 (0:00:00.075)       0:04:41.648 ***********
2026-07-06 02:29:14.305081 | mon1 | ok: [osd1]
2026-07-06 02:29:14.305491 | mon1 |
2026-07-06 02:29:14.305862 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-07-06 02:29:14.306201 | mon1 | Monday 06 July 2026  02:29:14 +0000 (0:00:00.937)       0:04:42.586 ***********
2026-07-06 02:29:15.165793 | mon1 | ok: [osd1] => (item=systemd-timesyncd)
2026-07-06 02:29:15.165867 | mon1 | ok: [osd1] => (item=ssh)
2026-07-06 02:29:15.166158 | mon1 |
2026-07-06 02:29:15.166169 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-07-06 02:29:15.166174 | mon1 | Monday 06 July 2026  02:29:15 +0000 (0:00:00.860)       0:04:43.447 ***********
2026-07-06 02:29:15.842080 | mon1 | changed: [osd1]
2026-07-06 02:29:15.842156 | mon1 |
2026-07-06 02:29:15.842167 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-07-06 02:29:15.842177 | mon1 | Monday 06 July 2026  02:29:15 +0000 (0:00:00.673)       0:04:44.121 ***********
2026-07-06 02:29:16.089821 | mon1 | ok: [osd1]
2026-07-06 02:29:16.089866 | mon1 |
2026-07-06 02:29:16.089877 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-07-06 02:29:16.089886 | mon1 | Monday 06 July 2026  02:29:16 +0000 (0:00:00.248)       0:04:44.369 ***********
2026-07-06 02:29:16.520077 | mon1 | changed: [osd1]
2026-07-06 02:29:16.520106 | mon1 |
2026-07-06 02:29:16.520111 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-07-06 02:29:16.520122 | mon1 | Monday 06 July 2026  02:29:16 +0000 (0:00:00.429)       0:04:44.799 ***********
2026-07-06 02:29:16.793321 | mon1 | changed: [osd1]
2026-07-06 02:29:16.793434 | mon1 |
2026-07-06 02:29:16.793458 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-07-06 02:29:16.793600 | mon1 | Monday 06 July 2026  02:29:16 +0000 (0:00:00.275)       0:04:45.074 ***********
2026-07-06 02:29:17.071477 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-07-06 02:29:17.071533 | mon1 |
2026-07-06 02:29:17.071949 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-07-06 02:29:17.071973 | mon1 | Monday 06 July 2026  02:29:17 +0000 (0:00:00.276)       0:04:45.351 ***********
2026-07-06 02:29:17.122965 | mon1 | ok: [osd1]
2026-07-06 02:29:17.123014 | mon1 |
2026-07-06 02:29:17.123024 | mon1 | TASK [Install Ceph host] *******************************************************
2026-07-06 02:29:17.123034 | mon1 | Monday 06 July 2026  02:29:17 +0000 (0:00:00.051)       0:04:45.403 ***********
2026-07-06 02:29:17.194890 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-07-06 02:29:17.194922 | mon1 |
2026-07-06 02:29:17.194932 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-07-06 02:29:17.194941 | mon1 | Monday 06 July 2026  02:29:17 +0000 (0:00:00.071)       0:04:45.475 ***********
2026-07-06 02:29:23.620029 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:29:23.620089 | mon1 |
2026-07-06 02:29:23.620103 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-07-06 02:29:23.620115 | mon1 | Monday 06 July 2026  02:29:23 +0000 (0:00:06.425)       0:04:51.900 ***********
2026-07-06 02:29:23.681395 | mon1 | ok: [osd1] => (item=osd1)
2026-07-06 02:29:23.681439 | mon1 |
2026-07-06 02:29:23.681446 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-07-06 02:29:23.681452 | mon1 | Monday 06 July 2026  02:29:23 +0000 (0:00:00.061)       0:04:51.961 ***********
2026-07-06 02:29:24.019550 | mon1 | changed: [osd1]
2026-07-06 02:29:24.019659 | mon1 |
2026-07-06 02:29:24.020097 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-07-06 02:29:24.020179 | mon1 | Monday 06 July 2026  02:29:24 +0000 (0:00:00.338)       0:04:52.300 ***********
2026-07-06 02:29:34.590519 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:29:34.590581 | mon1 |
2026-07-06 02:29:34.591026 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-07-06 02:29:34.591086 | mon1 | Monday 06 July 2026  02:29:34 +0000 (0:00:10.570)       0:05:02.871 ***********
2026-07-06 02:29:36.288826 | mon1 | ok: [osd1]
2026-07-06 02:29:36.288910 | mon1 |
2026-07-06 02:29:36.289009 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-07-06 02:29:36.289126 | mon1 | Monday 06 July 2026  02:29:36 +0000 (0:00:01.697)       0:05:04.568 ***********
2026-07-06 02:33:28.117514 | mon1 | ok: [osd1]
2026-07-06 02:33:28.117604 | mon1 |
2026-07-06 02:33:28.117807 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-07-06 02:33:28.117858 | mon1 | Monday 06 July 2026  02:33:28 +0000 (0:03:51.830)       0:08:56.398 ***********
2026-07-06 02:35:14.189503 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data)
2026-07-06 02:35:14.189590 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data)
2026-07-06 02:35:14.189611 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data)
2026-07-06 02:35:14.189629 | mon1 |
2026-07-06 02:35:14.189646 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-07-06 02:35:14.189807 | mon1 | Monday 06 July 2026  02:35:14 +0000 (0:01:46.070)       0:10:42.468 ***********
2026-07-06 02:35:20.622989 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:35:20.623059 | mon1 |
2026-07-06 02:35:20.623073 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-07-06 02:35:20.623085 | mon1 | Monday 06 July 2026  02:35:20 +0000 (0:00:06.434)       0:10:48.903 ***********
2026-07-06 02:35:26.952931 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:35:26.953015 | mon1 |
2026-07-06 02:35:26.953029 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-07-06 02:35:26.953041 | mon1 | Monday 06 July 2026  02:35:26 +0000 (0:00:06.329)       0:10:55.233 ***********
2026-07-06 02:35:27.012816 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-07-06 02:35:27.012876 | mon1 |
2026-07-06 02:35:27.013001 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-07-06 02:35:27.013107 | mon1 | Monday 06 July 2026  02:35:27 +0000 (0:00:00.060)       0:10:55.293 ***********
2026-07-06 02:35:27.058020 | mon1 | ok: [osd1]
2026-07-06 02:35:27.058076 | mon1 |
2026-07-06 02:35:27.058090 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-07-06 02:35:27.058103 | mon1 | Monday 06 July 2026  02:35:27 +0000 (0:00:00.044)       0:10:55.338 ***********
2026-07-06 02:35:33.473574 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:35:33.473639 | mon1 |
2026-07-06 02:35:33.473648 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-07-06 02:35:33.473655 | mon1 | Monday 06 July 2026  02:35:33 +0000 (0:00:06.415)       0:11:01.754 ***********
2026-07-06 02:35:33.519986 | mon1 | ok: [osd1]
2026-07-06 02:35:33.520037 | mon1 |
2026-07-06 02:35:33.520052 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-07-06 02:35:33.520066 | mon1 | Monday 06 July 2026  02:35:33 +0000 (0:00:00.045)       0:11:01.800 ***********
2026-07-06 02:35:33.562536 | mon1 | skipping: [osd1] => (item=1)
2026-07-06 02:35:33.562610 | mon1 | skipping: [osd1] => (item=1)
2026-07-06 02:35:33.562624 | mon1 | skipping: [osd1] => (item=1)
2026-07-06 02:35:33.562637 | mon1 | skipping: [osd1]
2026-07-06 02:35:33.562650 | mon1 |
2026-07-06 02:35:33.562663 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-07-06 02:35:33.562719 | mon1 | Monday 06 July 2026  02:35:33 +0000 (0:00:00.041)       0:11:01.842 ***********
2026-07-06 02:35:33.632889 | mon1 | skipping: [osd1]
2026-07-06 02:35:33.633052 | mon1 |
2026-07-06 02:35:33.633343 | mon1 | PLAY [Deploy Ceph exporters] ***************************************************
2026-07-06 02:35:33.633591 | mon1 |
2026-07-06 02:35:33.633853 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-06 02:35:33.634135 | mon1 | Monday 06 July 2026  02:35:33 +0000 (0:00:00.072)       0:11:01.914 ***********
2026-07-06 02:35:34.544583 | mon1 | ok: [mon1]
2026-07-06 02:35:34.544684 | mon1 |
2026-07-06 02:35:34.544854 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:35:34.545020 | mon1 | Monday 06 July 2026  02:35:34 +0000 (0:00:00.911)       0:11:02.826 ***********
2026-07-06 02:35:34.787533 | mon1 | ok: [mon1]
2026-07-06 02:35:34.787611 | mon1 |
2026-07-06 02:35:34.787874 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:35:34.788126 | mon1 | Monday 06 July 2026  02:35:34 +0000 (0:00:00.242)       0:11:03.068 ***********
2026-07-06 02:35:34.826668 | mon1 | skipping: [mon1]
2026-07-06 02:35:34.826751 | mon1 |
2026-07-06 02:35:34.826923 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-07-06 02:35:34.827071 | mon1 | Monday 06 July 2026  02:35:34 +0000 (0:00:00.039)       0:11:03.108 ***********
2026-07-06 02:35:35.078330 | mon1 | ok: [mon1]
2026-07-06 02:35:35.078583 | mon1 |
2026-07-06 02:35:35.078841 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:35:35.079088 | mon1 | Monday 06 July 2026  02:35:35 +0000 (0:00:00.251)       0:11:03.359 ***********
2026-07-06 02:35:35.137015 | mon1 | ok: [mon1] => {
2026-07-06 02:35:35.137251 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-07-06 02:35:35.137507 | mon1 | }
2026-07-06 02:35:35.137717 | mon1 |
2026-07-06 02:35:35.137964 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:35:35.138203 | mon1 | Monday 06 July 2026  02:35:35 +0000 (0:00:00.058)       0:11:03.418 ***********
2026-07-06 02:35:35.491188 | mon1 | ok: [mon1]
2026-07-06 02:35:35.491468 | mon1 |
2026-07-06 02:35:35.491741 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:35:35.491993 | mon1 | Monday 06 July 2026  02:35:35 +0000 (0:00:00.353)       0:11:03.772 ***********
2026-07-06 02:35:35.536138 | mon1 | skipping: [mon1]
2026-07-06 02:35:35.536341 | mon1 |
2026-07-06 02:35:35.536710 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:35:35.536969 | mon1 | Monday 06 July 2026  02:35:35 +0000 (0:00:00.045)       0:11:03.817 ***********
2026-07-06 02:35:35.578498 | mon1 | skipping: [mon1]
2026-07-06 02:35:35.578523 | mon1 |
2026-07-06 02:35:35.578529 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:35:35.578797 | mon1 | Monday 06 July 2026  02:35:35 +0000 (0:00:00.041)       0:11:03.859 ***********
2026-07-06 02:35:35.812475 | mon1 | ok: [mon1]
2026-07-06 02:35:35.812523 | mon1 |
2026-07-06 02:35:35.812539 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:35:35.812805 | mon1 | Monday 06 July 2026  02:35:35 +0000 (0:00:00.233)       0:11:04.093 ***********
2026-07-06 02:35:36.701886 | mon1 | ok: [mon1]
2026-07-06 02:35:36.701960 | mon1 |
2026-07-06 02:35:36.702054 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:35:36.702165 | mon1 | Monday 06 July 2026  02:35:36 +0000 (0:00:00.889)       0:11:04.982 ***********
2026-07-06 02:35:36.781417 | mon1 | ok: [mon1] => {
2026-07-06 02:35:36.781452 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-07-06 02:35:36.781456 | mon1 | }
2026-07-06 02:35:36.781461 | mon1 |
2026-07-06 02:35:36.781465 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:35:36.781472 | mon1 | Monday 06 July 2026  02:35:36 +0000 (0:00:00.077)       0:11:05.060 ***********
2026-07-06 02:35:37.201869 | mon1 | ok: [mon1]
2026-07-06 02:35:37.201919 | mon1 |
2026-07-06 02:35:37.201930 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:35:37.201939 | mon1 | Monday 06 July 2026  02:35:37 +0000 (0:00:00.421)       0:11:05.482 ***********
2026-07-06 02:35:39.291498 | mon1 | ok: [mon1]
2026-07-06 02:35:39.291558 | mon1 |
2026-07-06 02:35:39.291959 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-07-06 02:35:39.292004 | mon1 | Monday 06 July 2026  02:35:39 +0000 (0:00:02.089)       0:11:07.571 ***********
2026-07-06 02:35:39.324533 | mon1 | skipping: [mon1]
2026-07-06 02:35:39.324577 | mon1 |
2026-07-06 02:35:39.324590 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-07-06 02:35:39.324635 | mon1 | Monday 06 July 2026  02:35:39 +0000 (0:00:00.033)       0:11:07.605 ***********
2026-07-06 02:35:39.359975 | mon1 | skipping: [mon1]
2026-07-06 02:35:39.360096 | mon1 |
2026-07-06 02:35:39.360258 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-07-06 02:35:39.360378 | mon1 | Monday 06 July 2026  02:35:39 +0000 (0:00:00.035)       0:11:07.640 ***********
2026-07-06 02:35:39.395439 | mon1 | skipping: [mon1]
2026-07-06 02:35:39.395482 | mon1 |
2026-07-06 02:35:39.395842 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-07-06 02:35:39.396226 | mon1 | Monday 06 July 2026  02:35:39 +0000 (0:00:00.035)       0:11:07.675 ***********
2026-07-06 02:35:40.365909 | mon1 | ok: [mon1]
2026-07-06 02:35:40.366034 | mon1 |
2026-07-06 02:35:40.366211 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-07-06 02:35:40.366355 | mon1 | Monday 06 July 2026  02:35:40 +0000 (0:00:00.971)       0:11:08.647 ***********
2026-07-06 02:35:40.910950 | mon1 | ok: [mon1]
2026-07-06 02:35:40.911043 | mon1 |
2026-07-06 02:35:40.911449 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-07-06 02:35:40.911496 | mon1 | Monday 06 July 2026  02:35:40 +0000 (0:00:00.544)       0:11:09.191 ***********
2026-07-06 02:35:42.025404 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-07-06 02:35:42.025480 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-07-06 02:35:42.025487 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-07-06 02:35:42.025493 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-07-06 02:35:42.025499 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-07-06 02:35:42.025505 | mon1 |
2026-07-06 02:35:42.025511 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-07-06 02:35:42.025517 | mon1 | Monday 06 July 2026  02:35:42 +0000 (0:00:01.112)       0:11:10.304 ***********
2026-07-06 02:35:42.678510 | mon1 | ok: [mon1]
2026-07-06 02:35:42.678568 | mon1 |
2026-07-06 02:35:42.678596 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-07-06 02:35:42.678608 | mon1 | Monday 06 July 2026  02:35:42 +0000 (0:00:00.649)       0:11:10.954 ***********
2026-07-06 02:35:42.678619 | mon1 |
2026-07-06 02:35:42.678639 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-07-06 02:35:42.678654 | mon1 | Monday 06 July 2026  02:35:42 +0000 (0:00:00.005)       0:11:10.959 ***********
2026-07-06 02:35:43.117745 | mon1 | ok: [mon1]
2026-07-06 02:35:43.117800 | mon1 |
2026-07-06 02:35:43.117926 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:35:43.118026 | mon1 | Monday 06 July 2026  02:35:43 +0000 (0:00:00.439)       0:11:11.399 ***********
2026-07-06 02:35:43.365839 | mon1 | ok: [mon1]
2026-07-06 02:35:43.366050 | mon1 |
2026-07-06 02:35:43.366330 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:35:43.366666 | mon1 | Monday 06 July 2026  02:35:43 +0000 (0:00:00.247)       0:11:11.647 ***********
2026-07-06 02:35:43.426212 | mon1 | ok: [mon1] => {
2026-07-06 02:35:43.426503 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-07-06 02:35:43.426740 | mon1 | }
2026-07-06 02:35:43.427034 | mon1 |
2026-07-06 02:35:43.427271 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:35:43.427550 | mon1 | Monday 06 July 2026  02:35:43 +0000 (0:00:00.060)       0:11:11.707 ***********
2026-07-06 02:35:43.840170 | mon1 | ok: [mon1]
2026-07-06 02:35:43.840403 | mon1 |
2026-07-06 02:35:43.840693 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:35:43.840968 | mon1 | Monday 06 July 2026  02:35:43 +0000 (0:00:00.414)       0:11:12.121 ***********
2026-07-06 02:35:47.082472 | mon1 | ok: [mon1]
2026-07-06 02:35:47.082553 | mon1 |
2026-07-06 02:35:47.082568 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-07-06 02:35:47.082726 | mon1 | Monday 06 July 2026  02:35:47 +0000 (0:00:03.241)       0:11:15.363 ***********
2026-07-06 02:35:48.041493 | mon1 | ok: [mon1]
2026-07-06 02:35:48.041567 | mon1 |
2026-07-06 02:35:48.042047 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-07-06 02:35:48.042122 | mon1 | Monday 06 July 2026  02:35:48 +0000 (0:00:00.959)       0:11:16.322 ***********
2026-07-06 02:35:48.279965 | mon1 | ok: [mon1]
2026-07-06 02:35:48.280076 | mon1 |
2026-07-06 02:35:48.280237 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-07-06 02:35:48.280413 | mon1 | Monday 06 July 2026  02:35:48 +0000 (0:00:00.236)       0:11:16.558 ***********
2026-07-06 02:35:48.825575 | mon1 | ok: [mon1]
2026-07-06 02:35:48.825607 | mon1 |
2026-07-06 02:35:48.825612 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-07-06 02:35:48.825617 | mon1 | Monday 06 July 2026  02:35:48 +0000 (0:00:00.547)       0:11:17.106 ***********
2026-07-06 02:35:49.515326 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-07-06 02:35:49.515483 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-07-06 02:35:49.515644 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-07-06 02:35:49.516110 | mon1 |
2026-07-06 02:35:49.516138 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-07-06 02:35:49.516145 | mon1 | Monday 06 July 2026  02:35:49 +0000 (0:00:00.688)       0:11:17.795 ***********
2026-07-06 02:35:50.040410 | mon1 | ok: [mon1]
2026-07-06 02:35:50.040438 | mon1 |
2026-07-06 02:35:50.040675 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-07-06 02:35:50.040949 | mon1 | Monday 06 July 2026  02:35:50 +0000 (0:00:00.524)       0:11:18.320 ***********
2026-07-06 02:35:50.550701 | mon1 | ok: [mon1]
2026-07-06 02:35:50.551000 | mon1 |
2026-07-06 02:35:50.551290 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-07-06 02:35:50.551593 | mon1 | Monday 06 July 2026  02:35:50 +0000 (0:00:00.506)       0:11:18.826 ***********
2026-07-06 02:35:50.553490 | mon1 |
2026-07-06 02:35:50.553509 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-07-06 02:35:50.553518 | mon1 | Monday 06 July 2026  02:35:50 +0000 (0:00:00.005)       0:11:18.832 ***********
2026-07-06 02:35:51.009774 | mon1 | ok: [mon1]
2026-07-06 02:35:51.009977 | mon1 |
2026-07-06 02:35:51.010303 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-07-06 02:35:51.010694 | mon1 | Monday 06 July 2026  02:35:51 +0000 (0:00:00.459)       0:11:19.291 ***********
2026-07-06 02:35:51.067542 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-07-06 02:35:51.067757 | mon1 |
2026-07-06 02:35:51.068010 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-07-06 02:35:51.068259 | mon1 | Monday 06 July 2026  02:35:51 +0000 (0:00:00.057)       0:11:19.349 ***********
2026-07-06 02:35:52.019929 | mon1 | ok: [mon1]
2026-07-06 02:35:52.019972 | mon1 |
2026-07-06 02:35:52.019978 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-07-06 02:35:52.019985 | mon1 | Monday 06 July 2026  02:35:52 +0000 (0:00:00.951)       0:11:20.300 ***********
2026-07-06 02:35:52.803503 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-07-06 02:35:52.803556 | mon1 | ok: [mon1] => (item=ssh)
2026-07-06 02:35:52.804402 | mon1 |
2026-07-06 02:35:52.804423 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-07-06 02:35:52.804475 | mon1 | Monday 06 July 2026  02:35:52 +0000 (0:00:00.782)       0:11:21.083 ***********
2026-07-06 02:35:53.180400 | mon1 | ok: [mon1]
2026-07-06 02:35:53.180433 | mon1 |
2026-07-06 02:35:53.180440 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-07-06 02:35:53.180528 | mon1 | Monday 06 July 2026  02:35:53 +0000 (0:00:00.377)       0:11:21.461 ***********
2026-07-06 02:35:53.424695 | mon1 | ok: [mon1]
2026-07-06 02:35:53.424919 | mon1 |
2026-07-06 02:35:53.425220 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-07-06 02:35:53.425506 | mon1 | Monday 06 July 2026  02:35:53 +0000 (0:00:00.244)       0:11:21.706 ***********
2026-07-06 02:35:53.731042 | mon1 | ok: [mon1]
2026-07-06 02:35:53.731426 | mon1 |
2026-07-06 02:35:53.731781 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-07-06 02:35:53.732133 | mon1 | Monday 06 July 2026  02:35:53 +0000 (0:00:00.306)       0:11:22.012 ***********
2026-07-06 02:35:53.970698 | mon1 | ok: [mon1]
2026-07-06 02:35:53.971047 | mon1 |
2026-07-06 02:35:53.971697 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] ***********
2026-07-06 02:35:53.971723 | mon1 | Monday 06 July 2026  02:35:53 +0000 (0:00:00.239)       0:11:22.252 ***********
2026-07-06 02:36:06.231426 | mon1 | changed: [mon1]
2026-07-06 02:36:06.231482 | mon1 |
2026-07-06 02:36:06.231495 | mon1 | PLAY RECAP *********************************************************************
2026-07-06 02:36:06.231508 | mon1 | mon1                       : ok=93   changed=30   unreachable=0    failed=0    skipped=14   rescued=0    ignored=0
2026-07-06 02:36:06.231520 | mon1 | osd1                       : ok=53   changed=23   unreachable=0    failed=0    skipped=8    rescued=0    ignored=0
2026-07-06 02:36:06.231532 | mon1 |
2026-07-06 02:36:06.231543 | mon1 |
2026-07-06 02:36:06.231555 | mon1 | TASKS RECAP ********************************************************************
2026-07-06 02:36:06.231566 | mon1 | Monday 06 July 2026  02:36:06 +0000 (0:00:12.258)       0:11:34.510 ***********
2026-07-06 02:36:06.231578 | mon1 | ===============================================================================
2026-07-06 02:36:06.231899 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ----------------- 231.83s
2026-07-06 02:36:06.232219 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 115.42s
2026-07-06 02:36:06.232572 | mon1 | vexxhost.ceph.osd : Install OSDs -------------------------------------- 106.07s
2026-07-06 02:36:06.232893 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 19.69s
2026-07-06 02:36:06.233208 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.40s
2026-07-06 02:36:06.233564 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.38s
2026-07-06 02:36:06.233886 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ---------- 12.26s
2026-07-06 02:36:06.234300 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 11.87s
2026-07-06 02:36:06.234676 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 10.57s
2026-07-06 02:36:06.235093 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.26s
2026-07-06 02:36:06.235452 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.31s
2026-07-06 02:36:06.235852 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.95s
2026-07-06 02:36:06.236191 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.94s
2026-07-06 02:36:06.236347 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.43s
2026-07-06 02:36:06.236513 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.43s
2026-07-06 02:36:06.236660 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.42s
2026-07-06 02:36:06.236826 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.33s
2026-07-06 02:36:06.236971 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.31s
2026-07-06 02:36:06.237115 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 5.81s
2026-07-06 02:36:06.237259 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.49s
2026-07-06 02:36:06.330999 | mon1 | INFO     [default > converge] Executed: Successful
2026-07-06 02:36:06.340598 | mon1 | INFO     [default > idempotence] Executing
2026-07-06 02:36:07.381535 | mon1 |
2026-07-06 02:36:07.381807 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-07-06 02:36:07.381998 | mon1 |
2026-07-06 02:36:07.382211 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-06 02:36:07.382456 | mon1 | Monday 06 July 2026  02:36:07 +0000 (0:00:00.052)       0:00:00.052 ***********
2026-07-06 02:36:08.582253 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-07-06 02:36:08.582732 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-07-06 02:36:08.583066 | mon1 | interpreter could change the meaning of that path. See
2026-07-06 02:36:08.583440 | mon1 | https://docs.ansible.com/ansible-
2026-07-06 02:36:08.583776 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-06 02:36:08.594986 | mon1 | ok: [mon1]
2026-07-06 02:36:08.595279 | mon1 |
2026-07-06 02:36:08.595617 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:36:08.595923 | mon1 | Monday 06 July 2026  02:36:08 +0000 (0:00:01.213)       0:00:01.266 ***********
2026-07-06 02:36:08.935084 | mon1 | ok: [mon1]
2026-07-06 02:36:08.935484 | mon1 |
2026-07-06 02:36:08.935821 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:36:08.936133 | mon1 | Monday 06 July 2026  02:36:08 +0000 (0:00:00.339)       0:00:01.606 ***********
2026-07-06 02:36:08.976754 | mon1 | skipping: [mon1]
2026-07-06 02:36:08.977069 | mon1 |
2026-07-06 02:36:08.977477 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-07-06 02:36:08.977838 | mon1 | Monday 06 July 2026  02:36:08 +0000 (0:00:00.042)       0:00:01.648 ***********
2026-07-06 02:36:09.330030 | mon1 | ok: [mon1]
2026-07-06 02:36:09.330969 | mon1 |
2026-07-06 02:36:09.330996 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:36:09.331007 | mon1 | Monday 06 July 2026  02:36:09 +0000 (0:00:00.353)       0:00:02.001 ***********
2026-07-06 02:36:09.404948 | mon1 | ok: [mon1] => {
2026-07-06 02:36:09.405043 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-07-06 02:36:09.405055 | mon1 | }
2026-07-06 02:36:09.405065 | mon1 |
2026-07-06 02:36:09.405075 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:36:09.405085 | mon1 | Monday 06 July 2026  02:36:09 +0000 (0:00:00.073)       0:00:02.074 ***********
2026-07-06 02:36:09.885193 | mon1 | ok: [mon1]
2026-07-06 02:36:09.885225 | mon1 |
2026-07-06 02:36:09.885231 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:36:09.885237 | mon1 | Monday 06 July 2026  02:36:09 +0000 (0:00:00.481)       0:00:02.556 ***********
2026-07-06 02:36:09.934501 | mon1 | skipping: [mon1]
2026-07-06 02:36:09.934545 | mon1 |
2026-07-06 02:36:09.934556 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:36:09.934935 | mon1 | Monday 06 July 2026  02:36:09 +0000 (0:00:00.047)       0:00:02.603 ***********
2026-07-06 02:36:09.982071 | mon1 | skipping: [mon1]
2026-07-06 02:36:09.982439 | mon1 |
2026-07-06 02:36:09.982783 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:36:09.983110 | mon1 | Monday 06 July 2026  02:36:09 +0000 (0:00:00.049)       0:00:02.653 ***********
2026-07-06 02:36:10.225150 | mon1 | ok: [mon1]
2026-07-06 02:36:10.225433 | mon1 |
2026-07-06 02:36:10.225668 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:36:10.225895 | mon1 | Monday 06 July 2026  02:36:10 +0000 (0:00:00.242)       0:00:02.896 ***********
2026-07-06 02:36:11.210660 | mon1 | ok: [mon1]
2026-07-06 02:36:11.211473 | mon1 |
2026-07-06 02:36:11.211509 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:36:11.211602 | mon1 | Monday 06 July 2026  02:36:11 +0000 (0:00:00.985)       0:00:03.881 ***********
2026-07-06 02:36:11.401227 | mon1 | ok: [mon1] => {
2026-07-06 02:36:11.401513 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-07-06 02:36:11.401822 | mon1 | }
2026-07-06 02:36:11.402110 | mon1 |
2026-07-06 02:36:11.402478 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:36:11.402795 | mon1 | Monday 06 July 2026  02:36:11 +0000 (0:00:00.190)       0:00:04.072 ***********
2026-07-06 02:36:11.922002 | mon1 | ok: [mon1]
2026-07-06 02:36:11.922215 | mon1 |
2026-07-06 02:36:11.922521 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:36:11.922791 | mon1 | Monday 06 July 2026  02:36:11 +0000 (0:00:00.520)       0:00:04.593 ***********
2026-07-06 02:36:14.362869 | mon1 | ok: [mon1]
2026-07-06 02:36:14.363091 | mon1 |
2026-07-06 02:36:14.363352 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-07-06 02:36:14.363625 | mon1 | Monday 06 July 2026  02:36:14 +0000 (0:00:02.440)       0:00:07.033 ***********
2026-07-06 02:36:14.396916 | mon1 | skipping: [mon1]
2026-07-06 02:36:14.397041 | mon1 |
2026-07-06 02:36:14.397185 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-07-06 02:36:14.397323 | mon1 | Monday 06 July 2026  02:36:14 +0000 (0:00:00.034)       0:00:07.068 ***********
2026-07-06 02:36:14.427970 | mon1 | skipping: [mon1]
2026-07-06 02:36:14.428059 | mon1 |
2026-07-06 02:36:14.428203 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-07-06 02:36:14.428343 | mon1 | Monday 06 July 2026  02:36:14 +0000 (0:00:00.031)       0:00:07.099 ***********
2026-07-06 02:36:14.464809 | mon1 | skipping: [mon1]
2026-07-06 02:36:14.465003 | mon1 |
2026-07-06 02:36:14.465135 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-07-06 02:36:14.465295 | mon1 | Monday 06 July 2026  02:36:14 +0000 (0:00:00.036)       0:00:07.136 ***********
2026-07-06 02:36:15.560275 | mon1 | ok: [mon1]
2026-07-06 02:36:15.560327 | mon1 |
2026-07-06 02:36:15.560338 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-07-06 02:36:15.560347 | mon1 | Monday 06 July 2026  02:36:15 +0000 (0:00:01.094)       0:00:08.230 ***********
2026-07-06 02:36:16.104460 | mon1 | ok: [mon1]
2026-07-06 02:36:16.104525 | mon1 |
2026-07-06 02:36:16.105094 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-07-06 02:36:16.105136 | mon1 | Monday 06 July 2026  02:36:16 +0000 (0:00:00.544)       0:00:08.774 ***********
2026-07-06 02:36:17.229646 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-07-06 02:36:17.229680 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-07-06 02:36:17.229685 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-07-06 02:36:17.229689 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-07-06 02:36:17.229694 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-07-06 02:36:17.229698 | mon1 |
2026-07-06 02:36:17.229702 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-07-06 02:36:17.229706 | mon1 | Monday 06 July 2026  02:36:17 +0000 (0:00:01.125)       0:00:09.900 ***********
2026-07-06 02:36:17.928146 | mon1 | ok: [mon1]
2026-07-06 02:36:17.928194 | mon1 |
2026-07-06 02:36:17.928205 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-07-06 02:36:17.928216 | mon1 | Monday 06 July 2026  02:36:17 +0000 (0:00:00.689)       0:00:10.589 ***********
2026-07-06 02:36:17.928226 | mon1 |
2026-07-06 02:36:17.928253 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-07-06 02:36:17.928263 | mon1 | Monday 06 July 2026  02:36:17 +0000 (0:00:00.007)       0:00:10.596 ***********
2026-07-06 02:36:18.600523 | mon1 | ok: [mon1]
2026-07-06 02:36:18.600580 | mon1 |
2026-07-06 02:36:18.600935 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:36:18.600976 | mon1 | Monday 06 July 2026  02:36:18 +0000 (0:00:00.673)       0:00:11.270 ***********
2026-07-06 02:36:18.852826 | mon1 | ok: [mon1]
2026-07-06 02:36:18.852889 | mon1 |
2026-07-06 02:36:18.853116 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:36:18.853143 | mon1 | Monday 06 July 2026  02:36:18 +0000 (0:00:00.253)       0:00:11.523 ***********
2026-07-06 02:36:18.925792 | mon1 | ok: [mon1] => {
2026-07-06 02:36:18.925835 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-07-06 02:36:18.925841 | mon1 | }
2026-07-06 02:36:18.925848 | mon1 |
2026-07-06 02:36:18.925854 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:36:18.925860 | mon1 | Monday 06 July 2026  02:36:18 +0000 (0:00:00.072)       0:00:11.595 ***********
2026-07-06 02:36:19.356889 | mon1 | ok: [mon1]
2026-07-06 02:36:19.356933 | mon1 |
2026-07-06 02:36:19.356943 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:36:19.356953 | mon1 | Monday 06 July 2026  02:36:19 +0000 (0:00:00.430)       0:00:12.026 ***********
2026-07-06 02:36:23.634848 | mon1 | ok: [mon1]
2026-07-06 02:36:23.635119 | mon1 |
2026-07-06 02:36:23.635130 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-07-06 02:36:23.635216 | mon1 | Monday 06 July 2026  02:36:23 +0000 (0:00:04.278)       0:00:16.305 ***********
2026-07-06 02:36:24.545500 | mon1 | ok: [mon1]
2026-07-06 02:36:24.546410 | mon1 |
2026-07-06 02:36:24.546451 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-07-06 02:36:24.546463 | mon1 | Monday 06 July 2026  02:36:24 +0000 (0:00:00.910)       0:00:17.215 ***********
2026-07-06 02:36:24.882765 | mon1 | ok: [mon1]
2026-07-06 02:36:24.882870 | mon1 |
2026-07-06 02:36:24.882953 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-07-06 02:36:24.883108 | mon1 | Monday 06 July 2026  02:36:24 +0000 (0:00:00.337)       0:00:17.553 ***********
2026-07-06 02:36:25.465793 | mon1 | ok: [mon1]
2026-07-06 02:36:25.465860 | mon1 |
2026-07-06 02:36:25.465968 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-07-06 02:36:25.466077 | mon1 | Monday 06 July 2026  02:36:25 +0000 (0:00:00.581)       0:00:18.135 ***********
2026-07-06 02:36:26.166329 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-07-06 02:36:26.166406 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-07-06 02:36:26.166412 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-07-06 02:36:26.166416 | mon1 |
2026-07-06 02:36:26.166421 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-07-06 02:36:26.166427 | mon1 | Monday 06 July 2026  02:36:26 +0000 (0:00:00.700)       0:00:18.836 ***********
2026-07-06 02:36:26.736340 | mon1 | ok: [mon1]
2026-07-06 02:36:26.736413 | mon1 |
2026-07-06 02:36:26.736419 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-07-06 02:36:26.736424 | mon1 | Monday 06 July 2026  02:36:26 +0000 (0:00:00.569)       0:00:19.405 ***********
2026-07-06 02:36:27.307202 | mon1 | ok: [mon1]
2026-07-06 02:36:27.309012 | mon1 |
2026-07-06 02:36:27.309043 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-07-06 02:36:27.309055 | mon1 | Monday 06 July 2026  02:36:27 +0000 (0:00:00.557)       0:00:19.963 ***********
2026-07-06 02:36:27.309065 | mon1 |
2026-07-06 02:36:27.309074 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-07-06 02:36:27.309083 | mon1 | Monday 06 July 2026  02:36:27 +0000 (0:00:00.013)       0:00:19.976 ***********
2026-07-06 02:36:27.800081 | mon1 | ok: [mon1]
2026-07-06 02:36:27.800149 | mon1 |
2026-07-06 02:36:27.800162 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-07-06 02:36:27.800173 | mon1 | Monday 06 July 2026  02:36:27 +0000 (0:00:00.492)       0:00:20.469 ***********
2026-07-06 02:36:27.851907 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-07-06 02:36:27.852180 | mon1 |
2026-07-06 02:36:27.852443 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-07-06 02:36:27.852504 | mon1 | Monday 06 July 2026  02:36:27 +0000 (0:00:00.052)       0:00:20.522 ***********
2026-07-06 02:36:28.790514 | mon1 | ok: [mon1]
2026-07-06 02:36:28.790606 | mon1 |
2026-07-06 02:36:28.791013 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-07-06 02:36:28.791064 | mon1 | Monday 06 July 2026  02:36:28 +0000 (0:00:00.938)       0:00:21.460 ***********
2026-07-06 02:36:29.602811 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-07-06 02:36:29.602878 | mon1 | ok: [mon1] => (item=ssh)
2026-07-06 02:36:29.602966 | mon1 |
2026-07-06 02:36:29.603073 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-07-06 02:36:29.603175 | mon1 | Monday 06 July 2026  02:36:29 +0000 (0:00:00.813)       0:00:22.273 ***********
2026-07-06 02:36:29.994483 | mon1 | ok: [mon1]
2026-07-06 02:36:29.994545 | mon1 |
2026-07-06 02:36:29.994556 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-07-06 02:36:29.994566 | mon1 | Monday 06 July 2026  02:36:29 +0000 (0:00:00.388)       0:00:22.662 ***********
2026-07-06 02:36:30.245354 | mon1 | ok: [mon1]
2026-07-06 02:36:30.245413 | mon1 |
2026-07-06 02:36:30.245420 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-07-06 02:36:30.245426 | mon1 | Monday 06 July 2026  02:36:30 +0000 (0:00:00.252)       0:00:22.915 ***********
2026-07-06 02:36:30.700440 | mon1 | ok: [mon1]
2026-07-06 02:36:30.700481 | mon1 |
2026-07-06 02:36:30.700488 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-07-06 02:36:30.700495 | mon1 | Monday 06 July 2026  02:36:30 +0000 (0:00:00.455)       0:00:23.370 ***********
2026-07-06 02:36:31.107811 | mon1 | ok: [mon1]
2026-07-06 02:36:31.107883 | mon1 |
2026-07-06 02:36:31.107964 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-07-06 02:36:31.108078 | mon1 | Monday 06 July 2026  02:36:31 +0000 (0:00:00.407)       0:00:23.778 ***********
2026-07-06 02:36:31.236920 | mon1 | ok: [mon1]
2026-07-06 02:36:31.236983 | mon1 |
2026-07-06 02:36:31.236994 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-07-06 02:36:31.237004 | mon1 | Monday 06 July 2026  02:36:31 +0000 (0:00:00.128)       0:00:23.906 ***********
2026-07-06 02:36:31.532922 | mon1 | ok: [mon1] => (item=mon1)
2026-07-06 02:36:31.532977 | mon1 |
2026-07-06 02:36:31.532988 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-07-06 02:36:31.532997 | mon1 | Monday 06 July 2026  02:36:31 +0000 (0:00:00.296)       0:00:24.202 ***********
2026-07-06 02:36:31.585526 | mon1 | ok: [mon1]
2026-07-06 02:36:31.585570 | mon1 |
2026-07-06 02:36:31.585576 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-07-06 02:36:31.585749 | mon1 | Monday 06 July 2026  02:36:31 +0000 (0:00:00.052)       0:00:24.255 ***********
2026-07-06 02:36:31.627614 | mon1 | skipping: [mon1]
2026-07-06 02:36:31.627662 | mon1 |
2026-07-06 02:36:31.627669 | mon1 | TASK [Install Ceph host] *******************************************************
2026-07-06 02:36:31.627675 | mon1 | Monday 06 July 2026  02:36:31 +0000 (0:00:00.041)       0:00:24.297 ***********
2026-07-06 02:36:31.702506 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-07-06 02:36:31.702612 | mon1 |
2026-07-06 02:36:31.702624 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-07-06 02:36:31.702643 | mon1 | Monday 06 July 2026  02:36:31 +0000 (0:00:00.075)       0:00:24.373 ***********
2026-07-06 02:36:39.307659 | mon1 | ok: [mon1]
2026-07-06 02:36:39.307847 | mon1 |
2026-07-06 02:36:39.308123 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-07-06 02:36:39.308495 | mon1 | Monday 06 July 2026  02:36:39 +0000 (0:00:07.604)       0:00:31.977 ***********
2026-07-06 02:36:39.363305 | mon1 | ok: [mon1] => (item=mon1)
2026-07-06 02:36:39.363385 | mon1 |
2026-07-06 02:36:39.363397 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-07-06 02:36:39.363405 | mon1 | Monday 06 July 2026  02:36:39 +0000 (0:00:00.055)       0:00:32.033 ***********
2026-07-06 02:36:39.779037 | mon1 | ok: [mon1]
2026-07-06 02:36:39.779155 | mon1 |
2026-07-06 02:36:39.779394 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-07-06 02:36:39.779648 | mon1 | Monday 06 July 2026  02:36:39 +0000 (0:00:00.415)       0:00:32.448 ***********
2026-07-06 02:36:46.878228 | mon1 | ok: [mon1]
2026-07-06 02:36:46.878298 | mon1 |
2026-07-06 02:36:46.878312 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-07-06 02:36:46.878325 | mon1 | Monday 06 July 2026  02:36:46 +0000 (0:00:07.098)       0:00:39.547 ***********
2026-07-06 02:36:53.969974 | mon1 | ok: [mon1]
2026-07-06 02:36:53.970046 | mon1 |
2026-07-06 02:36:53.970060 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-07-06 02:36:53.970096 | mon1 | Monday 06 July 2026  02:36:53 +0000 (0:00:07.091)       0:00:46.639 ***********
2026-07-06 02:37:08.421953 | mon1 | ok: [mon1]
2026-07-06 02:37:08.422014 | mon1 |
2026-07-06 02:37:08.422028 | mon1 | TASK [Install Ceph host] *******************************************************
2026-07-06 02:37:08.422040 | mon1 | Monday 06 July 2026  02:37:08 +0000 (0:00:14.452)       0:01:01.091 ***********
2026-07-06 02:37:08.494743 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-07-06 02:37:08.494782 | mon1 |
2026-07-06 02:37:08.494796 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-07-06 02:37:08.494808 | mon1 | Monday 06 July 2026  02:37:08 +0000 (0:00:00.072)       0:01:01.164 ***********
2026-07-06 02:37:08.546018 | mon1 | skipping: [mon1]
2026-07-06 02:37:08.546071 | mon1 |
2026-07-06 02:37:08.546085 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-07-06 02:37:08.546097 | mon1 | Monday 06 July 2026  02:37:08 +0000 (0:00:00.050)       0:01:01.215 ***********
2026-07-06 02:37:08.596974 | mon1 | skipping: [mon1] => (item=mon1)
2026-07-06 02:37:08.597019 | mon1 | skipping: [mon1]
2026-07-06 02:37:08.597038 | mon1 |
2026-07-06 02:37:08.597788 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-07-06 02:37:08.597861 | mon1 | Monday 06 July 2026  02:37:08 +0000 (0:00:00.051)       0:01:01.266 ***********
2026-07-06 02:37:08.919935 | mon1 | ok: [mon1]
2026-07-06 02:37:08.919997 | mon1 |
2026-07-06 02:37:08.920010 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-07-06 02:37:08.920023 | mon1 | Monday 06 July 2026  02:37:08 +0000 (0:00:00.323)       0:01:01.589 ***********
2026-07-06 02:37:15.828153 | mon1 | ok: [mon1]
2026-07-06 02:37:15.828201 | mon1 |
2026-07-06 02:37:15.828209 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-07-06 02:37:15.828215 | mon1 | Monday 06 July 2026  02:37:15 +0000 (0:00:06.905)       0:01:08.495 ***********
2026-07-06 02:37:22.087930 | mon1 | ok: [mon1]
2026-07-06 02:37:22.087985 | mon1 |
2026-07-06 02:37:22.087999 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-07-06 02:37:22.088011 | mon1 | Monday 06 July 2026  02:37:22 +0000 (0:00:06.261)       0:01:14.757 ***********
2026-07-06 02:37:28.551907 | mon1 | ok: [mon1]
2026-07-06 02:37:28.551980 | mon1 |
2026-07-06 02:37:28.551994 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-07-06 02:37:28.552007 | mon1 | Monday 06 July 2026  02:37:28 +0000 (0:00:06.464)       0:01:21.221 ***********
2026-07-06 02:37:33.818575 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'})
2026-07-06 02:37:33.818656 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-07-06 02:37:33.818671 | mon1 | ok: [mon1] => (item={'name': 'prometheus'})
2026-07-06 02:37:33.818682 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-07-06 02:37:33.818701 | mon1 |
2026-07-06 02:37:33.818861 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-07-06 02:37:33.819085 | mon1 |
2026-07-06 02:37:33.819343 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-06 02:37:33.819736 | mon1 | Monday 06 July 2026  02:37:33 +0000 (0:00:05.267)       0:01:26.488 ***********
2026-07-06 02:37:35.119298 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-07-06 02:37:35.119348 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-07-06 02:37:35.119356 | mon1 | interpreter could change the meaning of that path. See
2026-07-06 02:37:35.119385 | mon1 | https://docs.ansible.com/ansible-
2026-07-06 02:37:35.119393 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-06 02:37:35.131209 | mon1 | ok: [osd1]
2026-07-06 02:37:35.131265 | mon1 |
2026-07-06 02:37:35.131272 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:37:35.131278 | mon1 | Monday 06 July 2026  02:37:35 +0000 (0:00:01.312)       0:01:27.801 ***********
2026-07-06 02:37:35.378007 | mon1 | ok: [osd1]
2026-07-06 02:37:35.378066 | mon1 |
2026-07-06 02:37:35.378080 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:37:35.378111 | mon1 | Monday 06 July 2026  02:37:35 +0000 (0:00:00.245)       0:01:28.047 ***********
2026-07-06 02:37:35.419062 | mon1 | skipping: [osd1]
2026-07-06 02:37:35.419122 | mon1 |
2026-07-06 02:37:35.419132 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-07-06 02:37:35.419142 | mon1 | Monday 06 July 2026  02:37:35 +0000 (0:00:00.040)       0:01:28.088 ***********
2026-07-06 02:37:35.677946 | mon1 | ok: [osd1]
2026-07-06 02:37:35.677998 | mon1 |
2026-07-06 02:37:35.678008 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:37:35.678018 | mon1 | Monday 06 July 2026  02:37:35 +0000 (0:00:00.259)       0:01:28.347 ***********
2026-07-06 02:37:35.749128 | mon1 | ok: [osd1] => {
2026-07-06 02:37:35.749161 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-07-06 02:37:35.749171 | mon1 | }
2026-07-06 02:37:35.749180 | mon1 |
2026-07-06 02:37:35.749189 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:37:35.749198 | mon1 | Monday 06 July 2026  02:37:35 +0000 (0:00:00.071)       0:01:28.419 ***********
2026-07-06 02:37:36.144848 | mon1 | ok: [osd1]
2026-07-06 02:37:36.144896 | mon1 |
2026-07-06 02:37:36.144907 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:37:36.144916 | mon1 | Monday 06 July 2026  02:37:36 +0000 (0:00:00.395)       0:01:28.814 ***********
2026-07-06 02:37:36.190885 | mon1 | skipping: [osd1]
2026-07-06 02:37:36.190937 | mon1 |
2026-07-06 02:37:36.190948 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:37:36.190957 | mon1 | Monday 06 July 2026  02:37:36 +0000 (0:00:00.046)       0:01:28.861 ***********
2026-07-06 02:37:36.234482 | mon1 | skipping: [osd1]
2026-07-06 02:37:36.234517 | mon1 |
2026-07-06 02:37:36.234527 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:37:36.234718 | mon1 | Monday 06 July 2026  02:37:36 +0000 (0:00:00.043)       0:01:28.904 ***********
2026-07-06 02:37:36.478741 | mon1 | ok: [osd1]
2026-07-06 02:37:36.478790 | mon1 |
2026-07-06 02:37:36.478951 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:37:36.479061 | mon1 | Monday 06 July 2026  02:37:36 +0000 (0:00:00.244)       0:01:29.149 ***********
2026-07-06 02:37:37.378193 | mon1 | ok: [osd1]
2026-07-06 02:37:37.378395 | mon1 |
2026-07-06 02:37:37.378665 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:37:37.378908 | mon1 | Monday 06 July 2026  02:37:37 +0000 (0:00:00.899)       0:01:30.048 ***********
2026-07-06 02:37:37.567650 | mon1 | ok: [osd1] => {
2026-07-06 02:37:37.567893 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-07-06 02:37:37.568131 | mon1 | }
2026-07-06 02:37:37.568341 | mon1 |
2026-07-06 02:37:37.568626 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:37:37.568876 | mon1 | Monday 06 July 2026  02:37:37 +0000 (0:00:00.189)       0:01:30.238 ***********
2026-07-06 02:37:38.129342 | mon1 | ok: [osd1]
2026-07-06 02:37:38.129637 | mon1 |
2026-07-06 02:37:38.129895 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:37:38.130147 | mon1 | Monday 06 July 2026  02:37:38 +0000 (0:00:00.561)       0:01:30.800 ***********
2026-07-06 02:37:40.345268 | mon1 | ok: [osd1]
2026-07-06 02:37:40.345323 | mon1 |
2026-07-06 02:37:40.345330 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-07-06 02:37:40.345336 | mon1 | Monday 06 July 2026  02:37:40 +0000 (0:00:02.215)       0:01:33.015 ***********
2026-07-06 02:37:40.380719 | mon1 | skipping: [osd1]
2026-07-06 02:37:40.380756 | mon1 |
2026-07-06 02:37:40.380769 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-07-06 02:37:40.380781 | mon1 | Monday 06 July 2026  02:37:40 +0000 (0:00:00.035)       0:01:33.051 ***********
2026-07-06 02:37:40.415497 | mon1 | skipping: [osd1]
2026-07-06 02:37:40.415540 | mon1 |
2026-07-06 02:37:40.415561 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-07-06 02:37:40.415698 | mon1 | Monday 06 July 2026  02:37:40 +0000 (0:00:00.033)       0:01:33.085 ***********
2026-07-06 02:37:40.449675 | mon1 | skipping: [osd1]
2026-07-06 02:37:40.449720 | mon1 |
2026-07-06 02:37:40.449866 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-07-06 02:37:40.449964 | mon1 | Monday 06 July 2026  02:37:40 +0000 (0:00:00.035)       0:01:33.120 ***********
2026-07-06 02:37:41.360937 | mon1 | ok: [osd1]
2026-07-06 02:37:41.360987 | mon1 |
2026-07-06 02:37:41.360999 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-07-06 02:37:41.361009 | mon1 | Monday 06 July 2026  02:37:41 +0000 (0:00:00.909)       0:01:34.030 ***********
2026-07-06 02:37:41.890274 | mon1 | ok: [osd1]
2026-07-06 02:37:41.890305 | mon1 |
2026-07-06 02:37:41.890310 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-07-06 02:37:41.890314 | mon1 | Monday 06 July 2026  02:37:41 +0000 (0:00:00.529)       0:01:34.560 ***********
2026-07-06 02:37:43.009607 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'})
2026-07-06 02:37:43.009640 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-07-06 02:37:43.009645 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-07-06 02:37:43.009649 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-07-06 02:37:43.009653 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-07-06 02:37:43.009657 | mon1 |
2026-07-06 02:37:43.009661 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-07-06 02:37:43.009665 | mon1 | Monday 06 July 2026  02:37:43 +0000 (0:00:01.118)       0:01:35.679 ***********
2026-07-06 02:37:43.684049 | mon1 | ok: [osd1]
2026-07-06 02:37:43.684102 | mon1 |
2026-07-06 02:37:43.684109 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-07-06 02:37:43.684116 | mon1 | Monday 06 July 2026  02:37:43 +0000 (0:00:00.668)       0:01:36.347 ***********
2026-07-06 02:37:43.684122 | mon1 |
2026-07-06 02:37:43.684128 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-07-06 02:37:43.684133 | mon1 | Monday 06 July 2026  02:37:43 +0000 (0:00:00.005)       0:01:36.353 ***********
2026-07-06 02:37:44.132196 | mon1 | ok: [osd1]
2026-07-06 02:37:44.132227 | mon1 |
2026-07-06 02:37:44.132232 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:37:44.132237 | mon1 | Monday 06 July 2026  02:37:44 +0000 (0:00:00.449)       0:01:36.802 ***********
2026-07-06 02:37:44.388806 | mon1 | ok: [osd1]
2026-07-06 02:37:44.388854 | mon1 |
2026-07-06 02:37:44.388865 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:37:44.388874 | mon1 | Monday 06 July 2026  02:37:44 +0000 (0:00:00.256)       0:01:37.059 ***********
2026-07-06 02:37:44.465298 | mon1 | ok: [osd1] => {
2026-07-06 02:37:44.465339 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-07-06 02:37:44.465349 | mon1 | }
2026-07-06 02:37:44.465399 | mon1 |
2026-07-06 02:37:44.465419 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:37:44.465431 | mon1 | Monday 06 July 2026  02:37:44 +0000 (0:00:00.075)       0:01:37.134 ***********
2026-07-06 02:37:44.889767 | mon1 | ok: [osd1]
2026-07-06 02:37:44.889810 | mon1 |
2026-07-06 02:37:44.889820 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:37:44.889830 | mon1 | Monday 06 July 2026  02:37:44 +0000 (0:00:00.424)       0:01:37.559 ***********
2026-07-06 02:37:48.229843 | mon1 | ok: [osd1]
2026-07-06 02:37:48.229903 | mon1 |
2026-07-06 02:37:48.229917 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-07-06 02:37:48.229930 | mon1 | Monday 06 July 2026  02:37:48 +0000 (0:00:03.340)       0:01:40.899 ***********
2026-07-06 02:37:49.130876 | mon1 | ok: [osd1]
2026-07-06 02:37:49.130936 | mon1 |
2026-07-06 02:37:49.130974 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-07-06 02:37:49.130984 | mon1 | Monday 06 July 2026  02:37:49 +0000 (0:00:00.900)       0:01:41.800 ***********
2026-07-06 02:37:49.366046 | mon1 | ok: [osd1]
2026-07-06 02:37:49.366102 | mon1 |
2026-07-06 02:37:49.366113 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-07-06 02:37:49.366148 | mon1 | Monday 06 July 2026  02:37:49 +0000 (0:00:00.234)       0:01:42.035 ***********
2026-07-06 02:37:49.913214 | mon1 | ok: [osd1]
2026-07-06 02:37:49.913267 | mon1 |
2026-07-06 02:37:49.913279 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-07-06 02:37:49.913290 | mon1 | Monday 06 July 2026  02:37:49 +0000 (0:00:00.547)       0:01:42.582 ***********
2026-07-06 02:37:50.604284 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'})
2026-07-06 02:37:50.604355 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-07-06 02:37:50.604404 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-07-06 02:37:50.604415 | mon1 |
2026-07-06 02:37:50.604424 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-07-06 02:37:50.604434 | mon1 | Monday 06 July 2026  02:37:50 +0000 (0:00:00.690)       0:01:43.273 ***********
2026-07-06 02:37:51.130318 | mon1 | ok: [osd1]
2026-07-06 02:37:51.130426 | mon1 |
2026-07-06 02:37:51.130453 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-07-06 02:37:51.130464 | mon1 | Monday 06 July 2026  02:37:51 +0000 (0:00:00.526)       0:01:43.799 ***********
2026-07-06 02:37:51.665900 | mon1 | ok: [osd1]
2026-07-06 02:37:51.665948 | mon1 |
2026-07-06 02:37:51.665956 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-07-06 02:37:51.665963 | mon1 | Monday 06 July 2026  02:37:51 +0000 (0:00:00.529)       0:01:44.329 ***********
2026-07-06 02:37:51.665970 | mon1 |
2026-07-06 02:37:51.665975 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-07-06 02:37:51.665982 | mon1 | Monday 06 July 2026  02:37:51 +0000 (0:00:00.006)       0:01:44.335 ***********
2026-07-06 02:37:52.128922 | mon1 | ok: [osd1]
2026-07-06 02:37:52.128980 | mon1 |
2026-07-06 02:37:52.128990 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-07-06 02:37:52.129001 | mon1 | Monday 06 July 2026  02:37:52 +0000 (0:00:00.463)       0:01:44.798 ***********
2026-07-06 02:37:52.182317 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-07-06 02:37:52.182351 | mon1 |
2026-07-06 02:37:52.182394 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-07-06 02:37:52.182408 | mon1 | Monday 06 July 2026  02:37:52 +0000 (0:00:00.054)       0:01:44.853 ***********
2026-07-06 02:37:53.067414 | mon1 | ok: [osd1]
2026-07-06 02:37:53.067450 | mon1 |
2026-07-06 02:37:53.067457 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-07-06 02:37:53.067463 | mon1 | Monday 06 July 2026  02:37:53 +0000 (0:00:00.884)       0:01:45.737 ***********
2026-07-06 02:37:53.878794 | mon1 | ok: [osd1] => (item=systemd-timesyncd)
2026-07-06 02:37:53.878863 | mon1 | ok: [osd1] => (item=ssh)
2026-07-06 02:37:53.878970 | mon1 |
2026-07-06 02:37:53.879087 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-07-06 02:37:53.879214 | mon1 | Monday 06 July 2026  02:37:53 +0000 (0:00:00.811)       0:01:46.548 ***********
2026-07-06 02:37:54.276922 | mon1 | ok: [osd1]
2026-07-06 02:37:54.276984 | mon1 |
2026-07-06 02:37:54.276998 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-07-06 02:37:54.277011 | mon1 | Monday 06 July 2026  02:37:54 +0000 (0:00:00.397)       0:01:46.946 ***********
2026-07-06 02:37:54.522023 | mon1 | ok: [osd1]
2026-07-06 02:37:54.522074 | mon1 |
2026-07-06 02:37:54.522089 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-07-06 02:37:54.522103 | mon1 | Monday 06 July 2026  02:37:54 +0000 (0:00:00.244)       0:01:47.191 ***********
2026-07-06 02:37:54.831788 | mon1 | ok: [osd1]
2026-07-06 02:37:54.831887 | mon1 |
2026-07-06 02:37:54.831965 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-07-06 02:37:54.832088 | mon1 | Monday 06 July 2026  02:37:54 +0000 (0:00:00.308)       0:01:47.499 ***********
2026-07-06 02:37:55.078912 | mon1 | ok: [osd1]
2026-07-06 02:37:55.078970 | mon1 |
2026-07-06 02:37:55.079081 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-07-06 02:37:55.079196 | mon1 | Monday 06 July 2026  02:37:55 +0000 (0:00:00.250)       0:01:47.750 ***********
2026-07-06 02:37:55.373454 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-07-06 02:37:55.373905 | mon1 |
2026-07-06 02:37:55.373936 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-07-06 02:37:55.373942 | mon1 | Monday 06 July 2026  02:37:55 +0000 (0:00:00.294)       0:01:48.044 ***********
2026-07-06 02:37:55.429422 | mon1 | ok: [osd1]
2026-07-06 02:37:55.429454 | mon1 |
2026-07-06 02:37:55.429459 | mon1 | TASK [Install Ceph host] *******************************************************
2026-07-06 02:37:55.429468 | mon1 | Monday 06 July 2026  02:37:55 +0000 (0:00:00.053)       0:01:48.098 ***********
2026-07-06 02:37:55.496473 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-07-06 02:37:55.496527 | mon1 |
2026-07-06 02:37:55.496885 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-07-06 02:37:55.496918 | mon1 | Monday 06 July 2026  02:37:55 +0000 (0:00:00.068)       0:01:48.166 ***********
2026-07-06 02:38:01.792945 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:38:01.793050 | mon1 |
2026-07-06 02:38:01.793327 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-07-06 02:38:01.793343 | mon1 | Monday 06 July 2026  02:38:01 +0000 (0:00:06.295)       0:01:54.462 ***********
2026-07-06 02:38:01.848711 | mon1 | ok: [osd1] => (item=osd1)
2026-07-06 02:38:01.848917 | mon1 |
2026-07-06 02:38:01.849217 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-07-06 02:38:01.849236 | mon1 | Monday 06 July 2026  02:38:01 +0000 (0:00:00.057)       0:01:54.519 ***********
2026-07-06 02:38:02.177542 | mon1 | ok: [osd1]
2026-07-06 02:38:02.177597 | mon1 |
2026-07-06 02:38:02.177611 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-07-06 02:38:02.177624 | mon1 | Monday 06 July 2026  02:38:02 +0000 (0:00:00.327)       0:01:54.847 ***********
2026-07-06 02:38:09.025497 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:38:09.025557 | mon1 |
2026-07-06 02:38:09.026045 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-07-06 02:38:09.026099 | mon1 | Monday 06 July 2026  02:38:09 +0000 (0:00:06.848)       0:02:01.695 ***********
2026-07-06 02:38:14.643505 | mon1 | ok: [osd1]
2026-07-06 02:38:14.643577 | mon1 |
2026-07-06 02:38:14.644136 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-07-06 02:38:14.644198 | mon1 | Monday 06 July 2026  02:38:14 +0000 (0:00:05.617)       0:02:07.313 ***********
2026-07-06 02:38:37.098130 | mon1 | ok: [osd1]
2026-07-06 02:38:37.098211 | mon1 |
2026-07-06 02:38:37.098224 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-07-06 02:38:37.098237 | mon1 | Monday 06 July 2026  02:38:37 +0000 (0:00:22.454)       0:02:29.768 ***********
2026-07-06 02:38:37.167529 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data)
2026-07-06 02:38:37.167590 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data)
2026-07-06 02:38:37.167610 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data)
2026-07-06 02:38:37.168642 | mon1 | skipping: [osd1]
2026-07-06 02:38:37.168706 | mon1 |
2026-07-06 02:38:37.168720 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-07-06 02:38:37.168732 | mon1 | Monday 06 July 2026  02:38:37 +0000 (0:00:00.069)       0:02:29.837 ***********
2026-07-06 02:38:43.603875 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:38:43.603938 | mon1 |
2026-07-06 02:38:43.603952 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-07-06 02:38:43.603965 | mon1 | Monday 06 July 2026  02:38:43 +0000 (0:00:06.436)       0:02:36.274 ***********
2026-07-06 02:38:50.056477 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:38:50.056547 | mon1 |
2026-07-06 02:38:50.056791 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-07-06 02:38:50.056825 | mon1 | Monday 06 July 2026  02:38:50 +0000 (0:00:06.451)       0:02:42.725 ***********
2026-07-06 02:38:50.119072 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-07-06 02:38:50.119105 | mon1 |
2026-07-06 02:38:50.119112 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-07-06 02:38:50.119118 | mon1 | Monday 06 July 2026  02:38:50 +0000 (0:00:00.063)       0:02:42.789 ***********
2026-07-06 02:38:50.164286 | mon1 | ok: [osd1]
2026-07-06 02:38:50.164323 | mon1 |
2026-07-06 02:38:50.164332 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-07-06 02:38:50.164340 | mon1 | Monday 06 July 2026  02:38:50 +0000 (0:00:00.045)       0:02:42.834 ***********
2026-07-06 02:38:56.463854 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:38:56.467269 | mon1 |
2026-07-06 02:38:56.467298 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-07-06 02:38:56.467311 | mon1 | Monday 06 July 2026  02:38:56 +0000 (0:00:06.299)       0:02:49.134 ***********
2026-07-06 02:38:56.514024 | mon1 | ok: [osd1]
2026-07-06 02:38:56.514075 | mon1 |
2026-07-06 02:38:56.514089 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-07-06 02:38:56.514101 | mon1 | Monday 06 July 2026  02:38:56 +0000 (0:00:00.048)       0:02:49.183 ***********
2026-07-06 02:38:56.550511 | mon1 | skipping: [osd1] => (item=1)
2026-07-06 02:38:56.550568 | mon1 | skipping: [osd1] => (item=1)
2026-07-06 02:38:56.550581 | mon1 | skipping: [osd1] => (item=1)
2026-07-06 02:38:56.550592 | mon1 | skipping: [osd1]
2026-07-06 02:38:56.550604 | mon1 |
2026-07-06 02:38:56.550616 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-07-06 02:38:56.550635 | mon1 | Monday 06 July 2026  02:38:56 +0000 (0:00:00.036)       0:02:49.219 ***********
2026-07-06 02:38:56.625631 | mon1 | skipping: [osd1]
2026-07-06 02:38:56.625856 | mon1 |
2026-07-06 02:38:56.626104 | mon1 | PLAY [Deploy Ceph exporters] ***************************************************
2026-07-06 02:38:56.626324 | mon1 |
2026-07-06 02:38:56.626602 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-06 02:38:56.626849 | mon1 | Monday 06 July 2026  02:38:56 +0000 (0:00:00.077)       0:02:49.296 ***********
2026-07-06 02:38:57.569330 | mon1 | ok: [mon1]
2026-07-06 02:38:57.569656 | mon1 |
2026-07-06 02:38:57.570021 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:38:57.570276 | mon1 | Monday 06 July 2026  02:38:57 +0000 (0:00:00.943)       0:02:50.240 ***********
2026-07-06 02:38:57.812520 | mon1 | ok: [mon1]
2026-07-06 02:38:57.812576 | mon1 |
2026-07-06 02:38:57.812590 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:38:57.812756 | mon1 | Monday 06 July 2026  02:38:57 +0000 (0:00:00.242)       0:02:50.483 ***********
2026-07-06 02:38:57.853093 | mon1 | skipping: [mon1]
2026-07-06 02:38:57.853269 | mon1 |
2026-07-06 02:38:57.853577 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-07-06 02:38:57.853830 | mon1 | Monday 06 July 2026  02:38:57 +0000 (0:00:00.041)       0:02:50.524 ***********
2026-07-06 02:38:58.108162 | mon1 | ok: [mon1]
2026-07-06 02:38:58.108400 | mon1 |
2026-07-06 02:38:58.108706 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:38:58.108956 | mon1 | Monday 06 July 2026  02:38:58 +0000 (0:00:00.254)       0:02:50.779 ***********
2026-07-06 02:38:58.242983 | mon1 | ok: [mon1] => {
2026-07-06 02:38:58.243097 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-07-06 02:38:58.243302 | mon1 | }
2026-07-06 02:38:58.243425 | mon1 |
2026-07-06 02:38:58.243613 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:38:58.243752 | mon1 | Monday 06 July 2026  02:38:58 +0000 (0:00:00.135)       0:02:50.914 ***********
2026-07-06 02:38:58.641527 | mon1 | ok: [mon1]
2026-07-06 02:38:58.641576 | mon1 |
2026-07-06 02:38:58.641593 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:38:58.641838 | mon1 | Monday 06 July 2026  02:38:58 +0000 (0:00:00.397)       0:02:51.311 ***********
2026-07-06 02:38:58.685917 | mon1 | skipping: [mon1]
2026-07-06 02:38:58.685969 | mon1 |
2026-07-06 02:38:58.685980 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:38:58.685989 | mon1 | Monday 06 July 2026  02:38:58 +0000 (0:00:00.043)       0:02:51.355 ***********
2026-07-06 02:38:58.728898 | mon1 | skipping: [mon1]
2026-07-06 02:38:58.728970 | mon1 |
2026-07-06 02:38:58.729121 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:38:58.729235 | mon1 | Monday 06 July 2026  02:38:58 +0000 (0:00:00.044)       0:02:51.399 ***********
2026-07-06 02:38:58.994889 | mon1 | ok: [mon1]
2026-07-06 02:38:58.994937 | mon1 |
2026-07-06 02:38:58.994948 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:38:58.994971 | mon1 | Monday 06 July 2026  02:38:58 +0000 (0:00:00.265)       0:02:51.664 ***********
2026-07-06 02:38:59.899545 | mon1 | ok: [mon1]
2026-07-06 02:38:59.899620 | mon1 |
2026-07-06 02:38:59.900249 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:38:59.900298 | mon1 | Monday 06 July 2026  02:38:59 +0000 (0:00:00.904)       0:02:52.569 ***********
2026-07-06 02:39:00.105551 | mon1 | ok: [mon1] => {
2026-07-06 02:39:00.105659 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-07-06 02:39:00.105670 | mon1 | }
2026-07-06 02:39:00.105680 | mon1 |
2026-07-06 02:39:00.105690 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:39:00.105700 | mon1 | Monday 06 July 2026  02:39:00 +0000 (0:00:00.204)       0:02:52.774 ***********
2026-07-06 02:39:00.649827 | mon1 | ok: [mon1]
2026-07-06 02:39:00.649914 | mon1 |
2026-07-06 02:39:00.649989 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:39:00.650102 | mon1 | Monday 06 July 2026  02:39:00 +0000 (0:00:00.544)       0:02:53.319 ***********
2026-07-06 02:39:02.988664 | mon1 | ok: [mon1]
2026-07-06 02:39:02.988892 | mon1 |
2026-07-06 02:39:02.989143 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-07-06 02:39:02.989459 | mon1 | Monday 06 July 2026  02:39:02 +0000 (0:00:02.339)       0:02:55.658 ***********
2026-07-06 02:39:03.020976 | mon1 | skipping: [mon1]
2026-07-06 02:39:03.021187 | mon1 |
2026-07-06 02:39:03.021491 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-07-06 02:39:03.021748 | mon1 | Monday 06 July 2026  02:39:03 +0000 (0:00:00.033)       0:02:55.691 ***********
2026-07-06 02:39:03.055602 | mon1 | skipping: [mon1]
2026-07-06 02:39:03.055720 | mon1 |
2026-07-06 02:39:03.055894 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-07-06 02:39:03.056089 | mon1 | Monday 06 July 2026  02:39:03 +0000 (0:00:00.035)       0:02:55.726 ***********
2026-07-06 02:39:03.088770 | mon1 | skipping: [mon1]
2026-07-06 02:39:03.088900 | mon1 |
2026-07-06 02:39:03.089071 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-07-06 02:39:03.089237 | mon1 | Monday 06 July 2026  02:39:03 +0000 (0:00:00.033)       0:02:55.759 ***********
2026-07-06 02:39:03.982867 | mon1 | ok: [mon1]
2026-07-06 02:39:03.983117 | mon1 |
2026-07-06 02:39:03.983434 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-07-06 02:39:03.983694 | mon1 | Monday 06 July 2026  02:39:03 +0000 (0:00:00.893)       0:02:56.653 ***********
2026-07-06 02:39:04.532510 | mon1 | ok: [mon1]
2026-07-06 02:39:04.532571 | mon1 |
2026-07-06 02:39:04.532730 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-07-06 02:39:04.533046 | mon1 | Monday 06 July 2026  02:39:04 +0000 (0:00:00.549)       0:02:57.202 ***********
2026-07-06 02:39:05.653145 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-07-06 02:39:05.653260 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-07-06 02:39:05.653471 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-07-06 02:39:05.653648 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-07-06 02:39:05.653818 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-07-06 02:39:05.653961 | mon1 |
2026-07-06 02:39:05.654139 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-07-06 02:39:05.654271 | mon1 | Monday 06 July 2026  02:39:05 +0000 (0:00:01.121)       0:02:58.324 ***********
2026-07-06 02:39:06.304666 | mon1 | ok: [mon1]
2026-07-06 02:39:06.304911 | mon1 |
2026-07-06 02:39:06.305168 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-07-06 02:39:06.305457 | mon1 | Monday 06 July 2026  02:39:06 +0000 (0:00:00.644)       0:02:58.968 ***********
2026-07-06 02:39:06.305689 | mon1 |
2026-07-06 02:39:06.305954 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-07-06 02:39:06.306202 | mon1 | Monday 06 July 2026  02:39:06 +0000 (0:00:00.007)       0:02:58.975 ***********
2026-07-06 02:39:06.762547 | mon1 | ok: [mon1]
2026-07-06 02:39:06.762606 | mon1 |
2026-07-06 02:39:06.762704 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:39:06.762969 | mon1 | Monday 06 July 2026  02:39:06 +0000 (0:00:00.457)       0:02:59.433 ***********
2026-07-06 02:39:07.008224 | mon1 | ok: [mon1]
2026-07-06 02:39:07.008470 | mon1 |
2026-07-06 02:39:07.008722 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:39:07.008964 | mon1 | Monday 06 July 2026  02:39:07 +0000 (0:00:00.246)       0:02:59.679 ***********
2026-07-06 02:39:07.080530 | mon1 | ok: [mon1] => {
2026-07-06 02:39:07.080813 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-07-06 02:39:07.081139 | mon1 | }
2026-07-06 02:39:07.081506 | mon1 |
2026-07-06 02:39:07.081778 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:39:07.082025 | mon1 | Monday 06 July 2026  02:39:07 +0000 (0:00:00.072)       0:02:59.751 ***********
2026-07-06 02:39:07.521907 | mon1 | ok: [mon1]
2026-07-06 02:39:07.522087 | mon1 |
2026-07-06 02:39:07.522306 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:39:07.522570 | mon1 | Monday 06 July 2026  02:39:07 +0000 (0:00:00.441)       0:03:00.192 ***********
2026-07-06 02:39:10.825547 | mon1 | ok: [mon1]
2026-07-06 02:39:10.825608 | mon1 |
2026-07-06 02:39:10.825623 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-07-06 02:39:10.825642 | mon1 | Monday 06 July 2026  02:39:10 +0000 (0:00:03.302)       0:03:03.495 ***********
2026-07-06 02:39:11.809187 | mon1 | ok: [mon1]
2026-07-06 02:39:11.809511 | mon1 |
2026-07-06 02:39:11.809863 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-07-06 02:39:11.810230 | mon1 | Monday 06 July 2026  02:39:11 +0000 (0:00:00.984)       0:03:04.479 ***********
2026-07-06 02:39:12.045340 | mon1 | ok: [mon1]
2026-07-06 02:39:12.045420 | mon1 |
2026-07-06 02:39:12.045438 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-07-06 02:39:12.045451 | mon1 | Monday 06 July 2026  02:39:12 +0000 (0:00:00.235)       0:03:04.715 ***********
2026-07-06 02:39:12.611512 | mon1 | ok: [mon1]
2026-07-06 02:39:12.611562 | mon1 |
2026-07-06 02:39:12.611981 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-07-06 02:39:12.612035 | mon1 | Monday 06 July 2026  02:39:12 +0000 (0:00:00.566)       0:03:05.282 ***********
2026-07-06 02:39:13.270827 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-07-06 02:39:13.270899 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-07-06 02:39:13.271034 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-07-06 02:39:13.271141 | mon1 |
2026-07-06 02:39:13.271264 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-07-06 02:39:13.271412 | mon1 | Monday 06 July 2026  02:39:13 +0000 (0:00:00.659)       0:03:05.941 ***********
2026-07-06 02:39:13.798855 | mon1 | ok: [mon1]
2026-07-06 02:39:13.798914 | mon1 |
2026-07-06 02:39:13.799022 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-07-06 02:39:13.799130 | mon1 | Monday 06 July 2026  02:39:13 +0000 (0:00:00.527)       0:03:06.469 ***********
2026-07-06 02:39:14.353749 | mon1 | ok: [mon1]
2026-07-06 02:39:14.353795 | mon1 |
2026-07-06 02:39:14.353806 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-07-06 02:39:14.353817 | mon1 | Monday 06 July 2026  02:39:14 +0000 (0:00:00.547)       0:03:07.016 ***********
2026-07-06 02:39:14.353826 | mon1 |
2026-07-06 02:39:14.353836 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-07-06 02:39:14.353845 | mon1 | Monday 06 July 2026  02:39:14 +0000 (0:00:00.005)       0:03:07.022 ***********
2026-07-06 02:39:14.797852 | mon1 | ok: [mon1]
2026-07-06 02:39:14.797895 | mon1 |
2026-07-06 02:39:14.797905 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-07-06 02:39:14.797915 | mon1 | Monday 06 July 2026  02:39:14 +0000 (0:00:00.445)       0:03:07.467 ***********
2026-07-06 02:39:14.850696 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-07-06 02:39:14.850731 | mon1 |
2026-07-06 02:39:14.850741 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-07-06 02:39:14.850750 | mon1 | Monday 06 July 2026  02:39:14 +0000 (0:00:00.052)       0:03:07.520 ***********
2026-07-06 02:39:15.735999 | mon1 | ok: [mon1]
2026-07-06 02:39:15.736046 | mon1 |
2026-07-06 02:39:15.736057 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-07-06 02:39:15.736067 | mon1 | Monday 06 July 2026  02:39:15 +0000 (0:00:00.885)       0:03:08.405 ***********
2026-07-06 02:39:16.542564 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-07-06 02:39:16.542635 | mon1 | ok: [mon1] => (item=ssh)
2026-07-06 02:39:16.542649 | mon1 |
2026-07-06 02:39:16.543097 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-07-06 02:39:16.543155 | mon1 | Monday 06 July 2026  02:39:16 +0000 (0:00:00.807)       0:03:09.212 ***********
2026-07-06 02:39:16.910780 | mon1 | ok: [mon1]
2026-07-06 02:39:16.910836 | mon1 |
2026-07-06 02:39:16.910954 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-07-06 02:39:16.911067 | mon1 | Monday 06 July 2026  02:39:16 +0000 (0:00:00.367)       0:03:09.580 ***********
2026-07-06 02:39:17.151962 | mon1 | ok: [mon1]
2026-07-06 02:39:17.152049 | mon1 |
2026-07-06 02:39:17.153536 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-07-06 02:39:17.153843 | mon1 | Monday 06 July 2026  02:39:17 +0000 (0:00:00.241)       0:03:09.822 ***********
2026-07-06 02:39:17.450893 | mon1 | ok: [mon1]
2026-07-06 02:39:17.450948 | mon1 |
2026-07-06 02:39:17.450962 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-07-06 02:39:17.450975 | mon1 | Monday 06 July 2026  02:39:17 +0000 (0:00:00.297)       0:03:10.120 ***********
2026-07-06 02:39:17.688452 | mon1 | ok: [mon1]
2026-07-06 02:39:17.688500 | mon1 |
2026-07-06 02:39:17.688514 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] ***********
2026-07-06 02:39:17.688526 | mon1 | Monday 06 July 2026  02:39:17 +0000 (0:00:00.238)       0:03:10.358 ***********
2026-07-06 02:39:23.959462 | mon1 | ok: [mon1]
2026-07-06 02:39:23.959538 | mon1 |
2026-07-06 02:39:23.959553 | mon1 | PLAY RECAP *********************************************************************
2026-07-06 02:39:23.959567 | mon1 | mon1                       : ok=83   changed=0    unreachable=0    failed=0    skipped=15   rescued=0    ignored=0
2026-07-06 02:39:23.959586 | mon1 | osd1                       : ok=48   changed=0    unreachable=0    failed=0    skipped=9    rescued=0    ignored=0
2026-07-06 02:39:23.959832 | mon1 |
2026-07-06 02:39:23.960061 | mon1 |
2026-07-06 02:39:23.960291 | mon1 | TASKS RECAP ********************************************************************
2026-07-06 02:39:23.960577 | mon1 | Monday 06 July 2026  02:39:23 +0000 (0:00:06.271)       0:03:16.629 ***********
2026-07-06 02:39:23.960841 | mon1 | ===============================================================================
2026-07-06 02:39:23.961097 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.45s
2026-07-06 02:39:23.961351 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.45s
2026-07-06 02:39:23.961657 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 7.60s
2026-07-06 02:39:23.961929 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.10s
2026-07-06 02:39:23.962176 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 7.09s
2026-07-06 02:39:23.962463 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.91s
2026-07-06 02:39:23.962769 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.85s
2026-07-06 02:39:23.963029 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.46s
2026-07-06 02:39:23.963277 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.45s
2026-07-06 02:39:23.963573 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.44s
2026-07-06 02:39:23.963815 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.30s
2026-07-06 02:39:23.964086 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.30s
2026-07-06 02:39:23.964333 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 6.27s
2026-07-06 02:39:23.964676 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.26s
2026-07-06 02:39:23.965002 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.62s
2026-07-06 02:39:23.965277 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 5.27s
2026-07-06 02:39:23.965563 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.28s
2026-07-06 02:39:23.965807 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.34s
2026-07-06 02:39:23.966085 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.30s
2026-07-06 02:39:23.966338 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.44s
2026-07-06 02:39:24.044419 | mon1 | INFO     [default > idempotence] Executed: Successful
2026-07-06 02:39:24.055677 | mon1 | INFO     [default > side_effect] Executing
2026-07-06 02:39:24.056130 | mon1 | WARNING  [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-07-06 02:39:24.062815 | mon1 | INFO     [default > verify] Executing
2026-07-06 02:39:24.797581 | mon1 |
2026-07-06 02:39:24.797841 | mon1 | PLAY [Verify] ******************************************************************
2026-07-06 02:39:24.798034 | mon1 |
2026-07-06 02:39:24.798296 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-06 02:39:24.798587 | mon1 | Monday 06 July 2026  02:39:24 +0000 (0:00:00.007)       0:00:00.007 ***********
2026-07-06 02:39:25.990919 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-07-06 02:39:25.991151 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-07-06 02:39:25.991451 | mon1 | interpreter could change the meaning of that path. See
2026-07-06 02:39:25.991685 | mon1 | https://docs.ansible.com/ansible-
2026-07-06 02:39:25.992012 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-06 02:39:25.998682 | mon1 | ok: [mon1]
2026-07-06 02:39:25.998889 | mon1 |
2026-07-06 02:39:25.999131 | mon1 | TASK [Get cluster health status] ***********************************************
2026-07-06 02:39:25.999524 | mon1 | Monday 06 July 2026  02:39:25 +0000 (0:00:01.201)       0:00:01.209 ***********
2026-07-06 02:39:36.410869 | mon1 | ok: [mon1]
2026-07-06 02:39:36.410988 | mon1 |
2026-07-06 02:39:36.411163 | mon1 | TASK [Print cluster health status] *********************************************
2026-07-06 02:39:36.411324 | mon1 | Monday 06 July 2026  02:39:36 +0000 (0:00:10.411)       0:00:11.621 ***********
2026-07-06 02:39:36.444819 | mon1 | ok: [mon1] => {
2026-07-06 02:39:36.445023 | mon1 |     "_ceph_health": {
2026-07-06 02:39:36.445257 | mon1 |         "changed": false,
2026-07-06 02:39:36.445551 | mon1 |         "cmd": [
2026-07-06 02:39:36.445778 | mon1 |             "cephadm",
2026-07-06 02:39:36.446007 | mon1 |             "shell",
2026-07-06 02:39:36.446231 | mon1 |             "--",
2026-07-06 02:39:36.446491 | mon1 |             "ceph",
2026-07-06 02:39:36.446721 | mon1 |             "health"
2026-07-06 02:39:36.446954 | mon1 |         ],
2026-07-06 02:39:36.447183 | mon1 |         "delta": "0:00:10.083334",
2026-07-06 02:39:36.447453 | mon1 |         "end": "2026-07-06 02:39:36.369558",
2026-07-06 02:39:36.447686 | mon1 |         "failed": false,
2026-07-06 02:39:36.447915 | mon1 |         "msg": "",
2026-07-06 02:39:36.448139 | mon1 |         "rc": 0,
2026-07-06 02:39:36.448391 | mon1 |         "start": "2026-07-06 02:39:26.286224",
2026-07-06 02:39:36.448671 | mon1 |         "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config",
2026-07-06 02:39:36.448903 | mon1 |         "stderr_lines": [
2026-07-06 02:39:36.449149 | mon1 |             "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2",
2026-07-06 02:39:36.449474 | mon1 |             "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config"
2026-07-06 02:39:36.449713 | mon1 |         ],
2026-07-06 02:39:36.449952 | mon1 |         "stdout": "HEALTH_OK",
2026-07-06 02:39:36.450186 | mon1 |         "stdout_lines": [
2026-07-06 02:39:36.450447 | mon1 |             "HEALTH_OK"
2026-07-06 02:39:36.450674 | mon1 |         ]
2026-07-06 02:39:36.450898 | mon1 |     }
2026-07-06 02:39:36.451130 | mon1 | }
2026-07-06 02:39:36.451340 | mon1 |
2026-07-06 02:39:36.451630 | mon1 | TASK [Assert that the cluster status is healthy] *******************************
2026-07-06 02:39:36.451859 | mon1 | Monday 06 July 2026  02:39:36 +0000 (0:00:00.034)       0:00:11.655 ***********
2026-07-06 02:39:36.475667 | mon1 | ok: [mon1] => {
2026-07-06 02:39:36.475883 | mon1 |     "changed": false,
2026-07-06 02:39:36.476132 | mon1 |     "msg": "All assertions passed"
2026-07-06 02:39:36.476378 | mon1 | }
2026-07-06 02:39:36.476634 | mon1 |
2026-07-06 02:39:36.476892 | mon1 | TASK [Create a test Ceph pool] *************************************************
2026-07-06 02:39:36.477146 | mon1 | Monday 06 July 2026  02:39:36 +0000 (0:00:00.030)       0:00:11.686 ***********
2026-07-06 02:39:43.805162 | mon1 | changed: [mon1]
2026-07-06 02:39:43.805400 | mon1 |
2026-07-06 02:39:43.805665 | mon1 | TASK [Create a test Ceph key] **************************************************
2026-07-06 02:39:43.805910 | mon1 | Monday 06 July 2026  02:39:43 +0000 (0:00:07.329)       0:00:19.015 ***********
2026-07-06 02:39:46.550056 | mon1 | changed: [mon1]
2026-07-06 02:39:46.550110 | mon1 |
2026-07-06 02:39:46.550119 | mon1 | TASK [Retrieve info for the test Ceph key] *************************************
2026-07-06 02:39:46.550127 | mon1 | Monday 06 July 2026  02:39:46 +0000 (0:00:02.744)       0:00:21.760 ***********
2026-07-06 02:39:47.746469 | mon1 | ok: [mon1]
2026-07-06 02:39:47.746538 | mon1 |
2026-07-06 02:39:47.746554 | mon1 | TASK [Assert that key_info returns the correct key] ****************************
2026-07-06 02:39:47.746664 | mon1 | Monday 06 July 2026  02:39:47 +0000 (0:00:01.196)       0:00:22.956 ***********
2026-07-06 02:39:47.792318 | mon1 | ok: [mon1] => {
2026-07-06 02:39:47.792391 | mon1 |     "changed": false,
2026-07-06 02:39:47.792408 | mon1 |     "msg": "All assertions passed"
2026-07-06 02:39:47.792421 | mon1 | }
2026-07-06 02:39:47.792433 | mon1 |
2026-07-06 02:39:47.792445 | mon1 | TASK [Retrieve info for the test Ceph key using the legacy key module] *********
2026-07-06 02:39:47.792457 | mon1 | Monday 06 July 2026  02:39:47 +0000 (0:00:00.044)       0:00:23.000 ***********
2026-07-06 02:39:49.172945 | mon1 | ok: [mon1]
2026-07-06 02:39:49.173012 | mon1 |
2026-07-06 02:39:49.173028 | mon1 | TASK [Assert that the legacy key module info state returns the correct key] ****
2026-07-06 02:39:49.173041 | mon1 | Monday 06 July 2026  02:39:49 +0000 (0:00:01.381)       0:00:24.382 ***********
2026-07-06 02:39:49.211424 | mon1 | ok: [mon1] => {
2026-07-06 02:39:49.211508 | mon1 |     "changed": false,
2026-07-06 02:39:49.211520 | mon1 |     "msg": "All assertions passed"
2026-07-06 02:39:49.211529 | mon1 | }
2026-07-06 02:39:49.211539 | mon1 |
2026-07-06 02:39:49.211549 | mon1 | PLAY RECAP *********************************************************************
2026-07-06 02:39:49.211558 | mon1 | mon1                       : ok=10   changed=2    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-07-06 02:39:49.211567 | mon1 |
2026-07-06 02:39:49.211576 | mon1 |
2026-07-06 02:39:49.211584 | mon1 | TASKS RECAP ********************************************************************
2026-07-06 02:39:49.211593 | mon1 | Monday 06 July 2026  02:39:49 +0000 (0:00:00.037)       0:00:24.419 ***********
2026-07-06 02:39:49.211602 | mon1 | ===============================================================================
2026-07-06 02:39:49.212754 | mon1 | Get cluster health status ---------------------------------------------- 10.41s
2026-07-06 02:39:49.213042 | mon1 | Create a test Ceph pool ------------------------------------------------- 7.33s
2026-07-06 02:39:49.213239 | mon1 | Create a test Ceph key -------------------------------------------------- 2.74s
2026-07-06 02:39:49.213455 | mon1 | Retrieve info for the test Ceph key using the legacy key module --------- 1.38s
2026-07-06 02:39:49.213642 | mon1 | Gathering Facts --------------------------------------------------------- 1.20s
2026-07-06 02:39:49.213822 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.20s
2026-07-06 02:39:49.214001 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s
2026-07-06 02:39:49.214182 | mon1 | Assert that the legacy key module info state returns the correct key ---- 0.04s
2026-07-06 02:39:49.214356 | mon1 | Print cluster health status --------------------------------------------- 0.03s
2026-07-06 02:39:49.214572 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.03s
2026-07-06 02:39:49.281316 | mon1 | INFO     [default > verify] Executed: Successful
2026-07-06 02:39:49.293786 | mon1 | INFO     [default > cleanup] Executing
2026-07-06 02:39:49.294224 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-07-06 02:39:49.318230 | mon1 | INFO     [default > destroy] Executing
2026-07-06 02:39:49.318350 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-07-06 02:39:49.318469 | mon1 | INFO     [default > destroy] Executed: Successful
2026-07-06 02:39:49.318738 | mon1 | WARNING  Molecule executed 1 scenario (1 missing files)
2026-07-06 02:39:49.604075 | mon1 | ok: Runtime: 0:16:20.554163
2026-07-06 02:39:49.618709 | 
2026-07-06 02:39:49.618763 | PLAY RECAP
2026-07-06 02:39:49.618805 | mon1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-07-06 02:39:49.618827 | 
2026-07-06 02:39:49.779024 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-07-06 02:39:49.783920 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-07-06 02:39:50.382518 | 
2026-07-06 02:39:50.382654 | PLAY [all]
2026-07-06 02:39:50.394584 | 
2026-07-06 02:39:50.394656 | TASK [fetch-output : Set log path for multiple nodes]
2026-07-06 02:39:50.445913 | mon1 | ok
2026-07-06 02:39:50.450524 | osd1 | ok
2026-07-06 02:39:50.455166 | 
2026-07-06 02:39:50.455237 | TASK [fetch-output : Set log path for single node]
2026-07-06 02:39:50.477186 | mon1 | skipping: Conditional result was False
2026-07-06 02:39:50.488435 | osd1 | skipping: Conditional result was False
2026-07-06 02:39:50.498238 | 
2026-07-06 02:39:50.498330 | LOOP [fetch-output : Ensure local output dirs]
2026-07-06 02:39:50.979265 | osd1 -> localhost | changed: "/var/lib/zuul/builds/3c252cc302b049b2aa606f802c1d5e33/work/logs/osd1"
2026-07-06 02:39:50.985718 | mon1 -> localhost | changed: "/var/lib/zuul/builds/3c252cc302b049b2aa606f802c1d5e33/work/logs/mon1"
2026-07-06 02:39:51.176343 | osd1 -> localhost | changed: "/var/lib/zuul/builds/3c252cc302b049b2aa606f802c1d5e33/work/artifacts"
2026-07-06 02:39:51.185599 | mon1 -> localhost | ok: "/var/lib/zuul/builds/3c252cc302b049b2aa606f802c1d5e33/work/artifacts"
2026-07-06 02:39:51.378824 | mon1 -> localhost | ok: "/var/lib/zuul/builds/3c252cc302b049b2aa606f802c1d5e33/work/docs"
2026-07-06 02:39:51.385319 | osd1 -> localhost | changed: "/var/lib/zuul/builds/3c252cc302b049b2aa606f802c1d5e33/work/docs"
2026-07-06 02:39:51.403489 | 
2026-07-06 02:39:51.403654 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-07-06 02:39:52.037230 | osd1 | changed: .d..t...... ./
2026-07-06 02:39:52.037461 | osd1 | changed: All items complete
2026-07-06 02:39:52.037494 | 
2026-07-06 02:39:52.042412 | mon1 | changed: .d..t...... ./
2026-07-06 02:39:52.479805 | osd1 | changed: .d..t...... ./
2026-07-06 02:39:52.496551 | mon1 | ok
2026-07-06 02:39:52.932571 | osd1 | changed: .d..t...... ./
2026-07-06 02:39:52.967437 | mon1 | ok
2026-07-06 02:39:52.995733 | 
2026-07-06 02:39:52.995912 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-07-06 02:39:53.417716 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007873
2026-07-06 02:39:53.417981 | mon1 -> localhost | changed: All items complete
2026-07-06 02:39:53.418026 | 
2026-07-06 02:39:53.636773 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.008951
2026-07-06 02:39:53.661659 | 
2026-07-06 02:39:53.661803 | PLAY [all]
2026-07-06 02:39:53.668738 | 
2026-07-06 02:39:53.668805 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-07-06 02:39:54.130179 | mon1 | changed
2026-07-06 02:39:54.313639 | osd1 | changed
2026-07-06 02:39:54.325990 | 
2026-07-06 02:39:54.326045 | PLAY RECAP
2026-07-06 02:39:54.326095 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-07-06 02:39:54.326126 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-07-06 02:39:54.326145 | 
2026-07-06 02:39:54.468386 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-07-06 02:39:54.474017 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-07-06 02:39:55.038333 | 
2026-07-06 02:39:55.038464 | PLAY [localhost]
2026-07-06 02:39:55.048213 | 
2026-07-06 02:39:55.048286 | TASK [Generate Zuul manifest]
2026-07-06 02:39:55.070823 | localhost | ok
2026-07-06 02:39:55.086900 | 
2026-07-06 02:39:55.086975 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-07-06 02:39:55.441496 | localhost | changed
2026-07-06 02:39:55.454139 | 
2026-07-06 02:39:55.454216 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-07-06 02:39:55.487054 | localhost | ok
2026-07-06 02:39:55.495657 | 
2026-07-06 02:39:55.495722 | TASK [Upload logs]
2026-07-06 02:39:55.518115 | localhost | ok
2026-07-06 02:39:55.576641 | 
2026-07-06 02:39:55.576779 | TASK [Set zuul-log-path fact]
2026-07-06 02:39:55.599523 | localhost | ok
2026-07-06 02:39:55.612551 | 
2026-07-06 02:39:55.612619 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-07-06 02:39:55.644385 | localhost | ok
2026-07-06 02:39:55.652494 | 
2026-07-06 02:39:55.652554 | TASK [upload-logs : Create log directories]
2026-07-06 02:39:56.050002 | localhost | changed
2026-07-06 02:39:56.057540 | 
2026-07-06 02:39:56.057621 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-07-06 02:39:56.445302 | localhost -> localhost | ok: Runtime: 0:00:00.005159
2026-07-06 02:39:56.452303 | 
2026-07-06 02:39:56.452376 | TASK [upload-logs : Upload logs to log server]
2026-07-06 02:39:56.900641 | localhost | Output suppressed because no_log was given
2026-07-06 02:39:56.906366 | 
2026-07-06 02:39:56.906458 | LOOP [upload-logs : Compress console log and json output]
2026-07-06 02:39:56.993712 | localhost | skipping: Conditional result was False
2026-07-06 02:39:57.000538 | localhost | skipping: Conditional result was False
2026-07-06 02:39:57.014852 | 
2026-07-06 02:39:57.014994 | LOOP [upload-logs : Upload compressed console log and json output]
2026-07-06 02:39:57.091107 | localhost | skipping: Conditional result was False
2026-07-06 02:39:57.091538 | 
2026-07-06 02:39:57.094898 | localhost | skipping: Conditional result was False
2026-07-06 02:39:57.149026 | 
2026-07-06 02:39:57.149181 | LOOP [upload-logs : Upload console log and json output]