2026-08-18 12:55:25.327675 | Job console starting
2026-08-18 12:55:25.360507 | Updating git repos
2026-08-18 12:55:25.390951 | Cloning repos into workspace
2026-08-18 12:55:25.474545 | Restoring repo states
2026-08-18 12:55:25.482510 | Merging changes
2026-08-18 12:55:26.119143 | Checking out repos
2026-08-18 12:55:26.175337 | Preparing playbooks
2026-08-18 12:55:27.741142 | Running Ansible setup
2026-08-18 12:55:34.573152 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-18 12:55:35.266016 | 
2026-08-18 12:55:35.266493 | PLAY [localhost]
2026-08-18 12:55:35.274356 | 
2026-08-18 12:55:35.274436 | TASK [Gathering Facts]
2026-08-18 12:55:36.573494 | localhost | ok
2026-08-18 12:55:36.585016 | 
2026-08-18 12:55:36.585159 | TASK [Setup log path fact]
2026-08-18 12:55:36.604086 | localhost | ok
2026-08-18 12:55:36.618493 | 
2026-08-18 12:55:36.618657 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-18 12:55:36.649695 | localhost | ok
2026-08-18 12:55:36.658441 | 
2026-08-18 12:55:36.658554 | TASK [emit-job-header : Print job information]
2026-08-18 12:55:36.700105 | # Job Information
2026-08-18 12:55:36.700344 | Ansible Version: 2.16.18
2026-08-18 12:55:36.700415 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble
2026-08-18 12:55:36.700464 | Pipeline: check
2026-08-18 12:55:36.700509 | Executor: 2d72f0692154
2026-08-18 12:55:36.700554 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/123
2026-08-18 12:55:36.700606 | Event ID: a98b4580-9b03-11f1-8895-8d0246b08d0b
2026-08-18 12:55:36.706611 | 
2026-08-18 12:55:36.706741 | LOOP [emit-job-header : Print node information]
2026-08-18 12:55:36.855709 | localhost | ok:
2026-08-18 12:55:36.855979 | localhost | # Node Information
2026-08-18 12:55:36.856010 | localhost | Inventory Hostname: node1
2026-08-18 12:55:36.856032 | localhost | Hostname: np0000189980
2026-08-18 12:55:36.856053 | localhost | Username: zuul
2026-08-18 12:55:36.856081 | localhost | Distro: Ubuntu 24.04
2026-08-18 12:55:36.856101 | localhost | Provider: yul1
2026-08-18 12:55:36.856120 | localhost | Region: ca-ymq-1
2026-08-18 12:55:36.856139 | localhost | Label: ubuntu-noble
2026-08-18 12:55:36.856157 | localhost | Product Name: OpenStack Nova
2026-08-18 12:55:36.856175 | localhost | Interface IP: 199.204.45.116
2026-08-18 12:55:36.911611 | localhost | ok:
2026-08-18 12:55:36.911807 | localhost | # Node Information
2026-08-18 12:55:36.911865 | localhost | Inventory Hostname: node2
2026-08-18 12:55:36.911938 | localhost | Hostname: np0000189981
2026-08-18 12:55:36.911983 | localhost | Username: zuul
2026-08-18 12:55:36.912025 | localhost | Distro: Ubuntu 24.04
2026-08-18 12:55:36.912065 | localhost | Provider: yul1
2026-08-18 12:55:36.912105 | localhost | Region: ca-ymq-1
2026-08-18 12:55:36.912145 | localhost | Label: ubuntu-noble
2026-08-18 12:55:36.912185 | localhost | Product Name: OpenStack Nova
2026-08-18 12:55:36.912227 | localhost | Interface IP: 199.204.45.177
2026-08-18 12:55:36.963178 | localhost | ok:
2026-08-18 12:55:36.963295 | localhost | # Node Information
2026-08-18 12:55:36.963348 | localhost | Inventory Hostname: node3
2026-08-18 12:55:36.963392 | localhost | Hostname: np0000189982
2026-08-18 12:55:36.963435 | localhost | Username: zuul
2026-08-18 12:55:36.963477 | localhost | Distro: Ubuntu 24.04
2026-08-18 12:55:36.963518 | localhost | Provider: yul1
2026-08-18 12:55:36.963557 | localhost | Region: ca-ymq-1
2026-08-18 12:55:36.963596 | localhost | Label: ubuntu-noble
2026-08-18 12:55:36.963635 | localhost | Product Name: OpenStack Nova
2026-08-18 12:55:36.963674 | localhost | Interface IP: 199.204.45.77
2026-08-18 12:55:36.972115 | 
2026-08-18 12:55:36.972308 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-08-18 12:55:37.331354 | localhost -> localhost | changed
2026-08-18 12:55:37.341701 | 
2026-08-18 12:55:37.341846 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-08-18 12:55:38.449694 | localhost -> localhost | changed
2026-08-18 12:55:38.474762 | 
2026-08-18 12:55:38.474879 | PLAY [all]
2026-08-18 12:55:38.485841 | 
2026-08-18 12:55:38.485975 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-08-18 12:55:38.718935 | node1 -> localhost | ok
2026-08-18 12:55:38.729761 | 
2026-08-18 12:55:38.729884 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-08-18 12:55:38.769663 | node1 | ok
2026-08-18 12:55:38.832793 | node2 | ok
2026-08-18 12:55:38.837457 | node3 | ok
2026-08-18 12:55:38.862400 | node1 | included: /var/lib/zuul/builds/7a9e062a129446c280273372d57d08af/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-18 12:55:38.862522 | node2 | included: /var/lib/zuul/builds/7a9e062a129446c280273372d57d08af/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-18 12:55:38.862551 | node3 | included: /var/lib/zuul/builds/7a9e062a129446c280273372d57d08af/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-18 12:55:38.873075 | 
2026-08-18 12:55:38.873211 | TASK [add-build-sshkey : Create Temp SSH key]
2026-08-18 12:55:40.752180 | node1 -> localhost | Generating public/private rsa key pair.
2026-08-18 12:55:40.752408 | node1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/7a9e062a129446c280273372d57d08af/work/7a9e062a129446c280273372d57d08af_id_rsa
2026-08-18 12:55:40.752451 | node1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/7a9e062a129446c280273372d57d08af/work/7a9e062a129446c280273372d57d08af_id_rsa.pub
2026-08-18 12:55:40.752484 | node1 -> localhost | The key fingerprint is:
2026-08-18 12:55:40.752515 | node1 -> localhost | SHA256:PRIuuXYKtdsGCHkyzzWCsx+/I4ZtXP/UYhayf9HzNvU zuul-build-sshkey
2026-08-18 12:55:40.752545 | node1 -> localhost | The key's randomart image is:
2026-08-18 12:55:40.752574 | node1 -> localhost | +---[RSA 3072]----+
2026-08-18 12:55:40.752603 | node1 -> localhost | |                 |
2026-08-18 12:55:40.752632 | node1 -> localhost | |                 |
2026-08-18 12:55:40.752661 | node1 -> localhost | |   o    .        |
2026-08-18 12:55:40.752689 | node1 -> localhost | |  B o oo o       |
2026-08-18 12:55:40.752716 | node1 -> localhost | |   X ++.S +  .   |
2026-08-18 12:55:40.752743 | node1 -> localhost | |  . =.o+ + +. o .|
2026-08-18 12:55:40.752770 | node1 -> localhost | |   =.++oo = .. oo|
2026-08-18 12:55:40.752798 | node1 -> localhost | |  . Boo=o= ..  .E|
2026-08-18 12:55:40.752825 | node1 -> localhost | |   o .++..o.   ..|
2026-08-18 12:55:40.752853 | node1 -> localhost | +----[SHA256]-----+
2026-08-18 12:55:40.752919 | node1 -> localhost | ok: Runtime: 0:00:01.454545
2026-08-18 12:55:40.760298 | 
2026-08-18 12:55:40.760362 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-08-18 12:55:40.804067 | node1 | ok
2026-08-18 12:55:40.809731 | node2 | ok
2026-08-18 12:55:40.814075 | node3 | ok
2026-08-18 12:55:40.834006 | node1 | included: /var/lib/zuul/builds/7a9e062a129446c280273372d57d08af/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-18 12:55:40.834093 | node2 | included: /var/lib/zuul/builds/7a9e062a129446c280273372d57d08af/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-18 12:55:40.834119 | node3 | included: /var/lib/zuul/builds/7a9e062a129446c280273372d57d08af/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-18 12:55:40.847946 | 
2026-08-18 12:55:40.848011 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-08-18 12:55:40.873155 | node1 | skipping: Conditional result was False
2026-08-18 12:55:40.889677 | node2 | skipping: Conditional result was False
2026-08-18 12:55:40.911026 | node3 | skipping: Conditional result was False
2026-08-18 12:55:40.920886 | 
2026-08-18 12:55:40.921019 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-08-18 12:55:41.466996 | node1 | changed
2026-08-18 12:55:41.471875 | node3 | changed
2026-08-18 12:55:41.476451 | node2 | changed
2026-08-18 12:55:41.481727 | 
2026-08-18 12:55:41.481789 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-08-18 12:55:41.700683 | node1 | ok
2026-08-18 12:55:41.730990 | node2 | ok
2026-08-18 12:55:41.738030 | node3 | ok
2026-08-18 12:55:41.744223 | 
2026-08-18 12:55:41.744289 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-08-18 12:55:42.306371 | node1 | changed
2026-08-18 12:55:42.313048 | node2 | changed
2026-08-18 12:55:42.330414 | node3 | changed
2026-08-18 12:55:42.339388 | 
2026-08-18 12:55:42.339504 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-08-18 12:55:42.893960 | node1 | changed
2026-08-18 12:55:42.937108 | node3 | changed
2026-08-18 12:55:42.958848 | node2 | changed
2026-08-18 12:55:42.964651 | 
2026-08-18 12:55:42.964720 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-08-18 12:55:43.004142 | node1 | skipping: Conditional result was False
2026-08-18 12:55:43.005463 | node2 | skipping: Conditional result was False
2026-08-18 12:55:43.026032 | node3 | skipping: Conditional result was False
2026-08-18 12:55:43.036518 | 
2026-08-18 12:55:43.036720 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-08-18 12:55:43.417879 | node1 -> localhost | changed
2026-08-18 12:55:43.444000 | 
2026-08-18 12:55:43.444085 | TASK [add-build-sshkey : Add back temp key]
2026-08-18 12:55:43.742876 | node1 -> localhost | Identity added: /var/lib/zuul/builds/7a9e062a129446c280273372d57d08af/work/7a9e062a129446c280273372d57d08af_id_rsa (zuul-build-sshkey)
2026-08-18 12:55:43.743056 | node1 -> localhost | ok: Runtime: 0:00:00.015481
2026-08-18 12:55:43.748357 | 
2026-08-18 12:55:43.748419 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-08-18 12:55:44.102392 | node2 | ok
2026-08-18 12:55:44.107085 | node3 | ok
2026-08-18 12:55:44.111480 | node1 | ok
2026-08-18 12:55:44.116430 | 
2026-08-18 12:55:44.116507 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-08-18 12:55:44.195787 | node1 | skipping: Conditional result was False
2026-08-18 12:55:44.196857 | node2 | skipping: Conditional result was False
2026-08-18 12:55:44.217420 | node3 | skipping: Conditional result was False
2026-08-18 12:55:44.244682 | 
2026-08-18 12:55:44.244747 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-08-18 12:55:44.566805 | node3 | ok
2026-08-18 12:55:44.577855 | node2 | ok
2026-08-18 12:55:44.583999 | node1 | ok
2026-08-18 12:55:44.590124 | 
2026-08-18 12:55:44.590187 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-08-18 12:55:45.329867 | node1 | Output suppressed because no_log was given
2026-08-18 12:55:45.340426 | node3 | Output suppressed because no_log was given
2026-08-18 12:55:45.347040 | node2 | Output suppressed because no_log was given
2026-08-18 12:55:45.366437 | 
2026-08-18 12:55:45.367030 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-08-18 12:55:45.595848 | node1 | ok: "logs"
2026-08-18 12:55:45.596378 | node1 | ok: All items complete
2026-08-18 12:55:45.596434 | 
2026-08-18 12:55:45.619874 | node2 | ok: "logs"
2026-08-18 12:55:45.626842 | node3 | ok: "logs"
2026-08-18 12:55:45.793845 | node1 | ok: "artifacts"
2026-08-18 12:55:45.829490 | node2 | ok: "artifacts"
2026-08-18 12:55:45.840476 | node3 | ok: "artifacts"
2026-08-18 12:55:45.981035 | node1 | ok: "docs"
2026-08-18 12:55:46.023825 | node3 | ok: "docs"
2026-08-18 12:55:46.074328 | node2 | ok: "docs"
2026-08-18 12:55:46.074476 | node2 | ok: All items complete
2026-08-18 12:55:46.074511 | 
2026-08-18 12:55:46.091939 | 
2026-08-18 12:55:46.092106 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-08-18 12:55:46.326740 | node1 | changed: "logs"
2026-08-18 12:55:46.353266 | node2 | changed: "logs"
2026-08-18 12:55:46.359191 | node3 | changed: "logs"
2026-08-18 12:55:46.518203 | node1 | changed: "artifacts"
2026-08-18 12:55:46.544497 | node2 | changed: "artifacts"
2026-08-18 12:55:46.584619 | node3 | changed: "artifacts"
2026-08-18 12:55:46.703585 | node1 | changed: "docs"
2026-08-18 12:55:46.748330 | node2 | changed: "docs"
2026-08-18 12:55:46.748484 | node2 | changed: All items complete
2026-08-18 12:55:46.748524 | 
2026-08-18 12:55:46.773482 | node3 | changed: "docs"
2026-08-18 12:55:46.798202 | 
2026-08-18 12:55:46.798372 | PLAY RECAP
2026-08-18 12:55:46.798434 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-18 12:55:46.798468 | node1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-18 12:55:46.798504 | node2 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-18 12:55:46.798533 | node3 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-18 12:55:46.798553 | 
2026-08-18 12:55:46.989471 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-18 12:55:46.998242 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-18 12:55:47.626457 | 
2026-08-18 12:55:47.626585 | PLAY [all]
2026-08-18 12:55:47.638998 | 
2026-08-18 12:55:47.639081 | TASK [setup-uv : Extract archive]
2026-08-18 12:55:50.141107 | node2 | changed
2026-08-18 12:55:50.512869 | node3 | changed
2026-08-18 12:55:51.109616 | node1 | changed
2026-08-18 12:55:51.116001 | 
2026-08-18 12:55:51.116107 | TASK [setup-uv : Print version]
2026-08-18 12:55:51.546337 | node2 | uv 0.8.13
2026-08-18 12:55:51.545959 | node1 | uv 0.8.13
2026-08-18 12:55:51.552786 | node3 | uv 0.8.13
2026-08-18 12:55:51.771293 | node1 | ok: Runtime: 0:00:00.016175
2026-08-18 12:55:51.782882 | node2 | ok: Runtime: 0:00:00.015644
2026-08-18 12:55:51.791374 | node3 | ok: Runtime: 0:00:00.015158
2026-08-18 12:55:51.810654 | 
2026-08-18 12:55:51.810728 | TASK [Install Ansible collection siblings]
2026-08-18 12:55:52.149913 | node1 | ok:
2026-08-18 12:55:52.150156 | node1 | Skipping community.crypto: no checked-out sibling
2026-08-18 12:55:52.150205 | node1 | Skipping community.docker: no checked-out sibling
2026-08-18 12:55:52.150258 | node1 | Skipping community.general: no checked-out sibling
2026-08-18 12:55:52.150304 | node1 | Skipping ansible.utils: no checked-out sibling
2026-08-18 12:55:52.150339 | node1 | Skipping vexxhost.containers: no checked-out sibling
2026-08-18 12:55:52.152825 | 
2026-08-18 12:55:52.152890 | PLAY RECAP
2026-08-18 12:55:52.152973 | node1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-18 12:55:52.153024 | node2 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-18 12:55:52.153067 | node3 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-18 12:55:52.153098 | 
2026-08-18 12:55:52.311632 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-18 12:55:52.324934 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-18 12:55:52.952839 | 
2026-08-18 12:55:52.953346 | PLAY [all]
2026-08-18 12:55:52.966010 | 
2026-08-18 12:55:52.966092 | LOOP [Check inventory directories]
2026-08-18 12:55:53.326083 | node1 | ok: "src/github.com/vexxhost/ansible-collection-ceph"
2026-08-18 12:55:53.511321 | node1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory"
2026-08-18 12:55:53.692803 | node1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory"
2026-08-18 12:55:53.713969 | 
2026-08-18 12:55:53.714138 | LOOP [Copy inventory file for Zuul]
2026-08-18 12:55:54.647247 | node1 | changed:
2026-08-18 12:55:54.647510 | node1 | {
2026-08-18 12:55:54.647552 | node1 |   "ansible_loop_var": "item",
2026-08-18 12:55:54.647583 | node1 |   "changed": false,
2026-08-18 12:55:54.647609 | node1 |   "failed": false,
2026-08-18 12:55:54.647640 | node1 |   "invocation": {
2026-08-18 12:55:54.647667 | node1 |     "module_args": {
2026-08-18 12:55:54.647708 | node1 |       "checksum_algorithm": "sha1",
2026-08-18 12:55:54.647733 | node1 |       "follow": true,
2026-08-18 12:55:54.647758 | node1 |       "get_attributes": true,
2026-08-18 12:55:54.647785 | node1 |       "get_checksum": true,
2026-08-18 12:55:54.647810 | node1 |       "get_mime": true,
2026-08-18 12:55:54.647834 | node1 |       "path": "src/github.com/vexxhost/ansible-collection-ceph"
2026-08-18 12:55:54.647859 | node1 |     }
2026-08-18 12:55:54.647883 | node1 |   },
2026-08-18 12:55:54.647907 | node1 |   "item": "src/github.com/vexxhost/ansible-collection-ceph",
2026-08-18 12:55:54.647932 | node1 |   "stat": {
2026-08-18 12:55:54.647955 | node1 |     "atime": 1787057745.214288,
2026-08-18 12:55:54.647979 | node1 |     "attr_flags": "e",
2026-08-18 12:55:54.648003 | node1 |     "attributes": [
2026-08-18 12:55:54.648027 | node1 |       "extents"
2026-08-18 12:55:54.648051 | node1 |     ],
2026-08-18 12:55:54.648075 | node1 |     "block_size": 4096,
2026-08-18 12:55:54.648099 | node1 |     "blocks": 8,
2026-08-18 12:55:54.648123 | node1 |     "charset": "unknown",
2026-08-18 12:55:54.648152 | node1 |     "ctime": 1787057745.2282884,
2026-08-18 12:55:54.648179 | node1 |     "dev": 64769,
2026-08-18 12:55:54.648203 | node1 |     "device_type": 0,
2026-08-18 12:55:54.648227 | node1 |     "executable": true,
2026-08-18 12:55:54.648251 | node1 |     "exists": true,
2026-08-18 12:55:54.648275 | node1 |     "gid": 1000,
2026-08-18 12:55:54.648300 | node1 |     "gr_name": "zuul",
2026-08-18 12:55:54.648323 | node1 |     "inode": 1034272,
2026-08-18 12:55:54.648347 | node1 |     "isblk": false,
2026-08-18 12:55:54.648372 | node1 |     "ischr": false,
2026-08-18 12:55:54.648396 | node1 |     "isdir": true,
2026-08-18 12:55:54.648424 | node1 |     "isfifo": false,
2026-08-18 12:55:54.648456 | node1 |     "isgid": false,
2026-08-18 12:55:54.648484 | node1 |     "islnk": false,
2026-08-18 12:55:54.648508 | node1 |     "isreg": false,
2026-08-18 12:55:54.648532 | node1 |     "issock": false,
2026-08-18 12:55:54.648555 | node1 |     "isuid": false,
2026-08-18 12:55:54.648579 | node1 |     "mimetype": "unknown",
2026-08-18 12:55:54.648602 | node1 |     "mode": "0755",
2026-08-18 12:55:54.648626 | node1 |     "mtime": 1787057726.0596344,
2026-08-18 12:55:54.648649 | node1 |     "nlink": 10,
2026-08-18 12:55:54.648673 | node1 |     "path": "src/github.com/vexxhost/ansible-collection-ceph",
2026-08-18 12:55:54.648696 | node1 |     "pw_name": "zuul",
2026-08-18 12:55:54.648721 | node1 |     "readable": true,
2026-08-18 12:55:54.648745 | node1 |     "rgrp": true,
2026-08-18 12:55:54.648769 | node1 |     "roth": true,
2026-08-18 12:55:54.648793 | node1 |     "rusr": true,
2026-08-18 12:55:54.648816 | node1 |     "size": 4096,
2026-08-18 12:55:54.648840 | node1 |     "uid": 1000,
2026-08-18 12:55:54.648864 | node1 |     "version": "3098476044",
2026-08-18 12:55:54.648889 | node1 |     "wgrp": false,
2026-08-18 12:55:54.648914 | node1 |     "woth": false,
2026-08-18 12:55:54.648938 | node1 |     "writeable": true,
2026-08-18 12:55:54.648985 | node1 |     "wusr": true,
2026-08-18 12:55:54.649011 | node1 |     "xgrp": true,
2026-08-18 12:55:54.649035 | node1 |     "xoth": true,
2026-08-18 12:55:54.649059 | node1 |     "xusr": true
2026-08-18 12:55:54.649084 | node1 |   }
2026-08-18 12:55:54.649113 | node1 | }
2026-08-18 12:55:54.649170 | node1 | ok: All items complete
2026-08-18 12:55:54.649206 | 
2026-08-18 12:55:54.650876 | node1 | skipping: Conditional result was False
2026-08-18 12:55:54.651712 | node1 | skipping: Conditional result was False
2026-08-18 12:55:54.667174 | 
2026-08-18 12:55:54.667318 | LOOP [Switch "ansible_host" to private IP]
2026-08-18 12:55:55.059848 | node1 | changed: 3 replacements made
2026-08-18 12:55:55.061479 | node1 | skipping: Conditional result was False
2026-08-18 12:55:55.063672 | node1 | skipping: Conditional result was False
2026-08-18 12:55:55.080349 | 
2026-08-18 12:55:55.080444 | TASK [Run Molecule scenario]
2026-08-18 12:55:55.565158 | node1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3
2026-08-18 12:55:55.565273 | node1 | Creating virtual environment at: .venv
2026-08-18 12:55:55.610841 | node1 | Downloading cryptography (4.3MiB)
2026-08-18 12:55:55.611069 | node1 | Downloading netaddr (2.2MiB)
2026-08-18 12:55:55.611369 | node1 | Downloading ansible-core (2.1MiB)
2026-08-18 12:55:55.611700 | node1 | Downloading pygments (1.2MiB)
2026-08-18 12:55:55.815528 | node1 |  Downloading netaddr
2026-08-18 12:55:55.825265 | node1 |  Downloading cryptography
2026-08-18 12:55:55.871987 | node1 |  Downloading pygments
2026-08-18 12:55:56.001222 | node1 |  Downloading ansible-core
2026-08-18 12:55:56.044402 | node1 | Installed 43 packages in 42ms
2026-08-18 12:55:56.807536 | node1 | INFO     Collection 'vexxhost.ceph' detected.
2026-08-18 12:55:56.807656 | node1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-08-18 12:55:57.424262 | node1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-08-18 12:55:57.424314 | node1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-08-18 12:56:25.499080 | node1 | INFO     [default > dependency] Executing
2026-08-18 12:56:25.499179 | node1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-08-18 12:56:25.499383 | node1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-08-18 12:56:25.499512 | node1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-08-18 12:56:25.505289 | node1 | INFO     [default > cleanup] Executing
2026-08-18 12:56:25.505555 | node1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-18 12:56:25.511243 | node1 | INFO     [default > destroy] Executing
2026-08-18 12:56:25.511281 | node1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-08-18 12:56:25.511359 | node1 | INFO     [default > destroy] Executed: Successful
2026-08-18 12:56:25.517006 | node1 | INFO     [default > syntax] Executing
2026-08-18 12:56:26.828557 | node1 |
2026-08-18 12:56:26.828752 | node1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-08-18 12:56:26.889648 | node1 | INFO     [default > syntax] Executed: Successful
2026-08-18 12:56:26.896794 | node1 | INFO     [default > create] Executing
2026-08-18 12:56:26.899633 | node1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-18 12:56:26.905360 | node1 | INFO     [default > prepare] Executing
2026-08-18 12:56:27.743539 | node1 |
2026-08-18 12:56:27.743633 | node1 | PLAY [Prepare] *****************************************************************
2026-08-18 12:56:27.743806 | node1 |
2026-08-18 12:56:27.743908 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 12:56:27.744036 | node1 | Tuesday 18 August 2026  12:56:27 +0000 (0:00:00.032)       0:00:00.032 ********
2026-08-18 12:56:28.984781 | node1 | [WARNING]: Platform linux on host node1 is using the discovered Python
2026-08-18 12:56:28.984993 | node1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-18 12:56:28.985230 | node1 | interpreter could change the meaning of that path. See
2026-08-18 12:56:28.985473 | node1 | https://docs.ansible.com/ansible-
2026-08-18 12:56:28.985844 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 12:56:30.035495 | node1 | [WARNING]: Platform linux on host node2 is using the discovered Python
2026-08-18 12:56:30.035807 | node1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-18 12:56:30.036103 | node1 | interpreter could change the meaning of that path. See
2026-08-18 12:56:30.036361 | node1 | https://docs.ansible.com/ansible-
2026-08-18 12:56:30.036627 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 12:56:30.041715 | node1 | [WARNING]: Platform linux on host node3 is using the discovered Python
2026-08-18 12:56:30.041991 | node1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-18 12:56:30.042254 | node1 | interpreter could change the meaning of that path. See
2026-08-18 12:56:30.042494 | node1 | https://docs.ansible.com/ansible-
2026-08-18 12:56:30.042800 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 12:56:30.050084 | node1 | ok: [node1]
2026-08-18 12:56:30.050328 | node1 | ok: [node2]
2026-08-18 12:56:30.050630 | node1 | ok: [node3]
2026-08-18 12:56:30.050891 | node1 |
2026-08-18 12:56:30.051159 | node1 | TASK [Configure short hostname] ************************************************
2026-08-18 12:56:30.051421 | node1 | Tuesday 18 August 2026  12:56:30 +0000 (0:00:02.306)       0:00:02.339 ********
2026-08-18 12:56:30.876992 | node1 | changed: [node3]
2026-08-18 12:56:30.877166 | node1 | changed: [node1]
2026-08-18 12:56:30.877449 | node1 | changed: [node2]
2026-08-18 12:56:30.877737 | node1 |
2026-08-18 12:56:30.877989 | node1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-08-18 12:56:30.878237 | node1 | Tuesday 18 August 2026  12:56:30 +0000 (0:00:00.826)       0:00:03.165 ********
2026-08-18 12:56:31.184909 | node1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-08-18 12:56:31.185208 | node1 | with a mode of 0700, this may cause issues when running as another user. To
2026-08-18 12:56:31.185609 | node1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-08-18 12:56:31.208623 | node1 | changed: [node1]
2026-08-18 12:56:31.208647 | node1 | changed: [node3]
2026-08-18 12:56:31.208653 | node1 | changed: [node2]
2026-08-18 12:56:31.208795 | node1 |
2026-08-18 12:56:31.209096 | node1 | TASK [Update apt cache] ********************************************************
2026-08-18 12:56:31.209555 | node1 | Tuesday 18 August 2026  12:56:31 +0000 (0:00:00.331)       0:00:03.496 ********
2026-08-18 12:56:39.319700 | node1 | changed: [node3]
2026-08-18 12:56:39.319917 | node1 | changed: [node2]
2026-08-18 12:56:39.320187 | node1 | changed: [node1]
2026-08-18 12:56:39.320450 | node1 |
2026-08-18 12:56:39.320757 | node1 | PLAY [Create devices for Ceph] *************************************************
2026-08-18 12:56:39.321028 | node1 |
2026-08-18 12:56:39.321303 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 12:56:39.321626 | node1 | Tuesday 18 August 2026  12:56:39 +0000 (0:00:08.111)       0:00:11.608 ********
2026-08-18 12:56:40.156760 | node1 | ok: [node2]
2026-08-18 12:56:40.157020 | node1 | ok: [node3]
2026-08-18 12:56:40.157284 | node1 | ok: [node1]
2026-08-18 12:56:40.157554 | node1 |
2026-08-18 12:56:40.157865 | node1 | TASK [Install depedencies] *****************************************************
2026-08-18 12:56:40.158139 | node1 | Tuesday 18 August 2026  12:56:40 +0000 (0:00:00.836)       0:00:12.444 ********
2026-08-18 12:57:12.770856 | node1 | changed: [node2]
2026-08-18 12:57:12.771022 | node1 | changed: [node1]
2026-08-18 12:57:12.771248 | node1 | changed: [node3]
2026-08-18 12:57:12.771468 | node1 |
2026-08-18 12:57:12.771740 | node1 | TASK [Start up service] ********************************************************
2026-08-18 12:57:12.771986 | node1 | Tuesday 18 August 2026  12:57:12 +0000 (0:00:32.614)       0:00:45.059 ********
2026-08-18 12:57:13.436555 | node1 | ok: [node1]
2026-08-18 12:57:13.436823 | node1 | ok: [node2]
2026-08-18 12:57:13.437072 | node1 | ok: [node3]
2026-08-18 12:57:13.437295 | node1 |
2026-08-18 12:57:13.437571 | node1 | TASK [Generate lvm.conf] *******************************************************
2026-08-18 12:57:13.437872 | node1 | Tuesday 18 August 2026  12:57:13 +0000 (0:00:00.665)       0:00:45.725 ********
2026-08-18 12:57:14.779241 | node1 | ok: [node1]
2026-08-18 12:57:14.779499 | node1 | ok: [node3]
2026-08-18 12:57:14.779850 | node1 | ok: [node2]
2026-08-18 12:57:14.780082 | node1 |
2026-08-18 12:57:14.780343 | node1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-08-18 12:57:14.780688 | node1 | Tuesday 18 August 2026  12:57:14 +0000 (0:00:01.342)       0:00:47.068 ********
2026-08-18 12:57:15.575607 | node1 | changed: [node1]
2026-08-18 12:57:15.575796 | node1 | changed: [node2]
2026-08-18 12:57:15.575995 | node1 | changed: [node3]
2026-08-18 12:57:15.576182 | node1 |
2026-08-18 12:57:15.576391 | node1 | TASK [Get list of all loopback devices] ****************************************
2026-08-18 12:57:15.576635 | node1 | Tuesday 18 August 2026  12:57:15 +0000 (0:00:00.796)       0:00:47.864 ********
2026-08-18 12:57:15.840209 | node1 | ok: [node1]
2026-08-18 12:57:15.840384 | node1 | ok: [node2]
2026-08-18 12:57:15.840626 | node1 | ok: [node3]
2026-08-18 12:57:15.840852 | node1 |
2026-08-18 12:57:15.841101 | node1 | TASK [Fail if there is any existing loopback devices] **************************
2026-08-18 12:57:15.841340 | node1 | Tuesday 18 August 2026  12:57:15 +0000 (0:00:00.264)       0:00:48.128 ********
2026-08-18 12:57:15.891925 | node1 | skipping: [node1]
2026-08-18 12:57:15.892221 | node1 | skipping: [node2]
2026-08-18 12:57:15.892542 | node1 | skipping: [node3]
2026-08-18 12:57:15.892889 | node1 |
2026-08-18 12:57:15.893209 | node1 | TASK [Create devices for Ceph] *************************************************
2026-08-18 12:57:15.893540 | node1 | Tuesday 18 August 2026  12:57:15 +0000 (0:00:00.051)       0:00:48.180 ********
2026-08-18 12:57:16.645282 | node1 | changed: [node2] => (item=osd0)
2026-08-18 12:57:16.645351 | node1 | changed: [node1] => (item=osd0)
2026-08-18 12:57:16.645533 | node1 | changed: [node3] => (item=osd0)
2026-08-18 12:57:16.645721 | node1 | changed: [node2] => (item=osd1)
2026-08-18 12:57:16.645869 | node1 | changed: [node1] => (item=osd1)
2026-08-18 12:57:16.646013 | node1 | changed: [node3] => (item=osd1)
2026-08-18 12:57:16.646173 | node1 | changed: [node2] => (item=osd2)
2026-08-18 12:57:16.646309 | node1 | changed: [node1] => (item=osd2)
2026-08-18 12:57:16.646451 | node1 | changed: [node3] => (item=osd2)
2026-08-18 12:57:16.646647 | node1 |
2026-08-18 12:57:16.646771 | node1 | TASK [Set permissions on loopback devices] *************************************
2026-08-18 12:57:16.646959 | node1 | Tuesday 18 August 2026  12:57:16 +0000 (0:00:00.753)       0:00:48.933 ********
2026-08-18 12:57:17.473006 | node1 | changed: [node3] => (item=osd0)
2026-08-18 12:57:17.473143 | node1 | changed: [node1] => (item=osd0)
2026-08-18 12:57:17.473319 | node1 | changed: [node2] => (item=osd0)
2026-08-18 12:57:17.473494 | node1 | changed: [node3] => (item=osd1)
2026-08-18 12:57:17.473702 | node1 | changed: [node2] => (item=osd1)
2026-08-18 12:57:17.473879 | node1 | changed: [node1] => (item=osd1)
2026-08-18 12:57:17.474048 | node1 | changed: [node3] => (item=osd2)
2026-08-18 12:57:17.474222 | node1 | changed: [node2] => (item=osd2)
2026-08-18 12:57:17.474394 | node1 | changed: [node1] => (item=osd2)
2026-08-18 12:57:17.474687 | node1 |
2026-08-18 12:57:17.474870 | node1 | TASK [Start loop devices] ******************************************************
2026-08-18 12:57:17.475052 | node1 | Tuesday 18 August 2026  12:57:17 +0000 (0:00:00.827)       0:00:49.761 ********
2026-08-18 12:57:19.291948 | node1 | changed: [node3] => (item=osd0)
2026-08-18 12:57:19.292101 | node1 | changed: [node1] => (item=osd0)
2026-08-18 12:57:19.292392 | node1 | changed: [node2] => (item=osd0)
2026-08-18 12:57:19.292710 | node1 | changed: [node1] => (item=osd1)
2026-08-18 12:57:19.292987 | node1 | changed: [node2] => (item=osd1)
2026-08-18 12:57:19.293232 | node1 | changed: [node1] => (item=osd2)
2026-08-18 12:57:19.293536 | node1 | changed: [node2] => (item=osd2)
2026-08-18 12:57:19.293902 | node1 | changed: [node3] => (item=osd1)
2026-08-18 12:57:19.294095 | node1 | changed: [node3] => (item=osd2)
2026-08-18 12:57:19.294320 | node1 |
2026-08-18 12:57:19.294670 | node1 | TASK [Create a volume group for each loop device] ******************************
2026-08-18 12:57:19.294918 | node1 | Tuesday 18 August 2026  12:57:19 +0000 (0:00:01.818)       0:00:51.580 ********
2026-08-18 12:57:20.761259 | node1 | changed: [node1] => (item=osd0)
2026-08-18 12:57:20.761357 | node1 | changed: [node3] => (item=osd0)
2026-08-18 12:57:20.761512 | node1 | changed: [node2] => (item=osd0)
2026-08-18 12:57:20.761705 | node1 | changed: [node3] => (item=osd1)
2026-08-18 12:57:20.761861 | node1 | changed: [node1] => (item=osd1)
2026-08-18 12:57:20.762018 | node1 | changed: [node2] => (item=osd1)
2026-08-18 12:57:20.762163 | node1 | changed: [node2] => (item=osd2)
2026-08-18 12:57:20.762312 | node1 | changed: [node3] => (item=osd2)
2026-08-18 12:57:20.762461 | node1 | changed: [node1] => (item=osd2)
2026-08-18 12:57:20.762621 | node1 |
2026-08-18 12:57:20.762776 | node1 | TASK [Create a logical volume for each loop device] ****************************
2026-08-18 12:57:20.762944 | node1 | Tuesday 18 August 2026  12:57:20 +0000 (0:00:01.469)       0:00:53.049 ********
2026-08-18 12:57:22.173654 | node1 | changed: [node3] => (item=ceph-node3-osd0)
2026-08-18 12:57:22.173713 | node1 | changed: [node1] => (item=ceph-node1-osd0)
2026-08-18 12:57:22.175653 | node1 | changed: [node2] => (item=ceph-node2-osd0)
2026-08-18 12:57:22.175710 | node1 | changed: [node3] => (item=ceph-node3-osd1)
2026-08-18 12:57:22.175720 | node1 | changed: [node1] => (item=ceph-node1-osd1)
2026-08-18 12:57:22.175729 | node1 | changed: [node2] => (item=ceph-node2-osd1)
2026-08-18 12:57:22.175737 | node1 | changed: [node3] => (item=ceph-node3-osd2)
2026-08-18 12:57:22.175746 | node1 | changed: [node1] => (item=ceph-node1-osd2)
2026-08-18 12:57:22.175754 | node1 | changed: [node2] => (item=ceph-node2-osd2)
2026-08-18 12:57:22.175762 | node1 |
2026-08-18 12:57:22.176015 | node1 | PLAY RECAP *********************************************************************
2026-08-18 12:57:22.176494 | node1 | node1                      : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-08-18 12:57:22.176873 | node1 | node2                      : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-08-18 12:57:22.177200 | node1 | node3                      : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-08-18 12:57:22.177475 | node1 |
2026-08-18 12:57:22.177777 | node1 |
2026-08-18 12:57:22.178081 | node1 | TASKS RECAP ********************************************************************
2026-08-18 12:57:22.178381 | node1 | Tuesday 18 August 2026  12:57:22 +0000 (0:00:01.413)       0:00:54.462 ********
2026-08-18 12:57:22.178699 | node1 | ===============================================================================
2026-08-18 12:57:22.179004 | node1 | Install depedencies ---------------------------------------------------- 32.61s
2026-08-18 12:57:22.179295 | node1 | Update apt cache -------------------------------------------------------- 8.11s
2026-08-18 12:57:22.179614 | node1 | Gathering Facts --------------------------------------------------------- 2.31s
2026-08-18 12:57:22.179916 | node1 | Start loop devices ------------------------------------------------------ 1.82s
2026-08-18 12:57:22.180274 | node1 | Create a volume group for each loop device ------------------------------ 1.47s
2026-08-18 12:57:22.180576 | node1 | Create a logical volume for each loop device ---------------------------- 1.41s
2026-08-18 12:57:22.180924 | node1 | Generate lvm.conf ------------------------------------------------------- 1.34s
2026-08-18 12:57:22.181222 | node1 | Gathering Facts --------------------------------------------------------- 0.84s
2026-08-18 12:57:22.181522 | node1 | Set permissions on loopback devices ------------------------------------- 0.83s
2026-08-18 12:57:22.181850 | node1 | Configure short hostname ------------------------------------------------ 0.83s
2026-08-18 12:57:22.182154 | node1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.80s
2026-08-18 12:57:22.182461 | node1 | Create devices for Ceph ------------------------------------------------- 0.75s
2026-08-18 12:57:22.182792 | node1 | Start up service -------------------------------------------------------- 0.67s
2026-08-18 12:57:22.183099 | node1 | Ensure hostname inside hosts file --------------------------------------- 0.33s
2026-08-18 12:57:22.183395 | node1 | Get list of all loopback devices ---------------------------------------- 0.26s
2026-08-18 12:57:22.183726 | node1 | Fail if there is any existing loopback devices -------------------------- 0.05s
2026-08-18 12:57:22.264979 | node1 | INFO     [default > prepare] Executed: Successful
2026-08-18 12:57:22.275211 | node1 | INFO     [default > converge] Executing
2026-08-18 12:57:23.436228 | node1 |
2026-08-18 12:57:23.436633 | node1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-08-18 12:57:23.436926 | node1 |
2026-08-18 12:57:23.437222 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 12:57:23.437517 | node1 | Tuesday 18 August 2026  12:57:23 +0000 (0:00:00.057)       0:00:00.057 ********
2026-08-18 12:57:24.782430 | node1 | [WARNING]: Platform linux on host node2 is using the discovered Python
2026-08-18 12:57:24.782492 | node1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-18 12:57:24.782503 | node1 | interpreter could change the meaning of that path. See
2026-08-18 12:57:24.782512 | node1 | https://docs.ansible.com/ansible-
2026-08-18 12:57:24.782545 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 12:57:24.825811 | node1 | [WARNING]: Platform linux on host node3 is using the discovered Python
2026-08-18 12:57:24.825890 | node1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-18 12:57:24.825903 | node1 | interpreter could change the meaning of that path. See
2026-08-18 12:57:24.825941 | node1 | https://docs.ansible.com/ansible-
2026-08-18 12:57:24.826220 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 12:57:25.749913 | node1 | [WARNING]: Platform linux on host node1 is using the discovered Python
2026-08-18 12:57:25.750110 | node1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-18 12:57:25.750404 | node1 | interpreter could change the meaning of that path. See
2026-08-18 12:57:25.750758 | node1 | https://docs.ansible.com/ansible-
2026-08-18 12:57:25.751021 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 12:57:25.821737 | node1 | ok: [node2]
2026-08-18 12:57:25.821789 | node1 | ok: [node3]
2026-08-18 12:57:25.822772 | node1 | ok: [node1]
2026-08-18 12:57:25.822807 | node1 |
2026-08-18 12:57:25.822817 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 12:57:25.822827 | node1 | Tuesday 18 August 2026  12:57:25 +0000 (0:00:02.384)       0:00:02.442 ********
2026-08-18 12:57:26.209709 | node1 | ok: [node1]
2026-08-18 12:57:26.209809 | node1 | ok: [node3]
2026-08-18 12:57:26.209826 | node1 | ok: [node2]
2026-08-18 12:57:26.210260 | node1 |
2026-08-18 12:57:26.210298 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 12:57:26.210303 | node1 | Tuesday 18 August 2026  12:57:26 +0000 (0:00:00.387)       0:00:02.830 ********
2026-08-18 12:57:26.243570 | node1 | skipping: [node1]
2026-08-18 12:57:26.307373 | node1 | skipping: [node2]
2026-08-18 12:57:26.307403 | node1 | skipping: [node3]
2026-08-18 12:57:26.307408 | node1 |
2026-08-18 12:57:26.307412 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 12:57:26.307417 | node1 | Tuesday 18 August 2026  12:57:26 +0000 (0:00:00.097)       0:00:02.927 ********
2026-08-18 12:57:26.691174 | node1 | changed: [node2]
2026-08-18 12:57:26.691275 | node1 | changed: [node3]
2026-08-18 12:57:26.691416 | node1 | changed: [node1]
2026-08-18 12:57:26.691537 | node1 |
2026-08-18 12:57:26.691833 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 12:57:26.691848 | node1 | Tuesday 18 August 2026  12:57:26 +0000 (0:00:00.384)       0:00:03.312 ********
2026-08-18 12:57:26.819647 | node1 | ok: [node2] => {
2026-08-18 12:57:26.819696 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 12:57:26.819706 | node1 | }
2026-08-18 12:57:26.819715 | node1 | ok: [node1] => {
2026-08-18 12:57:26.819724 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 12:57:26.819732 | node1 | }
2026-08-18 12:57:26.819740 | node1 | ok: [node3] => {
2026-08-18 12:57:26.819749 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 12:57:26.819757 | node1 | }
2026-08-18 12:57:26.819766 | node1 |
2026-08-18 12:57:26.820184 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 12:57:26.820509 | node1 | Tuesday 18 August 2026  12:57:26 +0000 (0:00:00.125)       0:00:03.437 ********
2026-08-18 12:57:27.599386 | node1 | changed: [node3]
2026-08-18 12:57:27.599846 | node1 | changed: [node2]
2026-08-18 12:57:27.600159 | node1 | changed: [node1]
2026-08-18 12:57:27.600435 | node1 |
2026-08-18 12:57:27.600770 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 12:57:27.601079 | node1 | Tuesday 18 August 2026  12:57:27 +0000 (0:00:00.781)       0:00:04.219 ********
2026-08-18 12:57:27.722543 | node1 | skipping: [node1]
2026-08-18 12:57:27.722998 | node1 | skipping: [node2]
2026-08-18 12:57:27.723327 | node1 | skipping: [node3]
2026-08-18 12:57:27.723671 | node1 |
2026-08-18 12:57:27.724018 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 12:57:27.724326 | node1 | Tuesday 18 August 2026  12:57:27 +0000 (0:00:00.122)       0:00:04.342 ********
2026-08-18 12:57:27.845503 | node1 | skipping: [node1]
2026-08-18 12:57:27.846002 | node1 | skipping: [node2]
2026-08-18 12:57:27.846341 | node1 | skipping: [node3]
2026-08-18 12:57:27.846667 | node1 |
2026-08-18 12:57:27.846991 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 12:57:27.847300 | node1 | Tuesday 18 August 2026  12:57:27 +0000 (0:00:00.123)       0:00:04.465 ********
2026-08-18 12:57:28.148914 | node1 | ok: [node1]
2026-08-18 12:57:28.149012 | node1 | ok: [node2]
2026-08-18 12:57:28.149103 | node1 | ok: [node3]
2026-08-18 12:57:28.149194 | node1 |
2026-08-18 12:57:28.149490 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 12:57:28.149526 | node1 | Tuesday 18 August 2026  12:57:28 +0000 (0:00:00.304)       0:00:04.770 ********
2026-08-18 12:57:29.353094 | node1 | ok: [node3]
2026-08-18 12:57:29.353157 | node1 | ok: [node1]
2026-08-18 12:57:29.353220 | node1 | ok: [node2]
2026-08-18 12:57:29.353315 | node1 |
2026-08-18 12:57:29.353430 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 12:57:29.353542 | node1 | Tuesday 18 August 2026  12:57:29 +0000 (0:00:01.203)       0:00:05.973 ********
2026-08-18 12:57:29.585694 | node1 | ok: [node1] => {
2026-08-18 12:57:29.585774 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 12:57:29.585794 | node1 | }
2026-08-18 12:57:29.586988 | node1 | ok: [node2] => {
2026-08-18 12:57:29.587023 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 12:57:29.587029 | node1 | }
2026-08-18 12:57:29.587035 | node1 | ok: [node3] => {
2026-08-18 12:57:29.587040 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 12:57:29.587045 | node1 | }
2026-08-18 12:57:29.587051 | node1 |
2026-08-18 12:57:29.587056 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 12:57:29.587062 | node1 | Tuesday 18 August 2026  12:57:29 +0000 (0:00:00.232)       0:00:06.205 ********
2026-08-18 12:57:30.640053 | node1 | changed: [node2]
2026-08-18 12:57:30.640118 | node1 | changed: [node3]
2026-08-18 12:57:30.640130 | node1 | changed: [node1]
2026-08-18 12:57:30.640142 | node1 |
2026-08-18 12:57:30.640155 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 12:57:30.640167 | node1 | Tuesday 18 August 2026  12:57:30 +0000 (0:00:01.053)       0:00:07.259 ********
2026-08-18 12:57:34.771543 | node1 | changed: [node2]
2026-08-18 12:57:34.771644 | node1 | changed: [node1]
2026-08-18 12:57:34.771662 | node1 | changed: [node3]
2026-08-18 12:57:34.771674 | node1 |
2026-08-18 12:57:34.771686 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 12:57:34.771699 | node1 | Tuesday 18 August 2026  12:57:34 +0000 (0:00:04.132)       0:00:11.391 ********
2026-08-18 12:57:34.840678 | node1 | skipping: [node1]
2026-08-18 12:57:34.840746 | node1 | skipping: [node2]
2026-08-18 12:57:34.840766 | node1 | skipping: [node3]
2026-08-18 12:57:34.841518 | node1 |
2026-08-18 12:57:34.841558 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 12:57:34.841572 | node1 | Tuesday 18 August 2026  12:57:34 +0000 (0:00:00.069)       0:00:11.461 ********
2026-08-18 12:57:34.914569 | node1 | skipping: [node1]
2026-08-18 12:57:34.914642 | node1 | skipping: [node2]
2026-08-18 12:57:34.914656 | node1 | skipping: [node3]
2026-08-18 12:57:34.914668 | node1 |
2026-08-18 12:57:34.914680 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 12:57:34.914693 | node1 | Tuesday 18 August 2026  12:57:34 +0000 (0:00:00.072)       0:00:11.533 ********
2026-08-18 12:57:34.982758 | node1 | skipping: [node1]
2026-08-18 12:57:34.982817 | node1 | skipping: [node2]
2026-08-18 12:57:34.982831 | node1 | skipping: [node3]
2026-08-18 12:57:34.982844 | node1 |
2026-08-18 12:57:34.982858 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 12:57:34.982871 | node1 | Tuesday 18 August 2026  12:57:34 +0000 (0:00:00.067)       0:00:11.601 ********
2026-08-18 12:57:50.637822 | node1 | changed: [node3]
2026-08-18 12:57:50.637913 | node1 | changed: [node2]
2026-08-18 12:57:50.637926 | node1 | changed: [node1]
2026-08-18 12:57:50.637942 | node1 |
2026-08-18 12:57:50.638554 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 12:57:50.638609 | node1 | Tuesday 18 August 2026  12:57:50 +0000 (0:00:15.656)       0:00:27.257 ********
2026-08-18 12:57:51.329044 | node1 | changed: [node3]
2026-08-18 12:57:51.329171 | node1 | changed: [node1]
2026-08-18 12:57:51.329314 | node1 | changed: [node2]
2026-08-18 12:57:51.329452 | node1 |
2026-08-18 12:57:51.329623 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 12:57:51.329777 | node1 | Tuesday 18 August 2026  12:57:51 +0000 (0:00:00.692)       0:00:27.949 ********
2026-08-18 12:57:52.514755 | node1 | changed: [node1] => (item={'path': '/etc/containerd'})
2026-08-18 12:57:52.514815 | node1 | changed: [node2] => (item={'path': '/etc/containerd'})
2026-08-18 12:57:52.514825 | node1 | changed: [node3] => (item={'path': '/etc/containerd'})
2026-08-18 12:57:52.514835 | node1 | changed: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 12:57:52.514845 | node1 | changed: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 12:57:52.514854 | node1 | changed: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 12:57:52.515654 | node1 | changed: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 12:57:52.515707 | node1 | changed: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 12:57:52.515717 | node1 | changed: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 12:57:52.515935 | node1 | changed: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 12:57:52.516278 | node1 | changed: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 12:57:52.516635 | node1 | changed: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 12:57:52.517000 | node1 | changed: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 12:57:52.517359 | node1 | changed: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 12:57:52.517721 | node1 | changed: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 12:57:52.518042 | node1 |
2026-08-18 12:57:52.518362 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 12:57:52.518710 | node1 | Tuesday 18 August 2026  12:57:52 +0000 (0:00:01.184)       0:00:29.134 ********
2026-08-18 12:57:53.359419 | node1 | changed: [node1]
2026-08-18 12:57:53.361634 | node1 | changed: [node3]
2026-08-18 12:57:53.361665 | node1 | changed: [node2]
2026-08-18 12:57:53.361676 | node1 |
2026-08-18 12:57:53.361687 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 12:57:53.361697 | node1 | Tuesday 18 August 2026  12:57:53 +0000 (0:00:00.821)       0:00:29.955 ********
2026-08-18 12:57:53.361706 | node1 |
2026-08-18 12:57:53.361731 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 12:57:53.362080 | node1 | Tuesday 18 August 2026  12:57:53 +0000 (0:00:00.008)       0:00:29.963 ********
2026-08-18 12:57:53.362390 | node1 |
2026-08-18 12:57:53.362778 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 12:57:53.363099 | node1 | Tuesday 18 August 2026  12:57:53 +0000 (0:00:00.007)       0:00:29.971 ********
2026-08-18 12:57:53.363377 | node1 |
2026-08-18 12:57:53.363747 | node1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-18 12:57:53.364073 | node1 | Tuesday 18 August 2026  12:57:53 +0000 (0:00:00.007)       0:00:29.979 ********
2026-08-18 12:57:54.504093 | node1 | ok: [node1]
2026-08-18 12:57:54.504279 | node1 | ok: [node3]
2026-08-18 12:57:54.504435 | node1 | ok: [node2]
2026-08-18 12:57:54.504659 | node1 |
2026-08-18 12:57:54.504897 | node1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-08-18 12:57:54.505120 | node1 | Tuesday 18 August 2026  12:57:54 +0000 (0:00:01.145)       0:00:31.125 ********
2026-08-18 12:57:55.127177 | node1 | changed: [node1]
2026-08-18 12:57:55.127421 | node1 | changed: [node2]
2026-08-18 12:57:55.127633 | node1 | changed: [node3]
2026-08-18 12:57:55.127819 | node1 |
2026-08-18 12:57:55.128013 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 12:57:55.128203 | node1 | Tuesday 18 August 2026  12:57:55 +0000 (0:00:00.622)       0:00:31.747 ********
2026-08-18 12:57:55.887102 | node1 | changed: [node1]
2026-08-18 12:57:55.887173 | node1 | changed: [node2]
2026-08-18 12:57:55.887217 | node1 | changed: [node3]
2026-08-18 12:57:55.887323 | node1 |
2026-08-18 12:57:55.887433 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 12:57:55.887544 | node1 | Tuesday 18 August 2026  12:57:55 +0000 (0:00:00.760)       0:00:32.507 ********
2026-08-18 12:57:56.194669 | node1 | ok: [node1]
2026-08-18 12:57:56.194716 | node1 | ok: [node2]
2026-08-18 12:57:56.194977 | node1 | ok: [node3]
2026-08-18 12:57:56.195257 | node1 |
2026-08-18 12:57:56.195566 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 12:57:56.195917 | node1 | Tuesday 18 August 2026  12:57:56 +0000 (0:00:00.307)       0:00:32.815 ********
2026-08-18 12:57:56.329993 | node1 | ok: [node1] => {
2026-08-18 12:57:56.330789 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 12:57:56.330862 | node1 | }
2026-08-18 12:57:56.330914 | node1 | ok: [node2] => {
2026-08-18 12:57:56.331175 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 12:57:56.331400 | node1 | }
2026-08-18 12:57:56.331679 | node1 | ok: [node3] => {
2026-08-18 12:57:56.331942 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 12:57:56.332185 | node1 | }
2026-08-18 12:57:56.332420 | node1 |
2026-08-18 12:57:56.332726 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 12:57:56.333027 | node1 | Tuesday 18 August 2026  12:57:56 +0000 (0:00:00.135)       0:00:32.951 ********
2026-08-18 12:57:57.338505 | node1 | changed: [node1]
2026-08-18 12:57:57.338948 | node1 | changed: [node3]
2026-08-18 12:57:57.339207 | node1 | changed: [node2]
2026-08-18 12:57:57.339546 | node1 |
2026-08-18 12:57:57.339862 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 12:57:57.340113 | node1 | Tuesday 18 August 2026  12:57:57 +0000 (0:00:01.008)       0:00:33.959 ********
2026-08-18 12:58:03.064465 | node1 | changed: [node1]
2026-08-18 12:58:03.064634 | node1 | changed: [node2]
2026-08-18 12:58:03.064882 | node1 | changed: [node3]
2026-08-18 12:58:03.065100 | node1 |
2026-08-18 12:58:03.065348 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 12:58:03.065609 | node1 | Tuesday 18 August 2026  12:58:03 +0000 (0:00:05.725)       0:00:39.684 ********
2026-08-18 12:58:03.996862 | node1 | ok: [node2]
2026-08-18 12:58:03.997061 | node1 | ok: [node3]
2026-08-18 12:58:03.997301 | node1 | ok: [node1]
2026-08-18 12:58:03.997526 | node1 |
2026-08-18 12:58:03.997842 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 12:58:03.998087 | node1 | Tuesday 18 August 2026  12:58:03 +0000 (0:00:00.932)       0:00:40.617 ********
2026-08-18 12:58:04.406353 | node1 | changed: [node3]
2026-08-18 12:58:04.406564 | node1 | changed: [node2]
2026-08-18 12:58:04.406847 | node1 | changed: [node1]
2026-08-18 12:58:04.407071 | node1 |
2026-08-18 12:58:04.407320 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 12:58:04.407611 | node1 | Tuesday 18 August 2026  12:58:04 +0000 (0:00:00.409)       0:00:41.027 ********
2026-08-18 12:58:05.039951 | node1 | changed: [node1]
2026-08-18 12:58:05.040156 | node1 | changed: [node3]
2026-08-18 12:58:05.040457 | node1 | changed: [node2]
2026-08-18 12:58:05.040745 | node1 |
2026-08-18 12:58:05.041002 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 12:58:05.041255 | node1 | Tuesday 18 August 2026  12:58:05 +0000 (0:00:00.633)       0:00:41.660 ********
2026-08-18 12:58:05.762805 | node1 | changed: [node1] => (item={'path': '/etc/docker'})
2026-08-18 12:58:05.762875 | node1 | changed: [node2] => (item={'path': '/etc/docker'})
2026-08-18 12:58:05.764761 | node1 | changed: [node3] => (item={'path': '/etc/docker'})
2026-08-18 12:58:05.764821 | node1 | changed: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 12:58:05.764833 | node1 | changed: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 12:58:05.764841 | node1 | changed: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 12:58:05.764850 | node1 | changed: [node1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 12:58:05.764858 | node1 | changed: [node2] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 12:58:05.764872 | node1 | changed: [node3] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 12:58:05.765620 | node1 |
2026-08-18 12:58:05.765656 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 12:58:05.765666 | node1 | Tuesday 18 August 2026  12:58:05 +0000 (0:00:00.722)       0:00:42.383 ********
2026-08-18 12:58:06.373015 | node1 | changed: [node1]
2026-08-18 12:58:06.373079 | node1 | changed: [node3]
2026-08-18 12:58:06.373173 | node1 | changed: [node2]
2026-08-18 12:58:06.373274 | node1 |
2026-08-18 12:58:06.373388 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 12:58:06.373504 | node1 | Tuesday 18 August 2026  12:58:06 +0000 (0:00:00.610)       0:00:42.993 ********
2026-08-18 12:58:07.024643 | node1 | changed: [node1]
2026-08-18 12:58:07.024696 | node1 | changed: [node3]
2026-08-18 12:58:07.024706 | node1 | changed: [node2]
2026-08-18 12:58:07.024717 | node1 |
2026-08-18 12:58:07.024727 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 12:58:07.024738 | node1 | Tuesday 18 August 2026  12:58:06 +0000 (0:00:00.622)       0:00:43.616 ********
2026-08-18 12:58:07.024747 | node1 |
2026-08-18 12:58:07.024757 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 12:58:07.024766 | node1 | Tuesday 18 August 2026  12:58:07 +0000 (0:00:00.009)       0:00:43.625 ********
2026-08-18 12:58:07.024971 | node1 |
2026-08-18 12:58:07.025304 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 12:58:07.025659 | node1 | Tuesday 18 August 2026  12:58:07 +0000 (0:00:00.008)       0:00:43.633 ********
2026-08-18 12:58:07.025976 | node1 |
2026-08-18 12:58:07.026306 | node1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-18 12:58:07.026658 | node1 | Tuesday 18 August 2026  12:58:07 +0000 (0:00:00.009)       0:00:43.643 ********
2026-08-18 12:58:07.974197 | node1 | ok: [node1]
2026-08-18 12:58:07.974271 | node1 | ok: [node3]
2026-08-18 12:58:07.974386 | node1 | ok: [node2]
2026-08-18 12:58:07.975631 | node1 |
2026-08-18 12:58:07.975662 | node1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-08-18 12:58:07.975674 | node1 | Tuesday 18 August 2026  12:58:07 +0000 (0:00:00.951)       0:00:44.595 ********
2026-08-18 12:58:09.206092 | node1 | changed: [node3]
2026-08-18 12:58:09.206160 | node1 | changed: [node1]
2026-08-18 12:58:09.206599 | node1 | changed: [node2]
2026-08-18 12:58:09.206616 | node1 |
2026-08-18 12:58:09.206622 | node1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 12:58:09.206628 | node1 | Tuesday 18 August 2026  12:58:09 +0000 (0:00:01.232)       0:00:45.827 ********
2026-08-18 12:58:09.985671 | node1 | changed: [node1]
2026-08-18 12:58:09.985735 | node1 | changed: [node2]
2026-08-18 12:58:09.985749 | node1 | changed: [node3]
2026-08-18 12:58:09.985763 | node1 |
2026-08-18 12:58:09.985776 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 12:58:09.985796 | node1 | Tuesday 18 August 2026  12:58:09 +0000 (0:00:00.777)       0:00:46.604 ********
2026-08-18 12:58:10.062114 | node1 | ok: [node1] => {
2026-08-18 12:58:10.062281 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 12:58:10.062316 | node1 | }
2026-08-18 12:58:10.062339 | node1 | ok: [node2] => {
2026-08-18 12:58:10.063237 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 12:58:10.063284 | node1 | }
2026-08-18 12:58:10.063292 | node1 | ok: [node3] => {
2026-08-18 12:58:10.063298 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 12:58:10.063314 | node1 | }
2026-08-18 12:58:10.063318 | node1 |
2026-08-18 12:58:10.063323 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 12:58:10.063327 | node1 | Tuesday 18 August 2026  12:58:10 +0000 (0:00:00.078)       0:00:46.682 ********
2026-08-18 12:58:11.867805 | node1 | changed: [node2]
2026-08-18 12:58:11.867862 | node1 | changed: [node1]
2026-08-18 12:58:11.867871 | node1 | changed: [node3]
2026-08-18 12:58:11.867880 | node1 |
2026-08-18 12:58:11.867890 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 12:58:11.867899 | node1 | Tuesday 18 August 2026  12:58:11 +0000 (0:00:01.803)       0:00:48.486 ********
2026-08-18 12:58:11.912633 | node1 | skipping: [node1]
2026-08-18 12:58:11.975533 | node1 | skipping: [node2]
2026-08-18 12:58:11.976501 | node1 | skipping: [node3]
2026-08-18 12:58:11.976538 | node1 |
2026-08-18 12:58:11.976549 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 12:58:11.976563 | node1 | Tuesday 18 August 2026  12:58:11 +0000 (0:00:00.108)       0:00:48.595 ********
2026-08-18 12:58:12.059729 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-18 12:58:12.059794 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-18 12:58:12.059800 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-18 12:58:12.059806 | node1 |
2026-08-18 12:58:12.059818 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 12:58:12.060045 | node1 | Tuesday 18 August 2026  12:58:12 +0000 (0:00:00.084)       0:00:48.679 ********
2026-08-18 12:58:13.191964 | node1 | ok: [node1]
2026-08-18 12:58:13.192078 | node1 | ok: [node3]
2026-08-18 12:58:13.192371 | node1 | ok: [node2]
2026-08-18 12:58:13.192630 | node1 |
2026-08-18 12:58:13.192872 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 12:58:13.193113 | node1 | Tuesday 18 August 2026  12:58:13 +0000 (0:00:01.133)       0:00:49.813 ********
2026-08-18 12:58:14.076656 | node1 | ok: [node1] => (item=systemd-timesyncd)
2026-08-18 12:58:14.076846 | node1 | ok: [node2] => (item=systemd-timesyncd)
2026-08-18 12:58:14.077151 | node1 | ok: [node3] => (item=systemd-timesyncd)
2026-08-18 12:58:14.077491 | node1 | ok: [node1] => (item=ssh)
2026-08-18 12:58:14.077823 | node1 | ok: [node3] => (item=ssh)
2026-08-18 12:58:14.078247 | node1 | ok: [node2] => (item=ssh)
2026-08-18 12:58:14.078324 | node1 |
2026-08-18 12:58:14.078568 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 12:58:14.078913 | node1 | Tuesday 18 August 2026  12:58:14 +0000 (0:00:00.884)       0:00:50.697 ********
2026-08-18 12:58:14.389303 | node1 | ok: [node1]
2026-08-18 12:58:14.389384 | node1 | ok: [node2]
2026-08-18 12:58:14.389470 | node1 | ok: [node3]
2026-08-18 12:58:14.389571 | node1 |
2026-08-18 12:58:14.389712 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 12:58:14.389824 | node1 | Tuesday 18 August 2026  12:58:14 +0000 (0:00:00.313)       0:00:51.010 ********
2026-08-18 12:58:14.945230 | node1 | changed: [node3]
2026-08-18 12:58:14.945466 | node1 | changed: [node1]
2026-08-18 12:58:14.945769 | node1 | changed: [node2]
2026-08-18 12:58:14.945983 | node1 |
2026-08-18 12:58:14.946261 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 12:58:14.946507 | node1 | Tuesday 18 August 2026  12:58:14 +0000 (0:00:00.555)       0:00:51.566 ********
2026-08-18 12:58:15.561748 | node1 | changed: [node1]
2026-08-18 12:58:15.562859 | node1 | changed: [node2]
2026-08-18 12:58:15.562915 | node1 | changed: [node3]
2026-08-18 12:58:15.562929 | node1 |
2026-08-18 12:58:15.562941 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 12:58:15.562953 | node1 | Tuesday 18 August 2026  12:58:15 +0000 (0:00:00.616)       0:00:52.182 ********
2026-08-18 12:58:15.641520 | node1 | skipping: [node1]
2026-08-18 12:58:15.641575 | node1 | skipping: [node2]
2026-08-18 12:58:15.641623 | node1 | skipping: [node3]
2026-08-18 12:58:15.641637 | node1 |
2026-08-18 12:58:15.641672 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 12:58:15.641682 | node1 | Tuesday 18 August 2026  12:58:15 +0000 (0:00:00.077)       0:00:52.260 ********
2026-08-18 12:59:06.739791 | node1 | changed: [node1]
2026-08-18 12:59:06.739878 | node1 | changed: [node3]
2026-08-18 12:59:06.739900 | node1 | changed: [node2]
2026-08-18 12:59:06.740010 | node1 |
2026-08-18 12:59:06.740025 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 12:59:06.740065 | node1 | Tuesday 18 August 2026  12:59:06 +0000 (0:00:51.097)       0:01:43.358 ********
2026-08-18 12:59:07.384642 | node1 | changed: [node1]
2026-08-18 12:59:07.384703 | node1 | changed: [node2]
2026-08-18 12:59:07.384715 | node1 | changed: [node3]
2026-08-18 12:59:07.384728 | node1 |
2026-08-18 12:59:07.384741 | node1 | TASK [vexxhost.ceph.mon : Find this monitor's addresses on the public network] ***
2026-08-18 12:59:07.384753 | node1 | Tuesday 18 August 2026  12:59:07 +0000 (0:00:00.645)       0:01:44.003 ********
2026-08-18 12:59:07.516872 | node1 | ok: [node1]
2026-08-18 12:59:07.516904 | node1 | ok: [node3]
2026-08-18 12:59:07.517934 | node1 | ok: [node2]
2026-08-18 12:59:07.517989 | node1 |
2026-08-18 12:59:07.518004 | node1 | TASK [vexxhost.ceph.mon : Assert exactly one address matches the public network] ***
2026-08-18 12:59:07.518018 | node1 | Tuesday 18 August 2026  12:59:07 +0000 (0:00:00.133)       0:01:44.137 ********
2026-08-18 12:59:07.607632 | node1 | ok: [node1] => {
2026-08-18 12:59:07.607683 | node1 |     "changed": false,
2026-08-18 12:59:07.607705 | node1 |     "msg": "All assertions passed"
2026-08-18 12:59:07.607722 | node1 | }
2026-08-18 12:59:07.607735 | node1 | ok: [node2] => {
2026-08-18 12:59:07.607747 | node1 |     "changed": false,
2026-08-18 12:59:07.607759 | node1 |     "msg": "All assertions passed"
2026-08-18 12:59:07.607771 | node1 | }
2026-08-18 12:59:07.607783 | node1 | ok: [node3] => {
2026-08-18 12:59:07.607795 | node1 |     "changed": false,
2026-08-18 12:59:07.608044 | node1 |     "msg": "All assertions passed"
2026-08-18 12:59:07.608415 | node1 | }
2026-08-18 12:59:07.608787 | node1 |
2026-08-18 12:59:07.609154 | node1 | TASK [vexxhost.ceph.mon : Set this monitor's Ceph public IP] *******************
2026-08-18 12:59:07.609511 | node1 | Tuesday 18 August 2026  12:59:07 +0000 (0:00:00.088)       0:01:44.226 ********
2026-08-18 12:59:07.691218 | node1 | ok: [node1]
2026-08-18 12:59:07.691570 | node1 | ok: [node2]
2026-08-18 12:59:07.691941 | node1 | ok: [node3]
2026-08-18 12:59:07.692283 | node1 |
2026-08-18 12:59:07.692661 | node1 | TASK [vexxhost.ceph.mon : Check whether any monitor is already bootstrapped] ***
2026-08-18 12:59:07.693006 | node1 | Tuesday 18 August 2026  12:59:07 +0000 (0:00:00.085)       0:01:44.311 ********
2026-08-18 12:59:08.399769 | node1 | ok: [node1] => (item=node1)
2026-08-18 12:59:08.400195 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 12:59:08.400521 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 12:59:08.400848 | node1 |
2026-08-18 12:59:08.401190 | node1 | TASK [vexxhost.ceph.mon : Select the bootstrap node (existing one, else the first monitor)] ***
2026-08-18 12:59:08.401507 | node1 | Tuesday 18 August 2026  12:59:08 +0000 (0:00:00.708)       0:01:45.020 ********
2026-08-18 12:59:08.498116 | node1 | ok: [node1]
2026-08-18 12:59:08.498158 | node1 | ok: [node2]
2026-08-18 12:59:08.498259 | node1 | ok: [node3]
2026-08-18 12:59:08.498353 | node1 |
2026-08-18 12:59:08.498465 | node1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] *******************************
2026-08-18 12:59:08.498574 | node1 | Tuesday 18 August 2026  12:59:08 +0000 (0:00:00.098)       0:01:45.118 ********
2026-08-18 12:59:08.653283 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap.yml for node1, node2, node3
2026-08-18 12:59:08.653333 | node1 |
2026-08-18 12:59:08.653348 | node1 | TASK [vexxhost.ceph.mon : Ensure /etc/ceph exists] *****************************
2026-08-18 12:59:08.653360 | node1 | Tuesday 18 August 2026  12:59:08 +0000 (0:00:00.154)       0:01:45.273 ********
2026-08-18 12:59:08.897541 | node1 | skipping: [node2]
2026-08-18 12:59:08.897629 | node1 | skipping: [node3]
2026-08-18 12:59:08.897645 | node1 | changed: [node1]
2026-08-18 12:59:08.897658 | node1 |
2026-08-18 12:59:08.897670 | node1 | TASK [vexxhost.ceph.mon : Write the caller-provided SSH private key] ***********
2026-08-18 12:59:08.897705 | node1 | Tuesday 18 August 2026  12:59:08 +0000 (0:00:00.243)       0:01:45.516 ********
2026-08-18 12:59:08.965960 | node1 | skipping: [node1]
2026-08-18 12:59:08.966015 | node1 | skipping: [node2]
2026-08-18 12:59:08.966025 | node1 | skipping: [node3]
2026-08-18 12:59:08.966034 | node1 |
2026-08-18 12:59:08.966043 | node1 | TASK [vexxhost.ceph.mon : Write the caller-provided SSH public key] ************
2026-08-18 12:59:08.966052 | node1 | Tuesday 18 August 2026  12:59:08 +0000 (0:00:00.068)       0:01:45.585 ********
2026-08-18 12:59:09.098419 | node1 | skipping: [node1]
2026-08-18 12:59:09.098453 | node1 | skipping: [node2]
2026-08-18 12:59:09.098462 | node1 | skipping: [node3]
2026-08-18 12:59:09.098471 | node1 |
2026-08-18 12:59:09.098481 | node1 | TASK [vexxhost.ceph.mon : Generate a cephadm SSH keypair when none was provided] ***
2026-08-18 12:59:09.098511 | node1 | Tuesday 18 August 2026  12:59:09 +0000 (0:00:00.132)       0:01:45.717 ********
2026-08-18 12:59:13.122830 | node1 | skipping: [node2]
2026-08-18 12:59:13.122872 | node1 | skipping: [node3]
2026-08-18 12:59:13.122879 | node1 | changed: [node1]
2026-08-18 12:59:13.122886 | node1 |
2026-08-18 12:59:13.122892 | node1 | TASK [vexxhost.ceph.mon : Create a temporary ceph.conf for bootstrap overrides] ***
2026-08-18 12:59:13.122898 | node1 | Tuesday 18 August 2026  12:59:13 +0000 (0:00:04.025)       0:01:49.743 ********
2026-08-18 12:59:13.468553 | node1 | skipping: [node2]
2026-08-18 12:59:13.468647 | node1 | skipping: [node3]
2026-08-18 12:59:13.468666 | node1 | changed: [node1]
2026-08-18 12:59:13.468681 | node1 |
2026-08-18 12:59:13.468696 | node1 | TASK [vexxhost.ceph.mon : Populate bootstrap ceph.conf overrides] **************
2026-08-18 12:59:13.468711 | node1 | Tuesday 18 August 2026  12:59:13 +0000 (0:00:00.344)       0:01:50.088 ********
2026-08-18 12:59:13.505404 | node1 | skipping: [node1]
2026-08-18 12:59:13.547751 | node1 | skipping: [node2]
2026-08-18 12:59:13.547846 | node1 | skipping: [node3]
2026-08-18 12:59:13.547859 | node1 |
2026-08-18 12:59:13.547872 | node1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] *******************************
2026-08-18 12:59:13.547885 | node1 | Tuesday 18 August 2026  12:59:13 +0000 (0:00:00.077)       0:01:50.166 ********
2026-08-18 12:59:54.467611 | node1 | skipping: [node2]
2026-08-18 12:59:54.468190 | node1 | skipping: [node3]
2026-08-18 12:59:54.468203 | node1 | changed: [node1]
2026-08-18 12:59:54.468571 | node1 |
2026-08-18 12:59:54.468856 | node1 | TASK [vexxhost.ceph.mon : Remove the temporary ceph.conf] **********************
2026-08-18 12:59:54.469111 | node1 | Tuesday 18 August 2026  12:59:54 +0000 (0:00:40.922)       0:02:31.088 ********
2026-08-18 12:59:54.731171 | node1 | skipping: [node2]
2026-08-18 12:59:54.731404 | node1 | skipping: [node3]
2026-08-18 12:59:54.731687 | node1 | changed: [node1]
2026-08-18 12:59:54.731930 | node1 |
2026-08-18 12:59:54.732193 | node1 | TASK [Register this monitor host] **********************************************
2026-08-18 12:59:54.732454 | node1 | Tuesday 18 August 2026  12:59:54 +0000 (0:00:00.263)       0:02:31.352 ********
2026-08-18 12:59:54.877093 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3
2026-08-18 12:59:54.877289 | node1 |
2026-08-18 12:59:54.877572 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 12:59:54.877838 | node1 | Tuesday 18 August 2026  12:59:54 +0000 (0:00:00.146)       0:02:31.498 ********
2026-08-18 12:59:56.628718 | node1 | ok: [node1]
2026-08-18 12:59:56.628825 | node1 |
2026-08-18 12:59:56.628936 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 12:59:56.629046 | node1 | Tuesday 18 August 2026  12:59:56 +0000 (0:00:01.751)       0:02:33.249 ********
2026-08-18 12:59:56.712046 | node1 | ok: [node1]
2026-08-18 12:59:56.712107 | node1 | ok: [node2]
2026-08-18 12:59:56.712215 | node1 | ok: [node3]
2026-08-18 12:59:56.712314 | node1 |
2026-08-18 12:59:56.712426 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 12:59:56.712545 | node1 | Tuesday 18 August 2026  12:59:56 +0000 (0:00:00.082)       0:02:33.332 ********
2026-08-18 12:59:56.802240 | node1 | ok: [node1] => {
2026-08-18 12:59:56.802365 | node1 |     "changed": false,
2026-08-18 12:59:56.802517 | node1 |     "msg": "All assertions passed"
2026-08-18 12:59:56.807630 | node1 | }
2026-08-18 12:59:56.807660 | node1 | ok: [node2] => {
2026-08-18 12:59:56.807686 | node1 |     "changed": false,
2026-08-18 12:59:56.807695 | node1 |     "msg": "All assertions passed"
2026-08-18 12:59:56.807703 | node1 | }
2026-08-18 12:59:56.807712 | node1 | ok: [node3] => {
2026-08-18 12:59:56.807720 | node1 |     "changed": false,
2026-08-18 12:59:56.807728 | node1 |     "msg": "All assertions passed"
2026-08-18 12:59:56.807736 | node1 | }
2026-08-18 12:59:56.807745 | node1 |
2026-08-18 12:59:56.807754 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 12:59:56.807763 | node1 | Tuesday 18 August 2026  12:59:56 +0000 (0:00:00.091)       0:02:33.423 ********
2026-08-18 12:59:57.288296 | node1 | ok: [node1]
2026-08-18 12:59:57.288536 | node1 | changed: [node3]
2026-08-18 12:59:57.288904 | node1 | changed: [node2]
2026-08-18 12:59:57.289133 | node1 |
2026-08-18 12:59:57.289401 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 12:59:57.289688 | node1 | Tuesday 18 August 2026  12:59:57 +0000 (0:00:00.486)       0:02:33.909 ********
2026-08-18 12:59:57.375776 | node1 | ok: [node1]
2026-08-18 12:59:57.375977 | node1 | ok: [node2]
2026-08-18 12:59:57.376218 | node1 | ok: [node3]
2026-08-18 12:59:57.376439 | node1 |
2026-08-18 12:59:57.376938 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 12:59:57.377212 | node1 | Tuesday 18 August 2026  12:59:57 +0000 (0:00:00.087)       0:02:33.996 ********
2026-08-18 12:59:57.489525 | node1 | ok: [node1]
2026-08-18 12:59:57.489741 | node1 | ok: [node2]
2026-08-18 12:59:57.489974 | node1 | ok: [node3]
2026-08-18 12:59:57.490194 | node1 |
2026-08-18 12:59:57.490457 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 12:59:57.490786 | node1 | Tuesday 18 August 2026  12:59:57 +0000 (0:00:00.113)       0:02:34.110 ********
2026-08-18 12:59:57.567561 | node1 | ok: [node1] => {
2026-08-18 12:59:57.567799 | node1 |     "changed": false,
2026-08-18 12:59:57.568015 | node1 |     "msg": "All assertions passed"
2026-08-18 12:59:57.568320 | node1 | }
2026-08-18 12:59:57.568671 | node1 | ok: [node2] => {
2026-08-18 12:59:57.568926 | node1 |     "changed": false,
2026-08-18 12:59:57.569169 | node1 |     "msg": "All assertions passed"
2026-08-18 12:59:57.569428 | node1 | }
2026-08-18 12:59:57.569713 | node1 | ok: [node3] => {
2026-08-18 12:59:57.569946 | node1 |     "changed": false,
2026-08-18 12:59:57.570176 | node1 |     "msg": "All assertions passed"
2026-08-18 12:59:57.570433 | node1 | }
2026-08-18 12:59:57.570731 | node1 |
2026-08-18 12:59:57.570977 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 12:59:57.571222 | node1 | Tuesday 18 August 2026  12:59:57 +0000 (0:00:00.078)       0:02:34.188 ********
2026-08-18 13:00:18.410945 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:00:18.411200 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:00:18.411463 | node1 | changed: [node1]
2026-08-18 13:00:18.411748 | node1 |
2026-08-18 13:00:18.412027 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 13:00:18.412295 | node1 | Tuesday 18 August 2026  13:00:18 +0000 (0:00:20.843)       0:02:55.031 ********
2026-08-18 13:00:18.520314 | node1 | skipping: [node1]
2026-08-18 13:00:18.520435 | node1 | skipping: [node2]
2026-08-18 13:00:18.520623 | node1 | skipping: [node3]
2026-08-18 13:00:18.520858 | node1 |
2026-08-18 13:00:18.521030 | node1 | TASK [vexxhost.ceph.mon : Apply the monitor service spec] **********************
2026-08-18 13:00:18.521184 | node1 | Tuesday 18 August 2026  13:00:18 +0000 (0:00:00.109)       0:02:55.141 ********
2026-08-18 13:00:21.926823 | node1 | changed: [node1]
2026-08-18 13:00:21.926998 | node1 |
2026-08-18 13:00:21.927252 | node1 | TASK [vexxhost.ceph.mon : Wait for this monitor's daemon to be present] ********
2026-08-18 13:00:21.927524 | node1 | Tuesday 18 August 2026  13:00:21 +0000 (0:00:03.406)       0:02:58.547 ********
2026-08-18 13:00:30.035891 | node1 | ok: [node1]
2026-08-18 13:00:30.035968 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:00:30.035982 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:00:30.035998 | node1 |
2026-08-18 13:00:30.036014 | node1 | TASK [vexxhost.ceph.mgr : Locate the cluster admin host] ***********************
2026-08-18 13:00:30.036066 | node1 | Tuesday 18 August 2026  13:00:30 +0000 (0:00:08.107)       0:03:06.655 ********
2026-08-18 13:00:31.044545 | node1 | ok: [node1] => (item=node1)
2026-08-18 13:00:31.044623 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 13:00:31.044639 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 13:00:31.044648 | node1 |
2026-08-18 13:00:31.044658 | node1 | TASK [vexxhost.ceph.mgr : Select the admin host] *******************************
2026-08-18 13:00:31.044667 | node1 | Tuesday 18 August 2026  13:00:31 +0000 (0:00:01.008)       0:03:07.663 ********
2026-08-18 13:00:31.138549 | node1 | ok: [node1]
2026-08-18 13:00:31.138635 | node1 | ok: [node2]
2026-08-18 13:00:31.138650 | node1 | ok: [node3]
2026-08-18 13:00:31.138659 | node1 |
2026-08-18 13:00:31.138669 | node1 | TASK [Register this manager host] **********************************************
2026-08-18 13:00:31.138678 | node1 | Tuesday 18 August 2026  13:00:31 +0000 (0:00:00.093)       0:03:07.757 ********
2026-08-18 13:00:31.276420 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3
2026-08-18 13:00:31.276485 | node1 |
2026-08-18 13:00:31.276498 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 13:00:31.276508 | node1 | Tuesday 18 August 2026  13:00:31 +0000 (0:00:00.138)       0:03:07.896 ********
2026-08-18 13:00:32.996287 | node1 | ok: [node1]
2026-08-18 13:00:32.996348 | node1 |
2026-08-18 13:00:32.996363 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 13:00:32.996376 | node1 | Tuesday 18 August 2026  13:00:32 +0000 (0:00:01.719)       0:03:09.615 ********
2026-08-18 13:00:33.080789 | node1 | ok: [node1]
2026-08-18 13:00:33.080853 | node1 | ok: [node2]
2026-08-18 13:00:33.081493 | node1 | ok: [node3]
2026-08-18 13:00:33.081538 | node1 |
2026-08-18 13:00:33.081546 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 13:00:33.081553 | node1 | Tuesday 18 August 2026  13:00:33 +0000 (0:00:00.085)       0:03:09.701 ********
2026-08-18 13:00:33.167052 | node1 | ok: [node1] => {
2026-08-18 13:00:33.167117 | node1 |     "changed": false,
2026-08-18 13:00:33.168500 | node1 |     "msg": "All assertions passed"
2026-08-18 13:00:33.168533 | node1 | }
2026-08-18 13:00:33.168539 | node1 | ok: [node2] => {
2026-08-18 13:00:33.168544 | node1 |     "changed": false,
2026-08-18 13:00:33.168550 | node1 |     "msg": "All assertions passed"
2026-08-18 13:00:33.168555 | node1 | }
2026-08-18 13:00:33.168560 | node1 | ok: [node3] => {
2026-08-18 13:00:33.168565 | node1 |     "changed": false,
2026-08-18 13:00:33.168570 | node1 |     "msg": "All assertions passed"
2026-08-18 13:00:33.168575 | node1 | }
2026-08-18 13:00:33.168599 | node1 |
2026-08-18 13:00:33.168606 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 13:00:33.168612 | node1 | Tuesday 18 August 2026  13:00:33 +0000 (0:00:00.086)       0:03:09.787 ********
2026-08-18 13:00:33.530650 | node1 | ok: [node1]
2026-08-18 13:00:33.530692 | node1 | ok: [node3]
2026-08-18 13:00:33.530700 | node1 | ok: [node2]
2026-08-18 13:00:33.530708 | node1 |
2026-08-18 13:00:33.530720 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 13:00:33.530861 | node1 | Tuesday 18 August 2026  13:00:33 +0000 (0:00:00.363)       0:03:10.150 ********
2026-08-18 13:00:33.620075 | node1 | ok: [node1]
2026-08-18 13:00:33.620173 | node1 | ok: [node2]
2026-08-18 13:00:33.620270 | node1 | ok: [node3]
2026-08-18 13:00:33.620372 | node1 |
2026-08-18 13:00:33.620648 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 13:00:33.620683 | node1 | Tuesday 18 August 2026  13:00:33 +0000 (0:00:00.089)       0:03:10.240 ********
2026-08-18 13:00:33.750691 | node1 | ok: [node1]
2026-08-18 13:00:33.750760 | node1 | ok: [node2]
2026-08-18 13:00:33.750774 | node1 | ok: [node3]
2026-08-18 13:00:33.750787 | node1 |
2026-08-18 13:00:33.750832 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 13:00:33.750844 | node1 | Tuesday 18 August 2026  13:00:33 +0000 (0:00:00.129)       0:03:10.369 ********
2026-08-18 13:00:33.834649 | node1 | ok: [node1] => {
2026-08-18 13:00:33.834696 | node1 |     "changed": false,
2026-08-18 13:00:33.834731 | node1 |     "msg": "All assertions passed"
2026-08-18 13:00:33.834740 | node1 | }
2026-08-18 13:00:33.834749 | node1 | ok: [node2] => {
2026-08-18 13:00:33.834757 | node1 |     "changed": false,
2026-08-18 13:00:33.834796 | node1 |     "msg": "All assertions passed"
2026-08-18 13:00:33.834804 | node1 | }
2026-08-18 13:00:33.834813 | node1 | ok: [node3] => {
2026-08-18 13:00:33.834821 | node1 |     "changed": false,
2026-08-18 13:00:33.835123 | node1 |     "msg": "All assertions passed"
2026-08-18 13:00:33.835420 | node1 | }
2026-08-18 13:00:33.835739 | node1 |
2026-08-18 13:00:33.836065 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 13:00:33.836407 | node1 | Tuesday 18 August 2026  13:00:33 +0000 (0:00:00.083)       0:03:10.453 ********
2026-08-18 13:00:35.676004 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:00:35.676120 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:00:35.676262 | node1 | ok: [node1]
2026-08-18 13:00:35.676390 | node1 |
2026-08-18 13:00:35.676542 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 13:00:35.676722 | node1 | Tuesday 18 August 2026  13:00:35 +0000 (0:00:01.842)       0:03:12.295 ********
2026-08-18 13:00:35.794520 | node1 | skipping: [node1]
2026-08-18 13:00:35.794576 | node1 | skipping: [node2]
2026-08-18 13:00:35.794815 | node1 | skipping: [node3]
2026-08-18 13:00:35.794886 | node1 |
2026-08-18 13:00:35.794904 | node1 | TASK [vexxhost.ceph.mgr : Apply the manager service spec] **********************
2026-08-18 13:00:35.795043 | node1 | Tuesday 18 August 2026  13:00:35 +0000 (0:00:00.120)       0:03:12.415 ********
2026-08-18 13:00:45.062094 | node1 | changed: [node1]
2026-08-18 13:00:45.062148 | node1 |
2026-08-18 13:00:45.062161 | node1 | TASK [vexxhost.ceph.mgr : Wait for this manager's daemon to be present] ********
2026-08-18 13:00:45.062174 | node1 | Tuesday 18 August 2026  13:00:45 +0000 (0:00:09.266)       0:03:21.682 ********
2026-08-18 13:00:46.824499 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:00:46.824564 | node1 | ok: [node1]
2026-08-18 13:00:46.824578 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:00:46.824620 | node1 |
2026-08-18 13:00:46.824633 | node1 | TASK [vexxhost.ceph.mgr : Configure ceph-mgr modules] **************************
2026-08-18 13:00:46.824645 | node1 | Tuesday 18 August 2026  13:00:46 +0000 (0:00:01.761)       0:03:23.444 ********
2026-08-18 13:00:57.140886 | node1 | changed: [node1] => (item={'name': 'diskprediction_local'})
2026-08-18 13:00:57.140928 | node1 | changed: [node1] => (item={'name': 'dashboard'})
2026-08-18 13:00:57.140934 | node1 | ok: [node1] => (item={'name': 'iostat'})
2026-08-18 13:00:57.140939 | node1 | changed: [node1] => (item={'name': 'prometheus'})
2026-08-18 13:00:57.140944 | node1 | changed: [node1] => (item={'name': 'rgw'})
2026-08-18 13:00:57.140950 | node1 |
2026-08-18 13:00:57.140955 | node1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-08-18 13:00:57.140961 | node1 |
2026-08-18 13:00:57.140966 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 13:00:57.140972 | node1 | Tuesday 18 August 2026  13:00:57 +0000 (0:00:10.315)       0:03:33.759 ********
2026-08-18 13:00:59.199073 | node1 | ok: [node1]
2026-08-18 13:00:59.199303 | node1 | ok: [node3]
2026-08-18 13:00:59.199514 | node1 | ok: [node2]
2026-08-18 13:00:59.199741 | node1 |
2026-08-18 13:00:59.199947 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:00:59.200145 | node1 | Tuesday 18 August 2026  13:00:59 +0000 (0:00:02.058)       0:03:35.817 ********
2026-08-18 13:00:59.509685 | node1 | ok: [node1]
2026-08-18 13:00:59.509717 | node1 | ok: [node2]
2026-08-18 13:00:59.509723 | node1 | ok: [node3]
2026-08-18 13:00:59.509729 | node1 |
2026-08-18 13:00:59.509734 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:00:59.509740 | node1 | Tuesday 18 August 2026  13:00:59 +0000 (0:00:00.311)       0:03:36.128 ********
2026-08-18 13:00:59.601134 | node1 | skipping: [node1]
2026-08-18 13:00:59.601306 | node1 | skipping: [node2]
2026-08-18 13:00:59.604068 | node1 | skipping: [node3]
2026-08-18 13:00:59.604082 | node1 |
2026-08-18 13:00:59.604088 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 13:00:59.604105 | node1 | Tuesday 18 August 2026  13:00:59 +0000 (0:00:00.093)       0:03:36.222 ********
2026-08-18 13:00:59.942940 | node1 | ok: [node1]
2026-08-18 13:00:59.942976 | node1 | ok: [node2]
2026-08-18 13:00:59.942982 | node1 | ok: [node3]
2026-08-18 13:00:59.942987 | node1 |
2026-08-18 13:00:59.942993 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:00:59.942998 | node1 | Tuesday 18 August 2026  13:00:59 +0000 (0:00:00.340)       0:03:36.562 ********
2026-08-18 13:01:00.048329 | node1 | ok: [node1] => {
2026-08-18 13:01:00.048361 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:01:00.048366 | node1 | }
2026-08-18 13:01:00.048370 | node1 | ok: [node2] => {
2026-08-18 13:01:00.048374 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:01:00.048378 | node1 | }
2026-08-18 13:01:00.048381 | node1 | ok: [node3] => {
2026-08-18 13:01:00.048385 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:01:00.048389 | node1 | }
2026-08-18 13:01:00.048393 | node1 |
2026-08-18 13:01:00.048397 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:01:00.048401 | node1 | Tuesday 18 August 2026  13:01:00 +0000 (0:00:00.103)       0:03:36.666 ********
2026-08-18 13:01:00.453494 | node1 | ok: [node1]
2026-08-18 13:01:00.453882 | node1 | ok: [node2]
2026-08-18 13:01:00.454189 | node1 | ok: [node3]
2026-08-18 13:01:00.454470 | node1 |
2026-08-18 13:01:00.454813 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:01:00.455125 | node1 | Tuesday 18 August 2026  13:01:00 +0000 (0:00:00.408)       0:03:37.074 ********
2026-08-18 13:01:00.566134 | node1 | skipping: [node1]
2026-08-18 13:01:00.566368 | node1 | skipping: [node2]
2026-08-18 13:01:00.566564 | node1 | skipping: [node3]
2026-08-18 13:01:00.566818 | node1 |
2026-08-18 13:01:00.567148 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:01:00.567461 | node1 | Tuesday 18 August 2026  13:01:00 +0000 (0:00:00.112)       0:03:37.186 ********
2026-08-18 13:01:00.676239 | node1 | skipping: [node1]
2026-08-18 13:01:00.676483 | node1 | skipping: [node2]
2026-08-18 13:01:00.676700 | node1 | skipping: [node3]
2026-08-18 13:01:00.676993 | node1 |
2026-08-18 13:01:00.677305 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:01:00.677639 | node1 | Tuesday 18 August 2026  13:01:00 +0000 (0:00:00.110)       0:03:37.297 ********
2026-08-18 13:01:00.968310 | node1 | ok: [node1]
2026-08-18 13:01:00.968701 | node1 | ok: [node3]
2026-08-18 13:01:00.968896 | node1 | ok: [node2]
2026-08-18 13:01:00.969027 | node1 |
2026-08-18 13:01:00.969171 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:01:00.969313 | node1 | Tuesday 18 August 2026  13:01:00 +0000 (0:00:00.291)       0:03:37.588 ********
2026-08-18 13:01:02.249405 | node1 | ok: [node1]
2026-08-18 13:01:02.249862 | node1 | ok: [node3]
2026-08-18 13:01:02.250193 | node1 | ok: [node2]
2026-08-18 13:01:02.250485 | node1 |
2026-08-18 13:01:02.250877 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:01:02.251247 | node1 | Tuesday 18 August 2026  13:01:02 +0000 (0:00:01.281)       0:03:38.870 ********
2026-08-18 13:01:02.345806 | node1 | ok: [node1] => {
2026-08-18 13:01:02.345934 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:01:02.346317 | node1 | }
2026-08-18 13:01:02.346567 | node1 | ok: [node2] => {
2026-08-18 13:01:02.346885 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:01:02.347124 | node1 | }
2026-08-18 13:01:02.347404 | node1 | ok: [node3] => {
2026-08-18 13:01:02.347778 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:01:02.347969 | node1 | }
2026-08-18 13:01:02.348189 | node1 |
2026-08-18 13:01:02.348438 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:01:02.348827 | node1 | Tuesday 18 August 2026  13:01:02 +0000 (0:00:00.096)       0:03:38.967 ********
2026-08-18 13:01:02.774061 | node1 | ok: [node1]
2026-08-18 13:01:02.774159 | node1 | ok: [node3]
2026-08-18 13:01:02.775647 | node1 | ok: [node2]
2026-08-18 13:01:02.775687 | node1 |
2026-08-18 13:01:02.775697 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:01:02.775705 | node1 | Tuesday 18 August 2026  13:01:02 +0000 (0:00:00.427)       0:03:39.394 ********
2026-08-18 13:01:04.996758 | node1 | ok: [node1]
2026-08-18 13:01:04.996823 | node1 | ok: [node3]
2026-08-18 13:01:04.996836 | node1 | ok: [node2]
2026-08-18 13:01:04.996908 | node1 |
2026-08-18 13:01:04.997153 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 13:01:04.997392 | node1 | Tuesday 18 August 2026  13:01:04 +0000 (0:00:02.222)       0:03:41.617 ********
2026-08-18 13:01:05.059368 | node1 | skipping: [node1]
2026-08-18 13:01:05.059565 | node1 | skipping: [node2]
2026-08-18 13:01:05.059834 | node1 | skipping: [node3]
2026-08-18 13:01:05.060049 | node1 |
2026-08-18 13:01:05.060293 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 13:01:05.060530 | node1 | Tuesday 18 August 2026  13:01:05 +0000 (0:00:00.063)       0:03:41.680 ********
2026-08-18 13:01:05.128610 | node1 | skipping: [node1]
2026-08-18 13:01:05.128731 | node1 | skipping: [node2]
2026-08-18 13:01:05.128888 | node1 | skipping: [node3]
2026-08-18 13:01:05.129036 | node1 |
2026-08-18 13:01:05.129208 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 13:01:05.129370 | node1 | Tuesday 18 August 2026  13:01:05 +0000 (0:00:00.069)       0:03:41.749 ********
2026-08-18 13:01:05.210945 | node1 | skipping: [node1]
2026-08-18 13:01:05.211168 | node1 | skipping: [node2]
2026-08-18 13:01:05.211436 | node1 | skipping: [node3]
2026-08-18 13:01:05.211696 | node1 |
2026-08-18 13:01:05.211961 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 13:01:05.212225 | node1 | Tuesday 18 August 2026  13:01:05 +0000 (0:00:00.081)       0:03:41.831 ********
2026-08-18 13:01:06.165738 | node1 | ok: [node2]
2026-08-18 13:01:06.165968 | node1 | ok: [node3]
2026-08-18 13:01:06.166205 | node1 | ok: [node1]
2026-08-18 13:01:06.166424 | node1 |
2026-08-18 13:01:06.166718 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 13:01:06.166963 | node1 | Tuesday 18 August 2026  13:01:06 +0000 (0:00:00.955)       0:03:42.786 ********
2026-08-18 13:01:06.717964 | node1 | ok: [node1]
2026-08-18 13:01:06.718041 | node1 | ok: [node3]
2026-08-18 13:01:06.718146 | node1 | ok: [node2]
2026-08-18 13:01:06.718245 | node1 |
2026-08-18 13:01:06.718354 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 13:01:06.718464 | node1 | Tuesday 18 August 2026  13:01:06 +0000 (0:00:00.552)       0:03:43.339 ********
2026-08-18 13:01:07.925764 | node1 | ok: [node1] => (item={'path': '/etc/containerd'})
2026-08-18 13:01:07.925827 | node1 | ok: [node2] => (item={'path': '/etc/containerd'})
2026-08-18 13:01:07.925840 | node1 | ok: [node3] => (item={'path': '/etc/containerd'})
2026-08-18 13:01:07.925858 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:01:07.927650 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:01:07.927712 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:01:07.927724 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:01:07.927736 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:01:07.927747 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:01:07.927759 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:01:07.927829 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:01:07.928060 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:01:07.928263 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:01:07.928466 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:01:07.928712 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:01:07.928895 | node1 |
2026-08-18 13:01:07.929086 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 13:01:07.929283 | node1 | Tuesday 18 August 2026  13:01:07 +0000 (0:00:01.206)       0:03:44.545 ********
2026-08-18 13:01:08.618275 | node1 | ok: [node1]
2026-08-18 13:01:08.618678 | node1 | ok: [node2]
2026-08-18 13:01:08.619000 | node1 | ok: [node3]
2026-08-18 13:01:08.619293 | node1 |
2026-08-18 13:01:08.619647 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:01:08.619973 | node1 | Tuesday 18 August 2026  13:01:08 +0000 (0:00:00.675)       0:03:45.221 ********
2026-08-18 13:01:08.620262 | node1 |
2026-08-18 13:01:08.620580 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:01:08.620969 | node1 | Tuesday 18 August 2026  13:01:08 +0000 (0:00:00.006)       0:03:45.227 ********
2026-08-18 13:01:08.621259 | node1 |
2026-08-18 13:01:08.621571 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:01:08.621915 | node1 | Tuesday 18 August 2026  13:01:08 +0000 (0:00:00.006)       0:03:45.233 ********
2026-08-18 13:01:08.622199 | node1 |
2026-08-18 13:01:08.622511 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 13:01:08.622850 | node1 | Tuesday 18 August 2026  13:01:08 +0000 (0:00:00.006)       0:03:45.239 ********
2026-08-18 13:01:09.134147 | node1 | ok: [node1]
2026-08-18 13:01:09.134229 | node1 | ok: [node2]
2026-08-18 13:01:09.134244 | node1 | ok: [node3]
2026-08-18 13:01:09.134336 | node1 |
2026-08-18 13:01:09.134443 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:01:09.134556 | node1 | Tuesday 18 August 2026  13:01:09 +0000 (0:00:00.515)       0:03:45.755 ********
2026-08-18 13:01:09.456666 | node1 | ok: [node1]
2026-08-18 13:01:09.456721 | node1 | ok: [node2]
2026-08-18 13:01:09.457681 | node1 | ok: [node3]
2026-08-18 13:01:09.457743 | node1 |
2026-08-18 13:01:09.457757 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:01:09.457770 | node1 | Tuesday 18 August 2026  13:01:09 +0000 (0:00:00.322)       0:03:46.077 ********
2026-08-18 13:01:09.553639 | node1 | ok: [node1] => {
2026-08-18 13:01:09.553693 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:01:09.553706 | node1 | }
2026-08-18 13:01:09.553719 | node1 | ok: [node2] => {
2026-08-18 13:01:09.553731 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:01:09.553743 | node1 | }
2026-08-18 13:01:09.553755 | node1 | ok: [node3] => {
2026-08-18 13:01:09.553766 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:01:09.553778 | node1 | }
2026-08-18 13:01:09.553890 | node1 |
2026-08-18 13:01:09.554257 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:01:09.554573 | node1 | Tuesday 18 August 2026  13:01:09 +0000 (0:00:00.094)       0:03:46.171 ********
2026-08-18 13:01:10.059292 | node1 | ok: [node1]
2026-08-18 13:01:10.059678 | node1 | ok: [node2]
2026-08-18 13:01:10.059982 | node1 | ok: [node3]
2026-08-18 13:01:10.060261 | node1 |
2026-08-18 13:01:10.060627 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:01:10.060941 | node1 | Tuesday 18 August 2026  13:01:10 +0000 (0:00:00.508)       0:03:46.680 ********
2026-08-18 13:01:14.378030 | node1 | ok: [node1]
2026-08-18 13:01:14.378115 | node1 | ok: [node2]
2026-08-18 13:01:14.378156 | node1 | ok: [node3]
2026-08-18 13:01:14.378273 | node1 |
2026-08-18 13:01:14.378386 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 13:01:14.378499 | node1 | Tuesday 18 August 2026  13:01:14 +0000 (0:00:04.319)       0:03:50.999 ********
2026-08-18 13:01:15.684906 | node1 | ok: [node1]
2026-08-18 13:01:15.684949 | node1 | ok: [node2]
2026-08-18 13:01:15.684957 | node1 | ok: [node3]
2026-08-18 13:01:15.684965 | node1 |
2026-08-18 13:01:15.684973 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 13:01:15.684995 | node1 | Tuesday 18 August 2026  13:01:15 +0000 (0:00:01.303)       0:03:52.303 ********
2026-08-18 13:01:16.033797 | node1 | ok: [node1]
2026-08-18 13:01:16.033831 | node1 | ok: [node2]
2026-08-18 13:01:16.033838 | node1 | ok: [node3]
2026-08-18 13:01:16.033844 | node1 |
2026-08-18 13:01:16.033849 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 13:01:16.033855 | node1 | Tuesday 18 August 2026  13:01:16 +0000 (0:00:00.349)       0:03:52.652 ********
2026-08-18 13:01:16.632266 | node1 | ok: [node1]
2026-08-18 13:01:16.632676 | node1 | ok: [node2]
2026-08-18 13:01:16.632993 | node1 | ok: [node3]
2026-08-18 13:01:16.633285 | node1 |
2026-08-18 13:01:16.633626 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 13:01:16.633944 | node1 | Tuesday 18 August 2026  13:01:16 +0000 (0:00:00.600)       0:03:53.252 ********
2026-08-18 13:01:17.375411 | node1 | ok: [node1] => (item={'path': '/etc/docker'})
2026-08-18 13:01:17.375480 | node1 | ok: [node2] => (item={'path': '/etc/docker'})
2026-08-18 13:01:17.375625 | node1 | ok: [node3] => (item={'path': '/etc/docker'})
2026-08-18 13:01:17.376049 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:01:17.376070 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:01:17.376082 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:01:17.376097 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:01:17.376205 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:01:17.376329 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:01:17.376465 | node1 |
2026-08-18 13:01:17.376612 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 13:01:17.376736 | node1 | Tuesday 18 August 2026  13:01:17 +0000 (0:00:00.742)       0:03:53.994 ********
2026-08-18 13:01:17.991058 | node1 | ok: [node1]
2026-08-18 13:01:17.991130 | node1 | ok: [node3]
2026-08-18 13:01:17.991225 | node1 | ok: [node2]
2026-08-18 13:01:17.991324 | node1 |
2026-08-18 13:01:17.991438 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 13:01:17.991548 | node1 | Tuesday 18 August 2026  13:01:17 +0000 (0:00:00.610)       0:03:54.605 ********
2026-08-18 13:01:18.604321 | node1 | ok: [node1]
2026-08-18 13:01:18.604508 | node1 | ok: [node2]
2026-08-18 13:01:18.604805 | node1 | ok: [node3]
2026-08-18 13:01:18.605012 | node1 |
2026-08-18 13:01:18.605326 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:01:18.605571 | node1 | Tuesday 18 August 2026  13:01:18 +0000 (0:00:00.598)       0:03:55.203 ********
2026-08-18 13:01:18.605828 | node1 |
2026-08-18 13:01:18.606070 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:01:18.606308 | node1 | Tuesday 18 August 2026  13:01:18 +0000 (0:00:00.008)       0:03:55.212 ********
2026-08-18 13:01:18.606526 | node1 |
2026-08-18 13:01:18.606801 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:01:18.607025 | node1 | Tuesday 18 August 2026  13:01:18 +0000 (0:00:00.006)       0:03:55.218 ********
2026-08-18 13:01:18.607242 | node1 |
2026-08-18 13:01:18.607499 | node1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 13:01:18.607759 | node1 | Tuesday 18 August 2026  13:01:18 +0000 (0:00:00.006)       0:03:55.225 ********
2026-08-18 13:01:19.108311 | node1 | ok: [node1]
2026-08-18 13:01:19.108528 | node1 | ok: [node2]
2026-08-18 13:01:19.108796 | node1 | ok: [node3]
2026-08-18 13:01:19.109010 | node1 |
2026-08-18 13:01:19.109260 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:01:19.109501 | node1 | Tuesday 18 August 2026  13:01:19 +0000 (0:00:00.503)       0:03:55.729 ********
2026-08-18 13:01:19.169361 | node1 | ok: [node1] => {
2026-08-18 13:01:19.169525 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:01:19.169712 | node1 | }
2026-08-18 13:01:19.169876 | node1 | ok: [node2] => {
2026-08-18 13:01:19.170076 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:01:19.170234 | node1 | }
2026-08-18 13:01:19.170391 | node1 | ok: [node3] => {
2026-08-18 13:01:19.170553 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:01:19.170726 | node1 | }
2026-08-18 13:01:19.170870 | node1 |
2026-08-18 13:01:19.171032 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:01:19.171192 | node1 | Tuesday 18 August 2026  13:01:19 +0000 (0:00:00.061)       0:03:55.790 ********
2026-08-18 13:01:19.537745 | node1 | ok: [node1]
2026-08-18 13:01:19.537811 | node1 | ok: [node3]
2026-08-18 13:01:19.538007 | node1 | ok: [node2]
2026-08-18 13:01:19.538291 | node1 |
2026-08-18 13:01:19.538635 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:01:19.538948 | node1 | Tuesday 18 August 2026  13:01:19 +0000 (0:00:00.367)       0:03:56.158 ********
2026-08-18 13:01:19.626813 | node1 | skipping: [node1]
2026-08-18 13:01:19.626868 | node1 | skipping: [node2]
2026-08-18 13:01:19.626878 | node1 | skipping: [node3]
2026-08-18 13:01:19.626887 | node1 |
2026-08-18 13:01:19.627037 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 13:01:19.627308 | node1 | Tuesday 18 August 2026  13:01:19 +0000 (0:00:00.088)       0:03:56.246 ********
2026-08-18 13:01:19.704059 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-18 13:01:19.704146 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-18 13:01:19.705013 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-18 13:01:19.705049 | node1 |
2026-08-18 13:01:19.705057 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 13:01:19.705065 | node1 | Tuesday 18 August 2026  13:01:19 +0000 (0:00:00.077)       0:03:56.324 ********
2026-08-18 13:01:20.828755 | node1 | ok: [node1]
2026-08-18 13:01:20.828822 | node1 | ok: [node2]
2026-08-18 13:01:20.828869 | node1 | ok: [node3]
2026-08-18 13:01:20.829682 | node1 |
2026-08-18 13:01:20.829738 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 13:01:20.829749 | node1 | Tuesday 18 August 2026  13:01:20 +0000 (0:00:01.124)       0:03:57.449 ********
2026-08-18 13:01:21.708553 | node1 | ok: [node1] => (item=systemd-timesyncd)
2026-08-18 13:01:21.708619 | node1 | ok: [node2] => (item=systemd-timesyncd)
2026-08-18 13:01:21.708856 | node1 | ok: [node3] => (item=systemd-timesyncd)
2026-08-18 13:01:21.709115 | node1 | ok: [node1] => (item=ssh)
2026-08-18 13:01:21.709364 | node1 | ok: [node2] => (item=ssh)
2026-08-18 13:01:21.709569 | node1 | ok: [node3] => (item=ssh)
2026-08-18 13:01:21.709860 | node1 |
2026-08-18 13:01:21.710035 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 13:01:21.710299 | node1 | Tuesday 18 August 2026  13:01:21 +0000 (0:00:00.879)       0:03:58.328 ********
2026-08-18 13:01:21.988752 | node1 | ok: [node1]
2026-08-18 13:01:21.988813 | node1 | ok: [node2]
2026-08-18 13:01:21.988965 | node1 | ok: [node3]
2026-08-18 13:01:21.989103 | node1 |
2026-08-18 13:01:21.989264 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 13:01:21.989450 | node1 | Tuesday 18 August 2026  13:01:21 +0000 (0:00:00.280)       0:03:58.609 ********
2026-08-18 13:01:22.342740 | node1 | ok: [node1]
2026-08-18 13:01:22.342799 | node1 | ok: [node2]
2026-08-18 13:01:22.342841 | node1 | ok: [node3]
2026-08-18 13:01:22.343078 | node1 |
2026-08-18 13:01:22.343365 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 13:01:22.343652 | node1 | Tuesday 18 August 2026  13:01:22 +0000 (0:00:00.353)       0:03:58.963 ********
2026-08-18 13:01:22.922451 | node1 | ok: [node2]
2026-08-18 13:01:22.922578 | node1 | ok: [node1]
2026-08-18 13:01:22.922765 | node1 | ok: [node3]
2026-08-18 13:01:22.922910 | node1 |
2026-08-18 13:01:22.923070 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 13:01:22.923225 | node1 | Tuesday 18 August 2026  13:01:22 +0000 (0:00:00.580)       0:03:59.543 ********
2026-08-18 13:01:22.995850 | node1 | skipping: [node1]
2026-08-18 13:01:22.995978 | node1 | skipping: [node2]
2026-08-18 13:01:22.996130 | node1 | skipping: [node3]
2026-08-18 13:01:22.996274 | node1 |
2026-08-18 13:01:22.996439 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 13:01:22.996627 | node1 | Tuesday 18 August 2026  13:01:22 +0000 (0:00:00.073)       0:03:59.617 ********
2026-08-18 13:01:23.443153 | node1 | ok: [node2]
2026-08-18 13:01:23.443359 | node1 | ok: [node3]
2026-08-18 13:01:23.443636 | node1 | ok: [node1]
2026-08-18 13:01:23.443880 | node1 |
2026-08-18 13:01:23.444168 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 13:01:23.444429 | node1 | Tuesday 18 August 2026  13:01:23 +0000 (0:00:00.447)       0:04:00.064 ********
2026-08-18 13:01:24.083666 | node1 | ok: [node1]
2026-08-18 13:01:24.083741 | node1 | ok: [node2]
2026-08-18 13:01:24.083750 | node1 | ok: [node3]
2026-08-18 13:01:24.083763 | node1 |
2026-08-18 13:01:24.084028 | node1 | TASK [vexxhost.ceph.osd : Locate the cluster admin host] ***********************
2026-08-18 13:01:24.084279 | node1 | Tuesday 18 August 2026  13:01:24 +0000 (0:00:00.639)       0:04:00.704 ********
2026-08-18 13:01:24.817156 | node1 | ok: [node1] => (item=node1)
2026-08-18 13:01:24.817407 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 13:01:24.817707 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 13:01:24.818027 | node1 |
2026-08-18 13:01:24.818313 | node1 | TASK [vexxhost.ceph.osd : Select the admin host and its mon config path] *******
2026-08-18 13:01:24.818613 | node1 | Tuesday 18 August 2026  13:01:24 +0000 (0:00:00.733)       0:04:01.437 ********
2026-08-18 13:01:24.900715 | node1 | ok: [node1]
2026-08-18 13:01:24.901081 | node1 | ok: [node2]
2026-08-18 13:01:24.901463 | node1 | ok: [node3]
2026-08-18 13:01:24.901864 | node1 |
2026-08-18 13:01:24.902263 | node1 | TASK [vexxhost.ceph.osd : Set the admin mon config path] ***********************
2026-08-18 13:01:24.902618 | node1 | Tuesday 18 August 2026  13:01:24 +0000 (0:00:00.084)       0:04:01.521 ********
2026-08-18 13:01:24.988072 | node1 | ok: [node1]
2026-08-18 13:01:24.988328 | node1 | ok: [node2]
2026-08-18 13:01:24.988595 | node1 | ok: [node3]
2026-08-18 13:01:24.988859 | node1 |
2026-08-18 13:01:24.989121 | node1 | TASK [Register this OSD host] **************************************************
2026-08-18 13:01:24.989389 | node1 | Tuesday 18 August 2026  13:01:24 +0000 (0:00:00.087)       0:04:01.609 ********
2026-08-18 13:01:25.102632 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3
2026-08-18 13:01:25.102948 | node1 |
2026-08-18 13:01:25.103215 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 13:01:25.103458 | node1 | Tuesday 18 August 2026  13:01:25 +0000 (0:00:00.114)       0:04:01.723 ********
2026-08-18 13:01:26.770698 | node1 | ok: [node1]
2026-08-18 13:01:26.770770 | node1 |
2026-08-18 13:01:26.770792 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 13:01:26.771079 | node1 | Tuesday 18 August 2026  13:01:26 +0000 (0:00:01.667)       0:04:03.391 ********
2026-08-18 13:01:26.844104 | node1 | ok: [node1]
2026-08-18 13:01:26.844158 | node1 | ok: [node2]
2026-08-18 13:01:26.844259 | node1 | ok: [node3]
2026-08-18 13:01:26.844354 | node1 |
2026-08-18 13:01:26.844476 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 13:01:26.844607 | node1 | Tuesday 18 August 2026  13:01:26 +0000 (0:00:00.073)       0:04:03.465 ********
2026-08-18 13:01:26.916919 | node1 | ok: [node1] => {
2026-08-18 13:01:26.916973 | node1 |     "changed": false,
2026-08-18 13:01:26.917062 | node1 |     "msg": "All assertions passed"
2026-08-18 13:01:26.917161 | node1 | }
2026-08-18 13:01:26.917270 | node1 | ok: [node2] => {
2026-08-18 13:01:26.917372 | node1 |     "changed": false,
2026-08-18 13:01:26.917471 | node1 |     "msg": "All assertions passed"
2026-08-18 13:01:26.917573 | node1 | }
2026-08-18 13:01:26.917693 | node1 | ok: [node3] => {
2026-08-18 13:01:26.917797 | node1 |     "changed": false,
2026-08-18 13:01:26.917903 | node1 |     "msg": "All assertions passed"
2026-08-18 13:01:26.918004 | node1 | }
2026-08-18 13:01:26.918101 | node1 |
2026-08-18 13:01:26.918230 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 13:01:26.918328 | node1 | Tuesday 18 August 2026  13:01:26 +0000 (0:00:00.073)       0:04:03.538 ********
2026-08-18 13:01:27.291519 | node1 | ok: [node1]
2026-08-18 13:01:27.291759 | node1 | ok: [node2]
2026-08-18 13:01:27.292013 | node1 | ok: [node3]
2026-08-18 13:01:27.292253 | node1 |
2026-08-18 13:01:27.292551 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 13:01:27.292866 | node1 | Tuesday 18 August 2026  13:01:27 +0000 (0:00:00.374)       0:04:03.912 ********
2026-08-18 13:01:27.363947 | node1 | ok: [node1]
2026-08-18 13:01:27.364023 | node1 | ok: [node2]
2026-08-18 13:01:27.364633 | node1 | ok: [node3]
2026-08-18 13:01:27.364667 | node1 |
2026-08-18 13:01:27.364672 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 13:01:27.364677 | node1 | Tuesday 18 August 2026  13:01:27 +0000 (0:00:00.073)       0:04:03.985 ********
2026-08-18 13:01:27.486810 | node1 | ok: [node1]
2026-08-18 13:01:27.486876 | node1 | ok: [node2]
2026-08-18 13:01:27.486886 | node1 | ok: [node3]
2026-08-18 13:01:27.486896 | node1 |
2026-08-18 13:01:27.486906 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 13:01:27.486921 | node1 | Tuesday 18 August 2026  13:01:27 +0000 (0:00:00.122)       0:04:04.107 ********
2026-08-18 13:01:27.560084 | node1 | ok: [node1] => {
2026-08-18 13:01:27.560276 | node1 |     "changed": false,
2026-08-18 13:01:27.560514 | node1 |     "msg": "All assertions passed"
2026-08-18 13:01:27.560786 | node1 | }
2026-08-18 13:01:27.561014 | node1 | ok: [node2] => {
2026-08-18 13:01:27.561247 | node1 |     "changed": false,
2026-08-18 13:01:27.561481 | node1 |     "msg": "All assertions passed"
2026-08-18 13:01:27.561775 | node1 | }
2026-08-18 13:01:27.562006 | node1 | ok: [node3] => {
2026-08-18 13:01:27.562338 | node1 |     "changed": false,
2026-08-18 13:01:27.562577 | node1 |     "msg": "All assertions passed"
2026-08-18 13:01:27.562836 | node1 | }
2026-08-18 13:01:27.563056 | node1 |
2026-08-18 13:01:27.563305 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 13:01:27.563544 | node1 | Tuesday 18 August 2026  13:01:27 +0000 (0:00:00.073)       0:04:04.181 ********
2026-08-18 13:01:29.332490 | node1 | ok: [node1]
2026-08-18 13:01:29.332783 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:01:29.333034 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:01:29.333269 | node1 |
2026-08-18 13:01:29.333530 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 13:01:29.333820 | node1 | Tuesday 18 August 2026  13:01:29 +0000 (0:00:01.772)       0:04:05.953 ********
2026-08-18 13:01:29.422397 | node1 | skipping: [node1]
2026-08-18 13:01:29.422630 | node1 | skipping: [node2]
2026-08-18 13:01:29.422864 | node1 | skipping: [node3]
2026-08-18 13:01:29.423086 | node1 |
2026-08-18 13:01:29.423334 | node1 | TASK [vexxhost.ceph.osd : Apply OSD service specs (drive groups)] **************
2026-08-18 13:01:29.423572 | node1 | Tuesday 18 August 2026  13:01:29 +0000 (0:00:00.089)       0:04:06.043 ********
2026-08-18 13:01:29.456796 | node1 | skipping: [node1]
2026-08-18 13:01:29.457015 | node1 |
2026-08-18 13:01:29.457273 | node1 | TASK [vexxhost.ceph.osd : List existing ceph-volume OSDs on this host] *********
2026-08-18 13:01:29.457517 | node1 | Tuesday 18 August 2026  13:01:29 +0000 (0:00:00.034)       0:04:06.077 ********
2026-08-18 13:01:31.088914 | node1 | ok: [node1]
2026-08-18 13:01:31.088984 | node1 | ok: [node3]
2026-08-18 13:01:31.089825 | node1 | ok: [node2]
2026-08-18 13:01:31.089888 | node1 |
2026-08-18 13:01:31.089902 | node1 | TASK [vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices] ********
2026-08-18 13:01:31.089915 | node1 | Tuesday 18 August 2026  13:01:31 +0000 (0:00:01.631)       0:04:07.709 ********
2026-08-18 13:07:26.297046 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node2-osd0/data)
2026-08-18 13:07:26.297164 | node1 | changed: [node1] => (item=/dev/ceph-node1-osd0/data)
2026-08-18 13:07:26.298666 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node3-osd0/data)
2026-08-18 13:07:26.298686 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node2-osd1/data)
2026-08-18 13:07:26.298694 | node1 | changed: [node1] => (item=/dev/ceph-node1-osd1/data)
2026-08-18 13:07:26.298702 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node3-osd1/data)
2026-08-18 13:07:26.298734 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node2-osd2/data)
2026-08-18 13:07:26.298740 | node1 | changed: [node1] => (item=/dev/ceph-node1-osd2/data)
2026-08-18 13:07:26.298746 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node3-osd2/data)
2026-08-18 13:07:26.298752 | node1 |
2026-08-18 13:07:26.298759 | node1 | TASK [vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host] ***
2026-08-18 13:07:26.298766 | node1 | Tuesday 18 August 2026  13:07:26 +0000 (0:05:55.206)       0:10:02.915 ********
2026-08-18 13:07:48.113810 | node1 | FAILED - RETRYING: [node1]: Wait for explicitly requested OSD daemons to be running on this host (120 retries left).
2026-08-18 13:07:48.113890 | node1 | FAILED - RETRYING: [node3 -> node1]: Wait for explicitly requested OSD daemons to be running on this host (120 retries left).
2026-08-18 13:07:48.113990 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:07:48.114095 | node1 | ok: [node1]
2026-08-18 13:07:48.114220 | node1 | FAILED - RETRYING: [node3 -> node1]: Wait for explicitly requested OSD daemons to be running on this host (119 retries left).
2026-08-18 13:07:48.114339 | node1 | FAILED - RETRYING: [node3 -> node1]: Wait for explicitly requested OSD daemons to be running on this host (118 retries left).
2026-08-18 13:07:48.114457 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:07:48.114559 | node1 |
2026-08-18 13:07:48.114707 | node1 | TASK [vexxhost.ceph.osd : Wait for OSD drive-group services to deploy at least one daemon] ***
2026-08-18 13:07:48.114812 | node1 | Tuesday 18 August 2026  13:07:48 +0000 (0:00:21.817)       0:10:24.733 ********
2026-08-18 13:07:48.231893 | node1 | skipping: [node1]
2026-08-18 13:07:48.232176 | node1 |
2026-08-18 13:07:48.232445 | node1 | PLAY [Apply Ceph configuration] ************************************************
2026-08-18 13:07:48.232717 | node1 |
2026-08-18 13:07:48.233008 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 13:07:48.233272 | node1 | Tuesday 18 August 2026  13:07:48 +0000 (0:00:00.119)       0:10:24.853 ********
2026-08-18 13:07:49.363740 | node1 | ok: [node1]
2026-08-18 13:07:49.363803 | node1 | ok: [node3]
2026-08-18 13:07:49.363816 | node1 | ok: [node2]
2026-08-18 13:07:49.363829 | node1 |
2026-08-18 13:07:49.363842 | node1 | TASK [vexxhost.ceph.configure : Locate the cluster admin host] *****************
2026-08-18 13:07:49.363854 | node1 | Tuesday 18 August 2026  13:07:49 +0000 (0:00:01.129)       0:10:25.982 ********
2026-08-18 13:07:50.043371 | node1 | ok: [node1] => (item=node1)
2026-08-18 13:07:50.043403 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 13:07:50.043410 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 13:07:50.043417 | node1 |
2026-08-18 13:07:50.043423 | node1 | TASK [vexxhost.ceph.configure : Select the admin host] *************************
2026-08-18 13:07:50.043430 | node1 | Tuesday 18 August 2026  13:07:50 +0000 (0:00:00.680)       0:10:26.663 ********
2026-08-18 13:07:50.112166 | node1 | ok: [node1]
2026-08-18 13:07:50.112225 | node1 | ok: [node2]
2026-08-18 13:07:50.112238 | node1 | ok: [node3]
2026-08-18 13:07:50.112250 | node1 |
2026-08-18 13:07:50.112263 | node1 | TASK [vexxhost.ceph.configure : Set the admin mon config path] *****************
2026-08-18 13:07:50.112275 | node1 | Tuesday 18 August 2026  13:07:50 +0000 (0:00:00.068)       0:10:26.732 ********
2026-08-18 13:07:50.173705 | node1 | ok: [node1]
2026-08-18 13:07:50.173765 | node1 | ok: [node2]
2026-08-18 13:07:50.173778 | node1 | ok: [node3]
2026-08-18 13:07:50.173790 | node1 |
2026-08-18 13:07:50.173809 | node1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] **************
2026-08-18 13:07:50.174001 | node1 | Tuesday 18 August 2026  13:07:50 +0000 (0:00:00.062)       0:10:26.794 ********
2026-08-18 13:07:50.244240 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/config.yml for node1, node2, node3
2026-08-18 13:07:50.244421 | node1 |
2026-08-18 13:07:50.244742 | node1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] **************
2026-08-18 13:07:50.245001 | node1 | Tuesday 18 August 2026  13:07:50 +0000 (0:00:00.071)       0:10:26.865 ********
2026-08-18 13:08:09.203621 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/standby_behaviour)
2026-08-18 13:08:09.203685 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/RGW_API_SSL_VERIFY)
2026-08-18 13:08:09.203699 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_CEPHFS)
2026-08-18 13:08:09.203712 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_ISCSI)
2026-08-18 13:08:09.203724 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_MIRRORING)
2026-08-18 13:08:09.203737 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_NFS)
2026-08-18 13:08:09.203750 | node1 |
2026-08-18 13:08:09.203764 | node1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] ***************
2026-08-18 13:08:09.203776 | node1 | Tuesday 18 August 2026  13:08:09 +0000 (0:00:18.956)       0:10:45.822 ********
2026-08-18 13:08:09.273235 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/ec_profiles.yml for node1, node2, node3
2026-08-18 13:08:09.273289 | node1 |
2026-08-18 13:08:09.273303 | node1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] ***************
2026-08-18 13:08:09.273316 | node1 | Tuesday 18 August 2026  13:08:09 +0000 (0:00:00.069)       0:10:45.892 ********
2026-08-18 13:08:12.674004 | node1 | changed: [node1] => (item=ec_hdd_s3)
2026-08-18 13:08:12.674069 | node1 |
2026-08-18 13:08:12.674194 | node1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] *************************
2026-08-18 13:08:12.674304 | node1 | Tuesday 18 August 2026  13:08:12 +0000 (0:00:03.400)       0:10:49.292 ********
2026-08-18 13:08:12.747559 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/crush_rules.yml for node1, node2, node3
2026-08-18 13:08:12.747668 | node1 |
2026-08-18 13:08:12.747728 | node1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] *************************
2026-08-18 13:08:12.747839 | node1 | Tuesday 18 August 2026  13:08:12 +0000 (0:00:00.076)       0:10:49.369 ********
2026-08-18 13:08:24.990118 | node1 | changed: [node1] => (item=rep_hdd)
2026-08-18 13:08:24.990187 | node1 | changed: [node1] => (item=rep_lab)
2026-08-18 13:08:24.990289 | node1 | changed: [node1] => (item=ec_hdd_s3)
2026-08-18 13:08:24.990392 | node1 |
2026-08-18 13:08:24.990504 | node1 | TASK [vexxhost.ceph.configure : Configure pools] *******************************
2026-08-18 13:08:24.990625 | node1 | Tuesday 18 August 2026  13:08:24 +0000 (0:00:12.242)       0:11:01.611 ********
2026-08-18 13:08:25.070672 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/pools.yml for node1, node2, node3
2026-08-18 13:08:25.070733 | node1 |
2026-08-18 13:08:25.071101 | node1 | TASK [vexxhost.ceph.configure : Configure pools] *******************************
2026-08-18 13:08:25.071152 | node1 | Tuesday 18 August 2026  13:08:25 +0000 (0:00:00.079)       0:11:01.690 ********
2026-08-18 13:09:00.427140 | node1 | changed: [node1] => (item=molecule-1.rgw.buckets.data)
2026-08-18 13:09:00.427241 | node1 | changed: [node1] => (item=molecule-1.rgw.buckets.index)
2026-08-18 13:09:00.427409 | node1 | changed: [node1] => (item=molecule-1.rgw.buckets.non-ec)
2026-08-18 13:09:00.427559 | node1 | changed: [node1] => (item=molecule-1.rgw.control)
2026-08-18 13:09:00.427775 | node1 | changed: [node1] => (item=molecule-1.rgw.log)
2026-08-18 13:09:00.427916 | node1 | changed: [node1] => (item=molecule-1.rgw.meta)
2026-08-18 13:09:00.428048 | node1 |
2026-08-18 13:09:00.428270 | node1 | TASK [vexxhost.ceph.configure : Configure CephX keys] **************************
2026-08-18 13:09:00.428412 | node1 | Tuesday 18 August 2026  13:09:00 +0000 (0:00:35.355)       0:11:37.045 ********
2026-08-18 13:09:00.483919 | node1 | skipping: [node1]
2026-08-18 13:09:00.484164 | node1 | skipping: [node2]
2026-08-18 13:09:00.484425 | node1 | skipping: [node3]
2026-08-18 13:09:00.484672 | node1 |
2026-08-18 13:09:00.484927 | node1 | TASK [vexxhost.ceph.configure : Enroll the dashboard TLS certificate] **********
2026-08-18 13:09:00.485167 | node1 | Tuesday 18 August 2026  13:09:00 +0000 (0:00:00.059)       0:11:37.104 ********
2026-08-18 13:09:00.567376 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard.yml for node1, node2, node3
2026-08-18 13:09:00.567578 | node1 |
2026-08-18 13:09:00.567880 | node1 | TASK [vexxhost.ceph.configure : Check whether the dashboard mgr module is enabled] ***
2026-08-18 13:09:00.568125 | node1 | Tuesday 18 August 2026  13:09:00 +0000 (0:00:00.083)       0:11:37.188 ********
2026-08-18 13:09:02.349320 | node1 | ok: [node1]
2026-08-18 13:09:02.349522 | node1 |
2026-08-18 13:09:02.349811 | node1 | TASK [vexxhost.ceph.configure : Get the current dashboard certificate] *********
2026-08-18 13:09:02.350061 | node1 | Tuesday 18 August 2026  13:09:02 +0000 (0:00:01.781)       0:11:38.970 ********
2026-08-18 13:09:04.157774 | node1 | ok: [node1]
2026-08-18 13:09:04.157848 | node1 |
2026-08-18 13:09:04.158307 | node1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate] *****************
2026-08-18 13:09:04.158362 | node1 | Tuesday 18 August 2026  13:09:04 +0000 (0:00:01.808)       0:11:40.778 ********
2026-08-18 13:09:04.200128 | node1 | skipping: [node1]
2026-08-18 13:09:04.200188 | node1 |
2026-08-18 13:09:04.200361 | node1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate key] *************
2026-08-18 13:09:04.200521 | node1 | Tuesday 18 August 2026  13:09:04 +0000 (0:00:00.042)       0:11:40.821 ********
2026-08-18 13:09:04.244039 | node1 | skipping: [node1]
2026-08-18 13:09:04.244083 | node1 |
2026-08-18 13:09:04.244098 | node1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] *****************
2026-08-18 13:09:04.244111 | node1 | Tuesday 18 August 2026  13:09:04 +0000 (0:00:00.042)       0:11:40.863 ********
2026-08-18 13:09:04.284782 | node1 | skipping: [node1]
2026-08-18 13:09:04.284828 | node1 |
2026-08-18 13:09:04.284842 | node1 | TASK [vexxhost.ceph.configure : Create a self-signed certificate] **************
2026-08-18 13:09:04.284860 | node1 | Tuesday 18 August 2026  13:09:04 +0000 (0:00:00.041)       0:11:40.904 ********
2026-08-18 13:09:06.262106 | node1 | changed: [node1]
2026-08-18 13:09:06.262197 | node1 |
2026-08-18 13:09:06.262326 | node1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] *****************
2026-08-18 13:09:06.262506 | node1 | Tuesday 18 August 2026  13:09:06 +0000 (0:00:01.977)       0:11:42.882 ********
2026-08-18 13:09:06.332047 | node1 | ok: [node1]
2026-08-18 13:09:06.332086 | node1 |
2026-08-18 13:09:06.332099 | node1 | TASK [vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate] ***
2026-08-18 13:09:06.332112 | node1 | Tuesday 18 August 2026  13:09:06 +0000 (0:00:00.069)       0:11:42.951 ********
2026-08-18 13:09:13.562507 | node1 | changed: [node1] => (item=ceph mgr module disable dashboard)
2026-08-18 13:09:13.562561 | node1 | changed: [node1] => (item=ceph mgr module enable dashboard)
2026-08-18 13:09:13.562568 | node1 | changed: [node1] => (item=ceph orch reconfig mgr)
2026-08-18 13:09:13.562575 | node1 |
2026-08-18 13:09:13.562598 | node1 | TASK [vexxhost.ceph.configure : Configure dashboard users] *********************
2026-08-18 13:09:13.562606 | node1 | Tuesday 18 August 2026  13:09:13 +0000 (0:00:07.228)       0:11:50.180 ********
2026-08-18 13:09:13.648776 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard_users.yml for node1, node2, node3
2026-08-18 13:09:13.648842 | node1 |
2026-08-18 13:09:13.648859 | node1 | TASK [vexxhost.ceph.configure : Configure dashboard users] *********************
2026-08-18 13:09:13.648882 | node1 | Tuesday 18 August 2026  13:09:13 +0000 (0:00:00.089)       0:11:50.270 ********
2026-08-18 13:09:23.908829 | node1 | changed: [node1] => (item=None)
2026-08-18 13:09:23.908897 | node1 | changed: [node1] => (item=None)
2026-08-18 13:09:23.908912 | node1 | changed: [node1 -> {{ ceph_configure_admin_host }}]
2026-08-18 13:09:23.910036 | node1 |
2026-08-18 13:09:23.910095 | node1 | PLAY [Deploy Ceph RADOS Gateways] **********************************************
2026-08-18 13:09:23.910109 | node1 |
2026-08-18 13:09:23.910121 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 13:09:23.910134 | node1 | Tuesday 18 August 2026  13:09:23 +0000 (0:00:10.259)       0:12:00.529 ********
2026-08-18 13:09:25.190531 | node1 | ok: [node1]
2026-08-18 13:09:25.190616 | node1 | ok: [node2]
2026-08-18 13:09:25.190634 | node1 | ok: [node3]
2026-08-18 13:09:25.190670 | node1 |
2026-08-18 13:09:25.190680 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:09:25.190689 | node1 | Tuesday 18 August 2026  13:09:25 +0000 (0:00:01.280)       0:12:01.809 ********
2026-08-18 13:09:25.489479 | node1 | ok: [node1]
2026-08-18 13:09:25.489524 | node1 | ok: [node2]
2026-08-18 13:09:25.489534 | node1 | ok: [node3]
2026-08-18 13:09:25.489543 | node1 |
2026-08-18 13:09:25.489553 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:09:25.489561 | node1 | Tuesday 18 August 2026  13:09:25 +0000 (0:00:00.298)       0:12:02.108 ********
2026-08-18 13:09:25.575678 | node1 | skipping: [node1]
2026-08-18 13:09:25.576000 | node1 | skipping: [node2]
2026-08-18 13:09:25.576670 | node1 | skipping: [node3]
2026-08-18 13:09:25.576722 | node1 |
2026-08-18 13:09:25.577137 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 13:09:25.577160 | node1 | Tuesday 18 August 2026  13:09:25 +0000 (0:00:00.086)       0:12:02.195 ********
2026-08-18 13:09:25.882069 | node1 | ok: [node1]
2026-08-18 13:09:25.882134 | node1 | ok: [node2]
2026-08-18 13:09:25.882201 | node1 | ok: [node3]
2026-08-18 13:09:25.882294 | node1 |
2026-08-18 13:09:25.882406 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:09:25.882515 | node1 | Tuesday 18 August 2026  13:09:25 +0000 (0:00:00.306)       0:12:02.502 ********
2026-08-18 13:09:25.973127 | node1 | ok: [node1] => {
2026-08-18 13:09:25.973240 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:09:25.973377 | node1 | }
2026-08-18 13:09:25.973530 | node1 | ok: [node2] => {
2026-08-18 13:09:25.973759 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:09:25.973899 | node1 | }
2026-08-18 13:09:25.974028 | node1 | ok: [node3] => {
2026-08-18 13:09:25.974142 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:09:25.974245 | node1 | }
2026-08-18 13:09:25.974612 | node1 |
2026-08-18 13:09:25.974645 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:09:25.974651 | node1 | Tuesday 18 August 2026  13:09:25 +0000 (0:00:00.090)       0:12:02.593 ********
2026-08-18 13:09:26.395565 | node1 | ok: [node1]
2026-08-18 13:09:26.395623 | node1 | ok: [node3]
2026-08-18 13:09:26.395628 | node1 | ok: [node2]
2026-08-18 13:09:26.395633 | node1 |
2026-08-18 13:09:26.395637 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:09:26.395641 | node1 | Tuesday 18 August 2026  13:09:26 +0000 (0:00:00.422)       0:12:03.016 ********
2026-08-18 13:09:26.425970 | node1 | skipping: [node1]
2026-08-18 13:09:26.536043 | node1 | skipping: [node2]
2026-08-18 13:09:26.536123 | node1 | skipping: [node3]
2026-08-18 13:09:26.536225 | node1 |
2026-08-18 13:09:26.536343 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:09:26.536477 | node1 | Tuesday 18 August 2026  13:09:26 +0000 (0:00:00.141)       0:12:03.157 ********
2026-08-18 13:09:26.577098 | node1 | skipping: [node1]
2026-08-18 13:09:26.652146 | node1 | skipping: [node2]
2026-08-18 13:09:26.652191 | node1 | skipping: [node3]
2026-08-18 13:09:26.652201 | node1 |
2026-08-18 13:09:26.652211 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:09:26.652220 | node1 | Tuesday 18 August 2026  13:09:26 +0000 (0:00:00.114)       0:12:03.271 ********
2026-08-18 13:09:26.968493 | node1 | ok: [node1]
2026-08-18 13:09:26.968538 | node1 | ok: [node2]
2026-08-18 13:09:26.968548 | node1 | ok: [node3]
2026-08-18 13:09:26.968557 | node1 |
2026-08-18 13:09:26.968566 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:09:26.968575 | node1 | Tuesday 18 August 2026  13:09:26 +0000 (0:00:00.316)       0:12:03.588 ********
2026-08-18 13:09:28.206691 | node1 | ok: [node2]
2026-08-18 13:09:28.206745 | node1 | ok: [node1]
2026-08-18 13:09:28.206755 | node1 | ok: [node3]
2026-08-18 13:09:28.206764 | node1 |
2026-08-18 13:09:28.206780 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:09:28.206862 | node1 | Tuesday 18 August 2026  13:09:28 +0000 (0:00:01.238)       0:12:04.827 ********
2026-08-18 13:09:28.329026 | node1 | ok: [node1] => {
2026-08-18 13:09:28.329709 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:09:28.329865 | node1 | }
2026-08-18 13:09:28.330096 | node1 | ok: [node2] => {
2026-08-18 13:09:28.330254 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:09:28.330371 | node1 | }
2026-08-18 13:09:28.330531 | node1 | ok: [node3] => {
2026-08-18 13:09:28.332011 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:09:28.332119 | node1 | }
2026-08-18 13:09:28.332269 | node1 |
2026-08-18 13:09:28.334778 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:09:28.334881 | node1 | Tuesday 18 August 2026  13:09:28 +0000 (0:00:00.122)       0:12:04.949 ********
2026-08-18 13:09:28.780528 | node1 | ok: [node1]
2026-08-18 13:09:28.780668 | node1 | ok: [node2]
2026-08-18 13:09:28.780768 | node1 | ok: [node3]
2026-08-18 13:09:28.780917 | node1 |
2026-08-18 13:09:28.781078 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:09:28.781235 | node1 | Tuesday 18 August 2026  13:09:28 +0000 (0:00:00.451)       0:12:05.401 ********
2026-08-18 13:09:31.018649 | node1 | ok: [node1]
2026-08-18 13:09:31.018878 | node1 | ok: [node2]
2026-08-18 13:09:31.019345 | node1 | ok: [node3]
2026-08-18 13:09:31.019684 | node1 |
2026-08-18 13:09:31.019961 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 13:09:31.020229 | node1 | Tuesday 18 August 2026  13:09:31 +0000 (0:00:02.237)       0:12:07.639 ********
2026-08-18 13:09:31.085717 | node1 | skipping: [node1]
2026-08-18 13:09:31.085961 | node1 | skipping: [node2]
2026-08-18 13:09:31.086198 | node1 | skipping: [node3]
2026-08-18 13:09:31.086420 | node1 |
2026-08-18 13:09:31.086701 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 13:09:31.086971 | node1 | Tuesday 18 August 2026  13:09:31 +0000 (0:00:00.067)       0:12:07.706 ********
2026-08-18 13:09:31.147073 | node1 | skipping: [node1]
2026-08-18 13:09:31.147238 | node1 | skipping: [node2]
2026-08-18 13:09:31.147471 | node1 | skipping: [node3]
2026-08-18 13:09:31.147740 | node1 |
2026-08-18 13:09:31.147978 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 13:09:31.148216 | node1 | Tuesday 18 August 2026  13:09:31 +0000 (0:00:00.061)       0:12:07.768 ********
2026-08-18 13:09:31.213833 | node1 | skipping: [node1]
2026-08-18 13:09:31.214040 | node1 | skipping: [node2]
2026-08-18 13:09:31.214269 | node1 | skipping: [node3]
2026-08-18 13:09:31.214492 | node1 |
2026-08-18 13:09:31.214834 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 13:09:31.215085 | node1 | Tuesday 18 August 2026  13:09:31 +0000 (0:00:00.066)       0:12:07.834 ********
2026-08-18 13:09:32.544619 | node1 | ok: [node1]
2026-08-18 13:09:32.544691 | node1 | ok: [node2]
2026-08-18 13:09:32.544927 | node1 | ok: [node3]
2026-08-18 13:09:32.545189 | node1 |
2026-08-18 13:09:32.545488 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 13:09:32.545761 | node1 | Tuesday 18 August 2026  13:09:32 +0000 (0:00:01.330)       0:12:09.165 ********
2026-08-18 13:09:33.138316 | node1 | ok: [node1]
2026-08-18 13:09:33.138548 | node1 | ok: [node2]
2026-08-18 13:09:33.138834 | node1 | ok: [node3]
2026-08-18 13:09:33.139061 | node1 |
2026-08-18 13:09:33.139378 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 13:09:33.139654 | node1 | Tuesday 18 August 2026  13:09:33 +0000 (0:00:00.593)       0:12:09.759 ********
2026-08-18 13:09:34.346921 | node1 | ok: [node1] => (item={'path': '/etc/containerd'})
2026-08-18 13:09:34.347182 | node1 | ok: [node2] => (item={'path': '/etc/containerd'})
2026-08-18 13:09:34.347510 | node1 | ok: [node3] => (item={'path': '/etc/containerd'})
2026-08-18 13:09:34.347836 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:09:34.348129 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:09:34.348403 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:09:34.348714 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:09:34.348974 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:09:34.349306 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:09:34.349597 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:09:34.349896 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:09:34.350188 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:09:34.350445 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:09:34.350725 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:09:34.350978 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:09:34.351199 | node1 |
2026-08-18 13:09:34.351441 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 13:09:34.351717 | node1 | Tuesday 18 August 2026  13:09:34 +0000 (0:00:01.208)       0:12:10.967 ********
2026-08-18 13:09:35.116121 | node1 | ok: [node1]
2026-08-18 13:09:35.116396 | node1 | ok: [node2]
2026-08-18 13:09:35.116737 | node1 | ok: [node3]
2026-08-18 13:09:35.117028 | node1 |
2026-08-18 13:09:35.117342 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:09:35.117657 | node1 | Tuesday 18 August 2026  13:09:35 +0000 (0:00:00.749)       0:12:11.717 ********
2026-08-18 13:09:35.117908 | node1 |
2026-08-18 13:09:35.118205 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:09:35.118480 | node1 | Tuesday 18 August 2026  13:09:35 +0000 (0:00:00.007)       0:12:11.724 ********
2026-08-18 13:09:35.118748 | node1 |
2026-08-18 13:09:35.119006 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:09:35.119289 | node1 | Tuesday 18 August 2026  13:09:35 +0000 (0:00:00.006)       0:12:11.731 ********
2026-08-18 13:09:35.119517 | node1 |
2026-08-18 13:09:35.119805 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 13:09:35.120094 | node1 | Tuesday 18 August 2026  13:09:35 +0000 (0:00:00.006)       0:12:11.737 ********
2026-08-18 13:09:35.618653 | node1 | ok: [node1]
2026-08-18 13:09:35.618944 | node1 | ok: [node2]
2026-08-18 13:09:35.619320 | node1 | ok: [node3]
2026-08-18 13:09:35.619630 | node1 |
2026-08-18 13:09:35.619957 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:09:35.620255 | node1 | Tuesday 18 August 2026  13:09:35 +0000 (0:00:00.501)       0:12:12.238 ********
2026-08-18 13:09:35.913391 | node1 | ok: [node1]
2026-08-18 13:09:35.913469 | node1 | ok: [node2]
2026-08-18 13:09:35.913763 | node1 | ok: [node3]
2026-08-18 13:09:35.914001 | node1 |
2026-08-18 13:09:35.914229 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:09:35.914464 | node1 | Tuesday 18 August 2026  13:09:35 +0000 (0:00:00.296)       0:12:12.534 ********
2026-08-18 13:09:36.006439 | node1 | ok: [node1] => {
2026-08-18 13:09:36.006556 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:09:36.006777 | node1 | }
2026-08-18 13:09:36.006946 | node1 | ok: [node2] => {
2026-08-18 13:09:36.007120 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:09:36.007262 | node1 | }
2026-08-18 13:09:36.007407 | node1 | ok: [node3] => {
2026-08-18 13:09:36.007564 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:09:36.007730 | node1 | }
2026-08-18 13:09:36.007861 | node1 |
2026-08-18 13:09:36.008015 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:09:36.008205 | node1 | Tuesday 18 August 2026  13:09:36 +0000 (0:00:00.093)       0:12:12.627 ********
2026-08-18 13:09:36.466087 | node1 | ok: [node2]
2026-08-18 13:09:36.466237 | node1 | ok: [node1]
2026-08-18 13:09:36.466422 | node1 | ok: [node3]
2026-08-18 13:09:36.466564 | node1 |
2026-08-18 13:09:36.466756 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:09:36.466908 | node1 | Tuesday 18 August 2026  13:09:36 +0000 (0:00:00.458)       0:12:13.086 ********
2026-08-18 13:09:39.857416 | node1 | ok: [node1]
2026-08-18 13:09:39.857676 | node1 | ok: [node2]
2026-08-18 13:09:39.857903 | node1 | ok: [node3]
2026-08-18 13:09:39.858122 | node1 |
2026-08-18 13:09:39.858401 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 13:09:39.858693 | node1 | Tuesday 18 August 2026  13:09:39 +0000 (0:00:03.392)       0:12:16.478 ********
2026-08-18 13:09:41.155139 | node1 | ok: [node2]
2026-08-18 13:09:41.155210 | node1 | ok: [node1]
2026-08-18 13:09:41.155223 | node1 | ok: [node3]
2026-08-18 13:09:41.158224 | node1 |
2026-08-18 13:09:41.158255 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 13:09:41.158268 | node1 | Tuesday 18 August 2026  13:09:41 +0000 (0:00:01.297)       0:12:17.776 ********
2026-08-18 13:09:41.465005 | node1 | ok: [node1]
2026-08-18 13:09:41.465244 | node1 | ok: [node2]
2026-08-18 13:09:41.465482 | node1 | ok: [node3]
2026-08-18 13:09:41.465742 | node1 |
2026-08-18 13:09:41.465997 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 13:09:41.466239 | node1 | Tuesday 18 August 2026  13:09:41 +0000 (0:00:00.310)       0:12:18.086 ********
2026-08-18 13:09:42.053110 | node1 | ok: [node1]
2026-08-18 13:09:42.053311 | node1 | ok: [node2]
2026-08-18 13:09:42.053549 | node1 | ok: [node3]
2026-08-18 13:09:42.053862 | node1 |
2026-08-18 13:09:42.054116 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 13:09:42.054372 | node1 | Tuesday 18 August 2026  13:09:42 +0000 (0:00:00.588)       0:12:18.674 ********
2026-08-18 13:09:42.807801 | node1 | ok: [node1] => (item={'path': '/etc/docker'})
2026-08-18 13:09:42.808763 | node1 | ok: [node2] => (item={'path': '/etc/docker'})
2026-08-18 13:09:42.808828 | node1 | ok: [node3] => (item={'path': '/etc/docker'})
2026-08-18 13:09:42.808842 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:09:42.808859 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:09:42.810578 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:09:42.810647 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:09:42.810664 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:09:42.810676 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:09:42.810688 | node1 |
2026-08-18 13:09:42.810700 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 13:09:42.810712 | node1 | Tuesday 18 August 2026  13:09:42 +0000 (0:00:00.754)       0:12:19.428 ********
2026-08-18 13:09:43.379688 | node1 | ok: [node1]
2026-08-18 13:09:43.379749 | node1 | ok: [node2]
2026-08-18 13:09:43.380660 | node1 | ok: [node3]
2026-08-18 13:09:43.380710 | node1 |
2026-08-18 13:09:43.380724 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 13:09:43.380737 | node1 | Tuesday 18 August 2026  13:09:43 +0000 (0:00:00.571)       0:12:20.000 ********
2026-08-18 13:09:43.993208 | node1 | ok: [node1]
2026-08-18 13:09:43.993246 | node1 | ok: [node3]
2026-08-18 13:09:43.993255 | node1 | ok: [node2]
2026-08-18 13:09:43.993263 | node1 |
2026-08-18 13:09:43.993271 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:09:43.993279 | node1 | Tuesday 18 August 2026  13:09:43 +0000 (0:00:00.590)       0:12:20.591 ********
2026-08-18 13:09:43.993286 | node1 |
2026-08-18 13:09:43.993293 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:09:43.993300 | node1 | Tuesday 18 August 2026  13:09:43 +0000 (0:00:00.007)       0:12:20.598 ********
2026-08-18 13:09:43.993307 | node1 |
2026-08-18 13:09:43.993314 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:09:43.993321 | node1 | Tuesday 18 August 2026  13:09:43 +0000 (0:00:00.006)       0:12:20.604 ********
2026-08-18 13:09:43.993328 | node1 |
2026-08-18 13:09:43.993349 | node1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 13:09:43.993354 | node1 | Tuesday 18 August 2026  13:09:43 +0000 (0:00:00.006)       0:12:20.611 ********
2026-08-18 13:09:44.482011 | node1 | ok: [node1]
2026-08-18 13:09:44.482063 | node1 | ok: [node2]
2026-08-18 13:09:44.482073 | node1 | ok: [node3]
2026-08-18 13:09:44.482082 | node1 |
2026-08-18 13:09:44.482092 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:09:44.482101 | node1 | Tuesday 18 August 2026  13:09:44 +0000 (0:00:00.490)       0:12:21.101 ********
2026-08-18 13:09:44.548757 | node1 | ok: [node1] => {
2026-08-18 13:09:44.548830 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:09:44.548841 | node1 | }
2026-08-18 13:09:44.548850 | node1 | ok: [node2] => {
2026-08-18 13:09:44.548903 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:09:44.549130 | node1 | }
2026-08-18 13:09:44.549357 | node1 | ok: [node3] => {
2026-08-18 13:09:44.549742 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:09:44.549921 | node1 | }
2026-08-18 13:09:44.550105 | node1 |
2026-08-18 13:09:44.550411 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:09:44.550713 | node1 | Tuesday 18 August 2026  13:09:44 +0000 (0:00:00.067)       0:12:21.169 ********
2026-08-18 13:09:44.922795 | node1 | ok: [node1]
2026-08-18 13:09:44.923072 | node1 | ok: [node2]
2026-08-18 13:09:44.923348 | node1 | ok: [node3]
2026-08-18 13:09:44.923645 | node1 |
2026-08-18 13:09:44.923979 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:09:44.924246 | node1 | Tuesday 18 August 2026  13:09:44 +0000 (0:00:00.374)       0:12:21.544 ********
2026-08-18 13:09:45.000624 | node1 | skipping: [node1]
2026-08-18 13:09:45.000888 | node1 | skipping: [node2]
2026-08-18 13:09:45.001166 | node1 | skipping: [node3]
2026-08-18 13:09:45.001420 | node1 |
2026-08-18 13:09:45.001789 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 13:09:45.002096 | node1 | Tuesday 18 August 2026  13:09:44 +0000 (0:00:00.077)       0:12:21.621 ********
2026-08-18 13:09:45.078063 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-18 13:09:45.078341 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-18 13:09:45.131375 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-18 13:09:45.131650 | node1 |
2026-08-18 13:09:45.131966 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 13:09:45.132247 | node1 | Tuesday 18 August 2026  13:09:45 +0000 (0:00:00.130)       0:12:21.752 ********
2026-08-18 13:09:47.014812 | node1 | ok: [node2]
2026-08-18 13:09:47.014897 | node1 | ok: [node3]
2026-08-18 13:09:47.015960 | node1 | ok: [node1]
2026-08-18 13:09:47.015997 | node1 |
2026-08-18 13:09:47.016012 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 13:09:47.016025 | node1 | Tuesday 18 August 2026  13:09:47 +0000 (0:00:01.883)       0:12:23.635 ********
2026-08-18 13:09:47.859284 | node1 | ok: [node1] => (item=systemd-timesyncd)
2026-08-18 13:09:47.859334 | node1 | ok: [node2] => (item=systemd-timesyncd)
2026-08-18 13:09:47.859347 | node1 | ok: [node3] => (item=systemd-timesyncd)
2026-08-18 13:09:47.859358 | node1 | ok: [node1] => (item=ssh)
2026-08-18 13:09:47.859370 | node1 | ok: [node2] => (item=ssh)
2026-08-18 13:09:47.859382 | node1 | ok: [node3] => (item=ssh)
2026-08-18 13:09:47.859394 | node1 |
2026-08-18 13:09:47.859406 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 13:09:47.859418 | node1 | Tuesday 18 August 2026  13:09:47 +0000 (0:00:00.842)       0:12:24.477 ********
2026-08-18 13:09:48.139750 | node1 | ok: [node1]
2026-08-18 13:09:48.139840 | node1 | ok: [node2]
2026-08-18 13:09:48.139858 | node1 | ok: [node3]
2026-08-18 13:09:48.139872 | node1 |
2026-08-18 13:09:48.139885 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 13:09:48.139925 | node1 | Tuesday 18 August 2026  13:09:48 +0000 (0:00:00.281)       0:12:24.759 ********
2026-08-18 13:09:48.474004 | node1 | ok: [node1]
2026-08-18 13:09:48.474312 | node1 | ok: [node2]
2026-08-18 13:09:48.474733 | node1 | ok: [node3]
2026-08-18 13:09:48.475054 | node1 |
2026-08-18 13:09:48.475335 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 13:09:48.475610 | node1 | Tuesday 18 August 2026  13:09:48 +0000 (0:00:00.335)       0:12:25.095 ********
2026-08-18 13:09:49.052098 | node1 | ok: [node1]
2026-08-18 13:09:49.052311 | node1 | ok: [node2]
2026-08-18 13:09:49.052546 | node1 | ok: [node3]
2026-08-18 13:09:49.052815 | node1 |
2026-08-18 13:09:49.053056 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 13:09:49.053296 | node1 | Tuesday 18 August 2026  13:09:49 +0000 (0:00:00.578)       0:12:25.673 ********
2026-08-18 13:09:49.119249 | node1 | skipping: [node1]
2026-08-18 13:09:49.119583 | node1 | skipping: [node2]
2026-08-18 13:09:49.119915 | node1 | skipping: [node3]
2026-08-18 13:09:49.120247 | node1 |
2026-08-18 13:09:49.120576 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 13:09:49.120920 | node1 | Tuesday 18 August 2026  13:09:49 +0000 (0:00:00.067)       0:12:25.740 ********
2026-08-18 13:09:49.586903 | node1 | ok: [node1]
2026-08-18 13:09:49.587126 | node1 | ok: [node2]
2026-08-18 13:09:49.587360 | node1 | ok: [node3]
2026-08-18 13:09:49.587613 | node1 |
2026-08-18 13:09:49.587894 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 13:09:49.588134 | node1 | Tuesday 18 August 2026  13:09:49 +0000 (0:00:00.467)       0:12:26.208 ********
2026-08-18 13:09:50.201765 | node1 | ok: [node1]
2026-08-18 13:09:50.201973 | node1 | ok: [node2]
2026-08-18 13:09:50.202209 | node1 | ok: [node3]
2026-08-18 13:09:50.202430 | node1 |
2026-08-18 13:09:50.202758 | node1 | TASK [vexxhost.ceph.rgw : Locate the cluster admin host] ***********************
2026-08-18 13:09:50.203181 | node1 | Tuesday 18 August 2026  13:09:50 +0000 (0:00:00.614)       0:12:26.822 ********
2026-08-18 13:09:50.959545 | node1 | ok: [node1] => (item=node1)
2026-08-18 13:09:50.959736 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 13:09:50.959983 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 13:09:50.960200 | node1 |
2026-08-18 13:09:50.960453 | node1 | TASK [vexxhost.ceph.rgw : Select the admin host] *******************************
2026-08-18 13:09:50.960743 | node1 | Tuesday 18 August 2026  13:09:50 +0000 (0:00:00.757)       0:12:27.580 ********
2026-08-18 13:09:51.045743 | node1 | ok: [node1]
2026-08-18 13:09:51.045931 | node1 | ok: [node2]
2026-08-18 13:09:51.046167 | node1 | ok: [node3]
2026-08-18 13:09:51.046386 | node1 |
2026-08-18 13:09:51.047254 | node1 | TASK [vexxhost.ceph.rgw : Set the admin mon config path] ***********************
2026-08-18 13:09:51.047296 | node1 | Tuesday 18 August 2026  13:09:51 +0000 (0:00:00.086)       0:12:27.667 ********
2026-08-18 13:09:51.122809 | node1 | ok: [node1]
2026-08-18 13:09:51.123024 | node1 | ok: [node2]
2026-08-18 13:09:51.123243 | node1 | ok: [node3]
2026-08-18 13:09:51.123498 | node1 |
2026-08-18 13:09:51.123777 | node1 | TASK [Register this RGW host] **************************************************
2026-08-18 13:09:51.124020 | node1 | Tuesday 18 August 2026  13:09:51 +0000 (0:00:00.077)       0:12:27.744 ********
2026-08-18 13:09:51.238552 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3
2026-08-18 13:09:51.238787 | node1 |
2026-08-18 13:09:51.239029 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 13:09:51.239281 | node1 | Tuesday 18 August 2026  13:09:51 +0000 (0:00:00.115)       0:12:27.859 ********
2026-08-18 13:09:52.918728 | node1 | ok: [node1]
2026-08-18 13:09:52.918805 | node1 |
2026-08-18 13:09:52.918820 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 13:09:52.918840 | node1 | Tuesday 18 August 2026  13:09:52 +0000 (0:00:01.679)       0:12:29.538 ********
2026-08-18 13:09:52.992047 | node1 | ok: [node1]
2026-08-18 13:09:52.992130 | node1 | ok: [node2]
2026-08-18 13:09:52.992143 | node1 | ok: [node3]
2026-08-18 13:09:52.992156 | node1 |
2026-08-18 13:09:52.992191 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 13:09:52.992228 | node1 | Tuesday 18 August 2026  13:09:52 +0000 (0:00:00.071)       0:12:29.610 ********
2026-08-18 13:09:53.060710 | node1 | ok: [node1] => {
2026-08-18 13:09:53.060769 | node1 |     "changed": false,
2026-08-18 13:09:53.060966 | node1 |     "msg": "All assertions passed"
2026-08-18 13:09:53.061252 | node1 | }
2026-08-18 13:09:53.061445 | node1 | ok: [node2] => {
2026-08-18 13:09:53.061719 | node1 |     "changed": false,
2026-08-18 13:09:53.061958 | node1 |     "msg": "All assertions passed"
2026-08-18 13:09:53.062189 | node1 | }
2026-08-18 13:09:53.062469 | node1 | ok: [node3] => {
2026-08-18 13:09:53.062745 | node1 |     "changed": false,
2026-08-18 13:09:53.062979 | node1 |     "msg": "All assertions passed"
2026-08-18 13:09:53.063208 | node1 | }
2026-08-18 13:09:53.063427 | node1 |
2026-08-18 13:09:53.063717 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 13:09:53.063977 | node1 | Tuesday 18 August 2026  13:09:53 +0000 (0:00:00.070)       0:12:29.681 ********
2026-08-18 13:09:53.422442 | node1 | ok: [node1]
2026-08-18 13:09:53.422692 | node1 | ok: [node2]
2026-08-18 13:09:53.422932 | node1 | ok: [node3]
2026-08-18 13:09:53.423155 | node1 |
2026-08-18 13:09:53.423428 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 13:09:53.423708 | node1 | Tuesday 18 August 2026  13:09:53 +0000 (0:00:00.362)       0:12:30.043 ********
2026-08-18 13:09:53.497422 | node1 | ok: [node1]
2026-08-18 13:09:53.497676 | node1 | ok: [node2]
2026-08-18 13:09:53.497941 | node1 | ok: [node3]
2026-08-18 13:09:53.498155 | node1 |
2026-08-18 13:09:53.498412 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 13:09:53.498690 | node1 | Tuesday 18 August 2026  13:09:53 +0000 (0:00:00.075)       0:12:30.118 ********
2026-08-18 13:09:53.603457 | node1 | ok: [node1]
2026-08-18 13:09:53.603708 | node1 | ok: [node2]
2026-08-18 13:09:53.603936 | node1 | ok: [node3]
2026-08-18 13:09:53.604152 | node1 |
2026-08-18 13:09:53.604411 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 13:09:53.604690 | node1 | Tuesday 18 August 2026  13:09:53 +0000 (0:00:00.106)       0:12:30.224 ********
2026-08-18 13:09:53.675492 | node1 | ok: [node1] => {
2026-08-18 13:09:53.675757 | node1 |     "changed": false,
2026-08-18 13:09:53.676012 | node1 |     "msg": "All assertions passed"
2026-08-18 13:09:53.676263 | node1 | }
2026-08-18 13:09:53.676502 | node1 | ok: [node2] => {
2026-08-18 13:09:53.676778 | node1 |     "changed": false,
2026-08-18 13:09:53.677015 | node1 |     "msg": "All assertions passed"
2026-08-18 13:09:53.677243 | node1 | }
2026-08-18 13:09:53.677469 | node1 | ok: [node3] => {
2026-08-18 13:09:53.677756 | node1 |     "changed": false,
2026-08-18 13:09:53.677982 | node1 |     "msg": "All assertions passed"
2026-08-18 13:09:53.678206 | node1 | }
2026-08-18 13:09:53.678657 | node1 |
2026-08-18 13:09:53.678900 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 13:09:53.679181 | node1 | Tuesday 18 August 2026  13:09:53 +0000 (0:00:00.072)       0:12:30.297 ********
2026-08-18 13:09:55.419776 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:09:55.419992 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:09:55.420236 | node1 | ok: [node1]
2026-08-18 13:09:55.420490 | node1 |
2026-08-18 13:09:55.420787 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 13:09:55.421042 | node1 | Tuesday 18 August 2026  13:09:55 +0000 (0:00:01.744)       0:12:32.041 ********
2026-08-18 13:09:55.516637 | node1 | skipping: [node1]
2026-08-18 13:09:55.516864 | node1 | skipping: [node2]
2026-08-18 13:09:55.517109 | node1 | skipping: [node3]
2026-08-18 13:09:55.517328 | node1 |
2026-08-18 13:09:55.517606 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW multisite (realm, zonegroup, zone)] ****
2026-08-18 13:09:55.517872 | node1 | Tuesday 18 August 2026  13:09:55 +0000 (0:00:00.096)       0:12:32.137 ********
2026-08-18 13:09:55.574068 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/multisite.yml for node1
2026-08-18 13:09:55.574273 | node1 |
2026-08-18 13:09:55.574546 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW realms] ********************************
2026-08-18 13:09:55.574844 | node1 | Tuesday 18 August 2026  13:09:55 +0000 (0:00:00.057)       0:12:32.195 ********
2026-08-18 13:09:59.798647 | node1 | changed: [node1] => (item=molecule)
2026-08-18 13:09:59.798895 | node1 |
2026-08-18 13:09:59.799196 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW zonegroups] ****************************
2026-08-18 13:09:59.799485 | node1 | Tuesday 18 August 2026  13:09:59 +0000 (0:00:04.224)       0:12:36.419 ********
2026-08-18 13:10:02.220718 | node1 | changed: [node1] => (item=molecule)
2026-08-18 13:10:02.220792 | node1 |
2026-08-18 13:10:02.221301 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW zones] *********************************
2026-08-18 13:10:02.221356 | node1 | Tuesday 18 August 2026  13:10:02 +0000 (0:00:02.421)       0:12:38.841 ********
2026-08-18 13:10:04.685383 | node1 | changed: [node1] => (item=None)
2026-08-18 13:10:04.685453 | node1 | changed: [node1 -> {{ ceph_rgw_admin_host }}]
2026-08-18 13:10:04.685468 | node1 |
2026-08-18 13:10:04.685482 | node1 | TASK [vexxhost.ceph.rgw : Commit the RGW period] *******************************
2026-08-18 13:10:04.685496 | node1 | Tuesday 18 August 2026  13:10:04 +0000 (0:00:02.463)       0:12:41.305 ********
2026-08-18 13:10:06.365004 | node1 | changed: [node1]
2026-08-18 13:10:06.365069 | node1 |
2026-08-18 13:10:06.365177 | node1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] *************************
2026-08-18 13:10:06.365287 | node1 | Tuesday 18 August 2026  13:10:06 +0000 (0:00:01.679)       0:12:42.984 ********
2026-08-18 13:10:06.424949 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/services.yml for node1
2026-08-18 13:10:06.425005 | node1 |
2026-08-18 13:10:06.425147 | node1 | TASK [vexxhost.ceph.rgw : Snapshot current RGW service specs] ******************
2026-08-18 13:10:06.425287 | node1 | Tuesday 18 August 2026  13:10:06 +0000 (0:00:00.059)       0:12:43.044 ********
2026-08-18 13:10:08.113464 | node1 | ok: [node1]
2026-08-18 13:10:08.113561 | node1 |
2026-08-18 13:10:08.113575 | node1 | TASK [vexxhost.ceph.rgw : Index current RGW specs by service name] *************
2026-08-18 13:10:08.113629 | node1 | Tuesday 18 August 2026  13:10:08 +0000 (0:00:01.688)       0:12:44.732 ********
2026-08-18 13:10:08.162375 | node1 | ok: [node1]
2026-08-18 13:10:08.162436 | node1 |
2026-08-18 13:10:08.162451 | node1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] *************************
2026-08-18 13:10:08.162469 | node1 | Tuesday 18 August 2026  13:10:08 +0000 (0:00:00.049)       0:12:44.782 ********
2026-08-18 13:10:11.406192 | node1 | changed: [node1] => (item=molecule)
2026-08-18 13:10:11.406275 | node1 |
2026-08-18 13:10:11.406445 | node1 | TASK [vexxhost.ceph.rgw : Redeploy RGW services whose redeploy-triggering keys changed] ***
2026-08-18 13:10:11.406648 | node1 | Tuesday 18 August 2026  13:10:11 +0000 (0:00:03.242)       0:12:48.024 ********
2026-08-18 13:10:13.033026 | node1 | failed: [node1] (item=rgw.molecule) => {"ansible_loop_var": "item", "changed": true, "cmd": ["cephadm", "shell", "--fsid", "1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", "--config", "/var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.node1/config", "--", "ceph", "orch", "redeploy", "rgw.molecule"], "delta": "0:00:01.367155", "end": "2026-08-18 13:10:12.999278", "item": {"count_per_host": 1, "id": "molecule", "networks": ["0.0.0.0/0"], "spec": {"generate_cert": true, "rgw_frontend_port": 8080, "rgw_realm": "molecule", "rgw_zone": "molecule-1", "rgw_zonegroup": "molecule", "ssl": true}}, "msg": "non-zero return code", "rc": 22, "start": "2026-08-18 13:10:11.632123", "stderr": "Error EINVAL: No daemons exist under service name \"rgw.molecule\". View currently running services using \"ceph orch ls\"", "stderr_lines": ["Error EINVAL: No daemons exist under service name \"rgw.molecule\". View currently running services using \"ceph orch ls\""], "stdout": "", "stdout_lines": []}
2026-08-18 13:10:13.051737 | node1 |
2026-08-18 13:10:13.051797 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zone / zonegroup / pools] *********
2026-08-18 13:10:13.051903 | node1 | Tuesday 18 August 2026  13:10:13 +0000 (0:00:01.647)       0:12:49.671 ********
2026-08-18 13:10:13.117452 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/cleanup.yml for node2
2026-08-18 13:10:13.117534 | node1 |
2026-08-18 13:10:13.117545 | node1 | TASK [vexxhost.ceph.rgw : List RGW zones] **************************************
2026-08-18 13:10:13.117640 | node1 | Tuesday 18 August 2026  13:10:13 +0000 (0:00:00.065)       0:12:49.737 ********
2026-08-18 13:10:14.376556 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:10:14.376959 | node1 |
2026-08-18 13:10:14.377294 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zonegroup] ************************
2026-08-18 13:10:14.377708 | node1 | Tuesday 18 August 2026  13:10:14 +0000 (0:00:01.260)       0:12:50.997 ********
2026-08-18 13:10:14.424572 | node1 | skipping: [node2]
2026-08-18 13:10:14.424935 | node1 |
2026-08-18 13:10:14.425256 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zone] *****************************
2026-08-18 13:10:14.425637 | node1 | Tuesday 18 August 2026  13:10:14 +0000 (0:00:00.048)       0:12:51.045 ********
2026-08-18 13:10:14.473740 | node1 | skipping: [node2]
2026-08-18 13:10:14.473801 | node1 |
2026-08-18 13:10:14.473975 | node1 | TASK [vexxhost.ceph.rgw : Get the current pool deletion setting] ***************
2026-08-18 13:10:14.474209 | node1 | Tuesday 18 August 2026  13:10:14 +0000 (0:00:00.048)       0:12:51.094 ********
2026-08-18 13:10:14.521056 | node1 | skipping: [node2]
2026-08-18 13:10:14.521237 | node1 |
2026-08-18 13:10:14.521547 | node1 | TASK [vexxhost.ceph.rgw : Allow pool deletion] *********************************
2026-08-18 13:10:14.521827 | node1 | Tuesday 18 August 2026  13:10:14 +0000 (0:00:00.047)       0:12:51.142 ********
2026-08-18 13:10:14.571831 | node1 | skipping: [node2]
2026-08-18 13:10:14.572101 | node1 |
2026-08-18 13:10:14.572338 | node1 | TASK [vexxhost.ceph.rgw : Remove the default RGW pools] ************************
2026-08-18 13:10:14.572723 | node1 | Tuesday 18 August 2026  13:10:14 +0000 (0:00:00.050)       0:12:51.192 ********
2026-08-18 13:10:14.652032 | node1 | skipping: [node2] => (item=default.rgw.control)
2026-08-18 13:10:14.652191 | node1 | skipping: [node2] => (item=default.rgw.log)
2026-08-18 13:10:14.667655 | node1 | skipping: [node2] => (item=default.rgw.meta)
2026-08-18 13:10:14.667699 | node1 | skipping: [node2]
2026-08-18 13:10:14.667706 | node1 |
2026-08-18 13:10:14.667711 | node1 | TASK [vexxhost.ceph.rgw : Restore the configured pool deletion setting] ********
2026-08-18 13:10:14.667717 | node1 | Tuesday 18 August 2026  13:10:14 +0000 (0:00:00.080)       0:12:51.273 ********
2026-08-18 13:10:14.704649 | node1 | skipping: [node2]
2026-08-18 13:10:14.704709 | node1 |
2026-08-18 13:10:14.704724 | node1 | TASK [vexxhost.ceph.rgw : Remove the temporary pool deletion setting] **********
2026-08-18 13:10:14.704740 | node1 | Tuesday 18 August 2026  13:10:14 +0000 (0:00:00.051)       0:12:51.325 ********
2026-08-18 13:10:14.800715 | node1 | skipping: [node2]
2026-08-18 13:10:14.800773 | node1 |
2026-08-18 13:10:14.800788 | node1 | PLAY [Deploy Ceph monitoring stack] ********************************************
2026-08-18 13:10:14.800800 | node1 |
2026-08-18 13:10:14.800817 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 13:10:14.800982 | node1 | Tuesday 18 August 2026  13:10:14 +0000 (0:00:00.096)       0:12:51.421 ********
2026-08-18 13:10:16.843864 | node1 | ok: [node2]
2026-08-18 13:10:16.843933 | node1 | ok: [node3]
2026-08-18 13:10:16.844038 | node1 |
2026-08-18 13:10:16.844175 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:10:16.844309 | node1 | Tuesday 18 August 2026  13:10:16 +0000 (0:00:02.044)       0:12:53.465 ********
2026-08-18 13:10:17.114570 | node1 | ok: [node2]
2026-08-18 13:10:17.114917 | node1 | ok: [node3]
2026-08-18 13:10:17.115228 | node1 |
2026-08-18 13:10:17.115513 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:10:17.115881 | node1 | Tuesday 18 August 2026  13:10:17 +0000 (0:00:00.270)       0:12:53.735 ********
2026-08-18 13:10:17.179267 | node1 | skipping: [node2]
2026-08-18 13:10:17.179473 | node1 | skipping: [node3]
2026-08-18 13:10:17.179739 | node1 |
2026-08-18 13:10:17.179984 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 13:10:17.180236 | node1 | Tuesday 18 August 2026  13:10:17 +0000 (0:00:00.064)       0:12:53.800 ********
2026-08-18 13:10:17.468060 | node1 | ok: [node2]
2026-08-18 13:10:17.468328 | node1 | ok: [node3]
2026-08-18 13:10:17.468556 | node1 |
2026-08-18 13:10:17.468844 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:10:17.469090 | node1 | Tuesday 18 August 2026  13:10:17 +0000 (0:00:00.288)       0:12:54.089 ********
2026-08-18 13:10:17.596183 | node1 | ok: [node2] => {
2026-08-18 13:10:17.596309 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:10:17.596465 | node1 | }
2026-08-18 13:10:17.596646 | node1 | ok: [node3] => {
2026-08-18 13:10:17.596822 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:10:17.596938 | node1 | }
2026-08-18 13:10:17.597068 | node1 |
2026-08-18 13:10:17.597201 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:10:17.597360 | node1 | Tuesday 18 August 2026  13:10:17 +0000 (0:00:00.127)       0:12:54.216 ********
2026-08-18 13:10:18.023678 | node1 | ok: [node2]
2026-08-18 13:10:18.023752 | node1 | ok: [node3]
2026-08-18 13:10:18.023763 | node1 |
2026-08-18 13:10:18.024078 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:10:18.024338 | node1 | Tuesday 18 August 2026  13:10:18 +0000 (0:00:00.427)       0:12:54.644 ********
2026-08-18 13:10:18.112005 | node1 | skipping: [node2]
2026-08-18 13:10:18.112094 | node1 | skipping: [node3]
2026-08-18 13:10:18.112440 | node1 |
2026-08-18 13:10:18.112466 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:10:18.112471 | node1 | Tuesday 18 August 2026  13:10:18 +0000 (0:00:00.087)       0:12:54.731 ********
2026-08-18 13:10:18.196418 | node1 | skipping: [node2]
2026-08-18 13:10:18.196465 | node1 | skipping: [node3]
2026-08-18 13:10:18.196476 | node1 |
2026-08-18 13:10:18.196487 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:10:18.196497 | node1 | Tuesday 18 August 2026  13:10:18 +0000 (0:00:00.083)       0:12:54.815 ********
2026-08-18 13:10:18.476363 | node1 | ok: [node3]
2026-08-18 13:10:18.476396 | node1 | ok: [node2]
2026-08-18 13:10:18.476402 | node1 |
2026-08-18 13:10:18.476407 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:10:18.476412 | node1 | Tuesday 18 August 2026  13:10:18 +0000 (0:00:00.279)       0:12:55.095 ********
2026-08-18 13:10:19.639332 | node1 | ok: [node2]
2026-08-18 13:10:19.640480 | node1 | ok: [node3]
2026-08-18 13:10:19.640510 | node1 |
2026-08-18 13:10:19.640536 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:10:19.640549 | node1 | Tuesday 18 August 2026  13:10:19 +0000 (0:00:01.164)       0:12:56.260 ********
2026-08-18 13:10:19.737763 | node1 | ok: [node2] => {
2026-08-18 13:10:19.737788 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:10:19.737794 | node1 | }
2026-08-18 13:10:19.737799 | node1 | ok: [node3] => {
2026-08-18 13:10:19.737804 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:10:19.737810 | node1 | }
2026-08-18 13:10:19.737815 | node1 |
2026-08-18 13:10:19.737820 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:10:19.737826 | node1 | Tuesday 18 August 2026  13:10:19 +0000 (0:00:00.094)       0:12:56.355 ********
2026-08-18 13:10:20.160752 | node1 | ok: [node2]
2026-08-18 13:10:20.160794 | node1 | ok: [node3]
2026-08-18 13:10:20.160804 | node1 |
2026-08-18 13:10:20.160812 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:10:20.160819 | node1 | Tuesday 18 August 2026  13:10:20 +0000 (0:00:00.426)       0:12:56.781 ********
2026-08-18 13:10:22.355238 | node1 | ok: [node2]
2026-08-18 13:10:22.355633 | node1 | ok: [node3]
2026-08-18 13:10:22.355944 | node1 |
2026-08-18 13:10:22.356267 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 13:10:22.356613 | node1 | Tuesday 18 August 2026  13:10:22 +0000 (0:00:02.195)       0:12:58.976 ********
2026-08-18 13:10:22.404094 | node1 | skipping: [node2]
2026-08-18 13:10:22.404141 | node1 | skipping: [node3]
2026-08-18 13:10:22.404498 | node1 |
2026-08-18 13:10:22.404534 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 13:10:22.404554 | node1 | Tuesday 18 August 2026  13:10:22 +0000 (0:00:00.048)       0:12:59.025 ********
2026-08-18 13:10:22.460186 | node1 | skipping: [node2]
2026-08-18 13:10:22.460272 | node1 | skipping: [node3]
2026-08-18 13:10:22.460376 | node1 |
2026-08-18 13:10:22.460497 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 13:10:22.460664 | node1 | Tuesday 18 August 2026  13:10:22 +0000 (0:00:00.056)       0:12:59.081 ********
2026-08-18 13:10:22.523739 | node1 | skipping: [node2]
2026-08-18 13:10:22.523810 | node1 | skipping: [node3]
2026-08-18 13:10:22.524343 | node1 |
2026-08-18 13:10:22.524409 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 13:10:22.524419 | node1 | Tuesday 18 August 2026  13:10:22 +0000 (0:00:00.062)       0:12:59.143 ********
2026-08-18 13:10:23.740080 | node1 | ok: [node2]
2026-08-18 13:10:23.740220 | node1 | ok: [node3]
2026-08-18 13:10:23.740232 | node1 |
2026-08-18 13:10:23.740246 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 13:10:23.740392 | node1 | Tuesday 18 August 2026  13:10:23 +0000 (0:00:01.216)       0:13:00.359 ********
2026-08-18 13:10:24.313335 | node1 | ok: [node2]
2026-08-18 13:10:24.313449 | node1 | ok: [node3]
2026-08-18 13:10:24.313476 | node1 |
2026-08-18 13:10:24.313490 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 13:10:24.316698 | node1 | Tuesday 18 August 2026  13:10:24 +0000 (0:00:00.575)       0:13:00.934 ********
2026-08-18 13:10:25.492654 | node1 | ok: [node2] => (item={'path': '/etc/containerd'})
2026-08-18 13:10:25.492717 | node1 | ok: [node3] => (item={'path': '/etc/containerd'})
2026-08-18 13:10:25.492730 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:10:25.492743 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:10:25.492754 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:10:25.492765 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:10:25.492776 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:10:25.492788 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:10:25.492799 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:10:25.492910 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:10:25.493205 | node1 |
2026-08-18 13:10:25.493525 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 13:10:25.493872 | node1 | Tuesday 18 August 2026  13:10:25 +0000 (0:00:01.176)       0:13:02.111 ********
2026-08-18 13:10:26.231183 | node1 | ok: [node2]
2026-08-18 13:10:26.231427 | node1 | ok: [node3]
2026-08-18 13:10:26.231673 | node1 |
2026-08-18 13:10:26.231893 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:10:26.232107 | node1 | Tuesday 18 August 2026  13:10:26 +0000 (0:00:00.723)       0:13:02.834 ********
2026-08-18 13:10:26.232290 | node1 |
2026-08-18 13:10:26.232500 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:10:26.232718 | node1 | Tuesday 18 August 2026  13:10:26 +0000 (0:00:00.007)       0:13:02.842 ********
2026-08-18 13:10:26.232902 | node1 |
2026-08-18 13:10:26.233128 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 13:10:26.233325 | node1 | Tuesday 18 August 2026  13:10:26 +0000 (0:00:00.009)       0:13:02.852 ********
2026-08-18 13:10:26.736401 | node1 | ok: [node2]
2026-08-18 13:10:26.736811 | node1 | ok: [node3]
2026-08-18 13:10:26.737113 | node1 |
2026-08-18 13:10:26.737435 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:10:26.737843 | node1 | Tuesday 18 August 2026  13:10:26 +0000 (0:00:00.504)       0:13:03.356 ********
2026-08-18 13:10:27.006211 | node1 | ok: [node3]
2026-08-18 13:10:27.006653 | node1 | ok: [node2]
2026-08-18 13:10:27.007069 | node1 |
2026-08-18 13:10:27.007476 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:10:27.007878 | node1 | Tuesday 18 August 2026  13:10:27 +0000 (0:00:00.270)       0:13:03.627 ********
2026-08-18 13:10:27.085738 | node1 | ok: [node2] => {
2026-08-18 13:10:27.086169 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:10:27.086521 | node1 | }
2026-08-18 13:10:27.086901 | node1 | ok: [node3] => {
2026-08-18 13:10:27.087279 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:10:27.087644 | node1 | }
2026-08-18 13:10:27.088017 | node1 |
2026-08-18 13:10:27.088815 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:10:27.089312 | node1 | Tuesday 18 August 2026  13:10:27 +0000 (0:00:00.079)       0:13:03.706 ********
2026-08-18 13:10:27.539821 | node1 | ok: [node2]
2026-08-18 13:10:27.540235 | node1 | ok: [node3]
2026-08-18 13:10:27.540530 | node1 |
2026-08-18 13:10:27.540898 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:10:27.541216 | node1 | Tuesday 18 August 2026  13:10:27 +0000 (0:00:00.453)       0:13:04.160 ********
2026-08-18 13:10:30.916157 | node1 | ok: [node2]
2026-08-18 13:10:30.917280 | node1 | ok: [node3]
2026-08-18 13:10:30.917309 | node1 |
2026-08-18 13:10:30.917322 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 13:10:30.917335 | node1 | Tuesday 18 August 2026  13:10:30 +0000 (0:00:03.377)       0:13:07.537 ********
2026-08-18 13:10:32.079377 | node1 | ok: [node2]
2026-08-18 13:10:32.079503 | node1 | ok: [node3]
2026-08-18 13:10:32.079527 | node1 |
2026-08-18 13:10:32.079713 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 13:10:32.079982 | node1 | Tuesday 18 August 2026  13:10:32 +0000 (0:00:01.162)       0:13:08.700 ********
2026-08-18 13:10:32.356787 | node1 | ok: [node2]
2026-08-18 13:10:32.356911 | node1 | ok: [node3]
2026-08-18 13:10:32.356930 | node1 |
2026-08-18 13:10:32.356947 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 13:10:32.356961 | node1 | Tuesday 18 August 2026  13:10:32 +0000 (0:00:00.275)       0:13:08.975 ********
2026-08-18 13:10:32.933684 | node1 | ok: [node2]
2026-08-18 13:10:32.933904 | node1 | ok: [node3]
2026-08-18 13:10:32.934123 | node1 |
2026-08-18 13:10:32.934379 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 13:10:32.934663 | node1 | Tuesday 18 August 2026  13:10:32 +0000 (0:00:00.577)       0:13:09.553 ********
2026-08-18 13:10:33.695527 | node1 | ok: [node2] => (item={'path': '/etc/docker'})
2026-08-18 13:10:33.695628 | node1 | ok: [node3] => (item={'path': '/etc/docker'})
2026-08-18 13:10:33.695735 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:10:33.696450 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:10:33.696517 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:10:33.696524 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:10:33.696530 | node1 |
2026-08-18 13:10:33.696538 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 13:10:33.696544 | node1 | Tuesday 18 August 2026  13:10:33 +0000 (0:00:00.761)       0:13:10.314 ********
2026-08-18 13:10:34.265553 | node1 | ok: [node2]
2026-08-18 13:10:34.265613 | node1 | ok: [node3]
2026-08-18 13:10:34.265621 | node1 |
2026-08-18 13:10:34.265626 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 13:10:34.265632 | node1 | Tuesday 18 August 2026  13:10:34 +0000 (0:00:00.569)       0:13:10.884 ********
2026-08-18 13:10:34.845646 | node1 | ok: [node2]
2026-08-18 13:10:34.845700 | node1 | ok: [node3]
2026-08-18 13:10:34.845713 | node1 |
2026-08-18 13:10:34.845726 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:10:34.845738 | node1 | Tuesday 18 August 2026  13:10:34 +0000 (0:00:00.566)       0:13:11.451 ********
2026-08-18 13:10:34.845750 | node1 |
2026-08-18 13:10:34.845761 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:10:34.845799 | node1 | Tuesday 18 August 2026  13:10:34 +0000 (0:00:00.006)       0:13:11.458 ********
2026-08-18 13:10:34.845807 | node1 |
2026-08-18 13:10:34.845816 | node1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 13:10:34.845990 | node1 | Tuesday 18 August 2026  13:10:34 +0000 (0:00:00.006)       0:13:11.464 ********
2026-08-18 13:10:35.320265 | node1 | ok: [node2]
2026-08-18 13:10:35.320383 | node1 | ok: [node3]
2026-08-18 13:10:35.320698 | node1 |
2026-08-18 13:10:35.320773 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:10:35.320923 | node1 | Tuesday 18 August 2026  13:10:35 +0000 (0:00:00.476)       0:13:11.940 ********
2026-08-18 13:10:35.387424 | node1 | ok: [node2] => {
2026-08-18 13:10:35.389568 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:10:35.389630 | node1 | }
2026-08-18 13:10:35.389640 | node1 | ok: [node3] => {
2026-08-18 13:10:35.389649 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:10:35.389657 | node1 | }
2026-08-18 13:10:35.389666 | node1 |
2026-08-18 13:10:35.389675 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:10:35.389686 | node1 | Tuesday 18 August 2026  13:10:35 +0000 (0:00:00.066)       0:13:12.007 ********
2026-08-18 13:10:35.753421 | node1 | ok: [node2]
2026-08-18 13:10:35.753473 | node1 | ok: [node3]
2026-08-18 13:10:35.753484 | node1 |
2026-08-18 13:10:35.753494 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:10:35.753503 | node1 | Tuesday 18 August 2026  13:10:35 +0000 (0:00:00.364)       0:13:12.372 ********
2026-08-18 13:10:35.813654 | node1 | skipping: [node2]
2026-08-18 13:10:35.813700 | node1 | skipping: [node3]
2026-08-18 13:10:35.814389 | node1 |
2026-08-18 13:10:35.814433 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 13:10:35.814444 | node1 | Tuesday 18 August 2026  13:10:35 +0000 (0:00:00.061)       0:13:12.433 ********
2026-08-18 13:10:35.881231 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-18 13:10:35.881267 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-18 13:10:35.881277 | node1 |
2026-08-18 13:10:35.881287 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 13:10:35.881296 | node1 | Tuesday 18 August 2026  13:10:35 +0000 (0:00:00.067)       0:13:12.501 ********
2026-08-18 13:10:37.015304 | node1 | ok: [node2]
2026-08-18 13:10:37.015367 | node1 | ok: [node3]
2026-08-18 13:10:37.015380 | node1 |
2026-08-18 13:10:37.015393 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 13:10:37.015406 | node1 | Tuesday 18 August 2026  13:10:37 +0000 (0:00:01.133)       0:13:13.635 ********
2026-08-18 13:10:37.859846 | node1 | ok: [node2] => (item=systemd-timesyncd)
2026-08-18 13:10:37.859963 | node1 | ok: [node3] => (item=systemd-timesyncd)
2026-08-18 13:10:37.859978 | node1 | ok: [node2] => (item=ssh)
2026-08-18 13:10:37.859999 | node1 | ok: [node3] => (item=ssh)
2026-08-18 13:10:37.860709 | node1 |
2026-08-18 13:10:37.860765 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 13:10:37.860779 | node1 | Tuesday 18 August 2026  13:10:37 +0000 (0:00:00.845)       0:13:14.480 ********
2026-08-18 13:10:38.126388 | node1 | ok: [node2]
2026-08-18 13:10:38.126445 | node1 | ok: [node3]
2026-08-18 13:10:38.126459 | node1 |
2026-08-18 13:10:38.126471 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 13:10:38.126484 | node1 | Tuesday 18 August 2026  13:10:38 +0000 (0:00:00.266)       0:13:14.746 ********
2026-08-18 13:10:38.454320 | node1 | ok: [node2]
2026-08-18 13:10:38.454374 | node1 | ok: [node3]
2026-08-18 13:10:38.454388 | node1 |
2026-08-18 13:10:38.454412 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 13:10:38.454425 | node1 | Tuesday 18 August 2026  13:10:38 +0000 (0:00:00.328)       0:13:15.074 ********
2026-08-18 13:10:39.018928 | node1 | ok: [node2]
2026-08-18 13:10:39.019010 | node1 | ok: [node3]
2026-08-18 13:10:39.019024 | node1 |
2026-08-18 13:10:39.019071 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 13:10:39.019080 | node1 | Tuesday 18 August 2026  13:10:39 +0000 (0:00:00.563)       0:13:15.637 ********
2026-08-18 13:10:39.071767 | node1 | skipping: [node2]
2026-08-18 13:10:39.071837 | node1 | skipping: [node3]
2026-08-18 13:10:39.071847 | node1 |
2026-08-18 13:10:39.071865 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 13:10:39.072024 | node1 | Tuesday 18 August 2026  13:10:39 +0000 (0:00:00.054)       0:13:15.692 ********
2026-08-18 13:10:39.501251 | node1 | ok: [node2]
2026-08-18 13:10:39.501494 | node1 | ok: [node3]
2026-08-18 13:10:39.501783 | node1 |
2026-08-18 13:10:39.502062 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 13:10:39.502324 | node1 | Tuesday 18 August 2026  13:10:39 +0000 (0:00:00.429)       0:13:16.122 ********
2026-08-18 13:10:40.064266 | node1 | ok: [node2]
2026-08-18 13:10:40.064443 | node1 | ok: [node3]
2026-08-18 13:10:40.064809 | node1 |
2026-08-18 13:10:40.065143 | node1 | TASK [vexxhost.ceph.monitoring : Locate the cluster admin host] ****************
2026-08-18 13:10:40.065479 | node1 | Tuesday 18 August 2026  13:10:40 +0000 (0:00:00.562)       0:13:16.685 ********
2026-08-18 13:10:40.857545 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=node1)
2026-08-18 13:10:40.857753 | node1 | ok: [node2] => (item=node2)
2026-08-18 13:10:40.858006 | node1 | ok: [node2 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 13:10:40.858231 | node1 |
2026-08-18 13:10:40.858483 | node1 | TASK [vexxhost.ceph.monitoring : Select the admin host] ************************
2026-08-18 13:10:40.858763 | node1 | Tuesday 18 August 2026  13:10:40 +0000 (0:00:00.793)       0:13:17.478 ********
2026-08-18 13:10:40.931484 | node1 | ok: [node2]
2026-08-18 13:10:40.931646 | node1 | ok: [node3]
2026-08-18 13:10:40.931869 | node1 |
2026-08-18 13:10:40.932109 | node1 | TASK [vexxhost.ceph.monitoring : Set the admin mon config path] ****************
2026-08-18 13:10:40.932353 | node1 | Tuesday 18 August 2026  13:10:40 +0000 (0:00:00.074)       0:13:17.552 ********
2026-08-18 13:10:40.994872 | node1 | ok: [node2]
2026-08-18 13:10:40.995080 | node1 | ok: [node3]
2026-08-18 13:10:40.995337 | node1 |
2026-08-18 13:10:40.995608 | node1 | TASK [vexxhost.ceph.monitoring : Pin monitoring container images] **************
2026-08-18 13:10:40.995865 | node1 | Tuesday 18 August 2026  13:10:40 +0000 (0:00:00.063)       0:13:17.616 ********
2026-08-18 13:10:41.030391 | node1 | skipping: [node2]
2026-08-18 13:10:41.030560 | node1 |
2026-08-18 13:10:41.030853 | node1 | TASK [vexxhost.ceph.monitoring : Apply the monitoring service specs] ***********
2026-08-18 13:10:41.031102 | node1 | Tuesday 18 August 2026  13:10:41 +0000 (0:00:00.035)       0:13:17.651 ********
2026-08-18 13:10:44.217390 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=ceph-exporter)
2026-08-18 13:10:44.217610 | node1 |
2026-08-18 13:10:44.217871 | node1 | PLAY RECAP *********************************************************************
2026-08-18 13:10:44.218141 | node1 | node1                      : ok=204  changed=46   unreachable=0    failed=1    skipped=37   rescued=0    ignored=0
2026-08-18 13:10:44.218489 | node1 | node2                      : ok=210  changed=28   unreachable=0    failed=0    skipped=53   rescued=0    ignored=0
2026-08-18 13:10:44.218806 | node1 | node3                      : ok=206  changed=27   unreachable=0    failed=0    skipped=45   rescued=0    ignored=0
2026-08-18 13:10:44.219022 | node1 |
2026-08-18 13:10:44.219244 | node1 |
2026-08-18 13:10:44.219482 | node1 | TASKS RECAP ********************************************************************
2026-08-18 13:10:44.219795 | node1 | Tuesday 18 August 2026  13:10:44 +0000 (0:00:03.186)       0:13:20.837 ********
2026-08-18 13:10:44.220018 | node1 | ===============================================================================
2026-08-18 13:10:44.220266 | node1 | vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices ------ 355.21s
2026-08-18 13:10:44.220510 | node1 | vexxhost.ceph.cephadm : Pre-pull the Ceph image ------------------------ 51.10s
2026-08-18 13:10:44.220793 | node1 | vexxhost.ceph.mon : Bootstrap the cluster ------------------------------ 40.92s
2026-08-18 13:10:44.221109 | node1 | vexxhost.ceph.configure : Configure pools ------------------------------ 35.36s
2026-08-18 13:10:44.221374 | node1 | vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host -- 21.82s
2026-08-18 13:10:44.221720 | node1 | vexxhost.ceph.cephadm_host : Register the host (labels) ---------------- 20.84s
2026-08-18 13:10:44.221963 | node1 | vexxhost.ceph.configure : Apply central Ceph configuration ------------- 18.96s
2026-08-18 13:10:44.222208 | node1 | vexxhost.containers.containerd : Install AppArmor packages ------------- 15.66s
2026-08-18 13:10:44.222452 | node1 | vexxhost.ceph.configure : Configure CRUSH rules ------------------------ 12.24s
2026-08-18 13:10:44.222728 | node1 | vexxhost.ceph.mgr : Configure ceph-mgr modules ------------------------- 10.32s
2026-08-18 13:10:44.222965 | node1 | vexxhost.ceph.configure : Configure dashboard users -------------------- 10.26s
2026-08-18 13:10:44.223203 | node1 | vexxhost.ceph.mgr : Apply the manager service spec ---------------------- 9.27s
2026-08-18 13:10:44.223520 | node1 | vexxhost.ceph.mon : Wait for this monitor's daemon to be present -------- 8.11s
2026-08-18 13:10:44.223811 | node1 | vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate --- 7.23s
2026-08-18 13:10:44.224048 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 5.73s
2026-08-18 13:10:44.224289 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.32s
2026-08-18 13:10:44.224534 | node1 | vexxhost.ceph.rgw : Configure RGW realms -------------------------------- 4.22s
2026-08-18 13:10:44.224807 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.13s
2026-08-18 13:10:44.225109 | node1 | vexxhost.ceph.mon : Generate a cephadm SSH keypair when none was provided --- 4.03s
2026-08-18 13:10:44.225327 | node1 | vexxhost.ceph.mon : Apply the monitor service spec ---------------------- 3.41s
2026-08-18 13:10:44.332833 | node1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-08-18 13:10:44.333003 | node1 | ERROR    [default > converge] Executed: Failed
2026-08-18 13:10:44.333134 | node1 | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-08-18 13:10:54.490125 | node1 | ERROR
2026-08-18 13:10:54.490359 | node1 | {
2026-08-18 13:10:54.490405 | node1 |   "delta": "0:14:48.907269",
2026-08-18 13:10:54.490426 | node1 |   "end": "2026-08-18 13:10:44.396517",
2026-08-18 13:10:54.490444 | node1 |   "msg": "non-zero return code",
2026-08-18 13:10:54.490462 | node1 |   "rc": 2,
2026-08-18 13:10:54.490479 | node1 |   "start": "2026-08-18 12:55:55.489248"
2026-08-18 13:10:54.490498 | node1 | }
failure
2026-08-18 13:10:54.513159 | 
2026-08-18 13:10:54.513240 | PLAY RECAP
2026-08-18 13:10:54.513317 | node1 | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-08-18 13:10:54.513361 | 
2026-08-18 13:10:54.683962 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-18 13:10:54.701243 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-18 13:10:55.371931 | 
2026-08-18 13:10:55.372073 | PLAY [all]
2026-08-18 13:10:55.384909 | 
2026-08-18 13:10:55.385005 | TASK [fetch-output : Set log path for multiple nodes]
2026-08-18 13:10:55.437974 | node1 | ok
2026-08-18 13:10:55.442911 | node2 | ok
2026-08-18 13:10:55.461512 | node3 | ok
2026-08-18 13:10:55.468179 | 
2026-08-18 13:10:55.468295 | TASK [fetch-output : Set log path for single node]
2026-08-18 13:10:55.504303 | node1 | skipping: Conditional result was False
2026-08-18 13:10:55.505604 | node2 | skipping: Conditional result was False
2026-08-18 13:10:55.516181 | node3 | skipping: Conditional result was False
2026-08-18 13:10:55.527907 | 
2026-08-18 13:10:55.528519 | LOOP [fetch-output : Ensure local output dirs]
2026-08-18 13:10:55.945444 | node1 -> localhost | changed: "/var/lib/zuul/builds/7a9e062a129446c280273372d57d08af/work/logs/node1"
2026-08-18 13:10:55.963603 | node3 -> localhost | changed: "/var/lib/zuul/builds/7a9e062a129446c280273372d57d08af/work/logs/node3"
2026-08-18 13:10:55.991666 | node2 -> localhost | changed: "/var/lib/zuul/builds/7a9e062a129446c280273372d57d08af/work/logs/node2"
2026-08-18 13:10:56.148743 | node1 -> localhost | changed: "/var/lib/zuul/builds/7a9e062a129446c280273372d57d08af/work/artifacts"
2026-08-18 13:10:56.161323 | node3 -> localhost | ok: "/var/lib/zuul/builds/7a9e062a129446c280273372d57d08af/work/artifacts"
2026-08-18 13:10:56.196455 | node2 -> localhost | ok: "/var/lib/zuul/builds/7a9e062a129446c280273372d57d08af/work/artifacts"
2026-08-18 13:10:56.358274 | node3 -> localhost | changed: "/var/lib/zuul/builds/7a9e062a129446c280273372d57d08af/work/docs"
2026-08-18 13:10:56.376844 | node1 -> localhost | ok: "/var/lib/zuul/builds/7a9e062a129446c280273372d57d08af/work/docs"
2026-08-18 13:10:56.377018 | node1 -> localhost | changed: All items complete
2026-08-18 13:10:56.377081 | 
2026-08-18 13:10:56.396031 | node2 -> localhost | ok: "/var/lib/zuul/builds/7a9e062a129446c280273372d57d08af/work/docs"
2026-08-18 13:10:56.413826 | 
2026-08-18 13:10:56.414190 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-08-18 13:10:57.023890 | node3 | changed: .d..t...... ./
2026-08-18 13:10:57.024278 | node3 | changed: All items complete
2026-08-18 13:10:57.024318 | 
2026-08-18 13:10:57.059247 | node2 | changed: .d..t...... ./
2026-08-18 13:10:57.066493 | node1 | changed: .d..t...... ./
2026-08-18 13:10:57.514254 | node3 | changed: .d..t...... ./
2026-08-18 13:10:57.523899 | node1 | ok
2026-08-18 13:10:57.530690 | node2 | ok
2026-08-18 13:10:57.994768 | node1 | changed: .d..t...... ./
2026-08-18 13:10:58.029560 | node3 | ok
2026-08-18 13:10:58.036255 | node2 | ok
2026-08-18 13:10:58.077380 | 
2026-08-18 13:10:58.077579 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-08-18 13:10:58.478487 | node1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.009413
2026-08-18 13:10:58.478808 | node1 -> localhost | changed: All items complete
2026-08-18 13:10:58.478846 | 
2026-08-18 13:10:58.698898 | node1 -> localhost | ok: Item: docs Runtime: 0:00:00.006928
2026-08-18 13:10:58.734510 | 
2026-08-18 13:10:58.734667 | PLAY [all]
2026-08-18 13:10:58.749708 | 
2026-08-18 13:10:58.749882 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-08-18 13:10:59.269408 | node1 | changed
2026-08-18 13:10:59.483658 | node3 | changed
2026-08-18 13:10:59.503682 | node2 | changed
2026-08-18 13:10:59.518808 | 
2026-08-18 13:10:59.518861 | PLAY RECAP
2026-08-18 13:10:59.518910 | node1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-18 13:10:59.518938 | node2 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-18 13:10:59.518963 | node3 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-18 13:10:59.518982 | 
2026-08-18 13:10:59.673070 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-18 13:10:59.692341 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-08-18 13:11:00.348848 | 
2026-08-18 13:11:00.349029 | PLAY [localhost]
2026-08-18 13:11:00.360419 | 
2026-08-18 13:11:00.360523 | TASK [Generate Zuul manifest]
2026-08-18 13:11:00.381772 | localhost | ok
2026-08-18 13:11:00.402178 | 
2026-08-18 13:11:00.402330 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-08-18 13:11:00.769709 | localhost | changed
2026-08-18 13:11:00.780728 | 
2026-08-18 13:11:00.780800 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-08-18 13:11:00.816088 | localhost | ok
2026-08-18 13:11:00.825049 | 
2026-08-18 13:11:00.825137 | TASK [Upload logs]
2026-08-18 13:11:00.846051 | localhost | ok
2026-08-18 13:11:00.958462 | 
2026-08-18 13:11:00.958628 | TASK [Set zuul-log-path fact]
2026-08-18 13:11:00.984155 | localhost | ok
2026-08-18 13:11:00.999788 | 
2026-08-18 13:11:00.999897 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-18 13:11:01.032875 | localhost | ok
2026-08-18 13:11:01.042272 | 
2026-08-18 13:11:01.042368 | TASK [upload-logs : Create log directories]
2026-08-18 13:11:01.418387 | localhost | changed
2026-08-18 13:11:01.424720 | 
2026-08-18 13:11:01.424801 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-08-18 13:11:01.790523 | localhost -> localhost | ok: Runtime: 0:00:00.006151
2026-08-18 13:11:01.797560 | 
2026-08-18 13:11:01.797653 | TASK [upload-logs : Upload logs to log server]
2026-08-18 13:11:02.291620 | localhost | Output suppressed because no_log was given
2026-08-18 13:11:02.299462 | 
2026-08-18 13:11:02.299537 | LOOP [upload-logs : Compress console log and json output]
2026-08-18 13:11:02.351167 | localhost | skipping: Conditional result was False
2026-08-18 13:11:02.358868 | localhost | skipping: Conditional result was False
2026-08-18 13:11:02.375428 | 
2026-08-18 13:11:02.375640 | LOOP [upload-logs : Upload compressed console log and json output]
2026-08-18 13:11:02.421968 | localhost | skipping: Conditional result was False
2026-08-18 13:11:02.422505 | 
2026-08-18 13:11:02.425859 | localhost | skipping: Conditional result was False
2026-08-18 13:11:02.441784 | 
2026-08-18 13:11:02.441917 | LOOP [upload-logs : Upload console log and json output]