Skip to content

[ci] Let collect-logs skip hosts before SSH and harden post-run log compression - #4303

Open
fyanac wants to merge 1 commit into
openstack-k8s-operators:mainfrom
fyanac:add_skip_node_logs
Open

fyanac wants to merge 1 commit into
openstack-k8s-operators:mainfrom
fyanac:add_skip_node_logs

Conversation

@fyanac

@fyanac fyanac commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

The first play in ci/playbooks/collect-logs.yml runs on every Zuul node and only creates ~/ci-framework-data/logs.
ignore_errors does not cover an unreachable host, so one SSH timeout fails post-run even though the real collection already runs on cifmw_zuul_target_host.

End hosts listed in cifmw_collect_logs_skip_hosts before opening a connection. The list defaults to empty, so existing jobs are unchanged.

e2e-collect-logs and collect-logs both compress CRC kubelet logs; gzip
without -f failed when kubelet.log.gz already existed and caused
post_failure on multinode jobs. Use gzip -f, tolerate compress errors on
the controller always block, and treat empty ausearch/grep as success.

Assisted-By: Grok 4.7

Signed-off-by: Fiorella Yanac fyanac@redhat.com

@openshift-ci

openshift-ci Bot commented Oct 27, 2026

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign evallesp for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@qodo-code-review

Copy link
Copy Markdown

Qodo reviews are paused for this user.

Troubleshooting steps vary by plan Learn more →

On a Teams plan?
Reviews resume once this user has a paid seat and their Git account is linked in Qodo.
Link Git account →

Using GitHub Enterprise Server, GitLab Self-Managed, or Bitbucket Data Center?
These require an Enterprise plan - Contact us
Contact us →

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/b3cdb1d83bb049d98a6a38005a098664

✔️ openstack-k8s-operators-content-provider SUCCESS in 5h 40m 26s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 16m 06s
✔️ podified-multinode-edpm-deployment-crc-centos-10 SUCCESS in 1h 16m 21s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 29m 38s
❌ cifmw-crc-podified-edpm-baremetal-minor-update FAILURE in 2h 10m 34s (non-voting)
✔️ periodic-podified-edpm-baremetal-minor-update-bootc-master-ocp-crc SUCCESS in 1h 55m 31s (non-voting)
✔️ podified-multinode-hci-deployment-crc SUCCESS in 1h 53m 37s
❌ cifmw-multinode-tempest FAILURE in 1h 29m 35s
✔️ openstack-k8s-operators-content-provider-bootc SUCCESS in 3h 43m 34s
✔️ cifmw-crc-podified-edpm-baremetal-bootc SUCCESS in 1h 28m 15s
❌ adoption-standalone-to-crc-ceph-provider FAILURE in 1h 58m 09s (non-voting)
❌ whitebox-neutron-tempest-plugin-podified-multinode-edpm-deployment-crc-2comp FAILURE in 3h 24m 00s (non-voting)
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 58s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 55s
✔️ cifmw-content-provider-build-images SUCCESS in 30m 30s
✔️ cifmw-edpm-build-images SUCCESS in 18m 05s
❌ cifmw-multinode-kuttl FAILURE in 2h 54m 30s
❌ cifmw-tcib FAILURE in 7m 37s
✔️ cifmw-architecture-validate-hci SUCCESS in 6m 15s
✔️ ci-framework-openstack-meta-content-provider SUCCESS in 20m 15s
✔️ cifmw-molecule-adoption_osp_deploy SUCCESS in 5m 00s
✔️ cifmw-molecule-artifacts SUCCESS in 5m 58s
✔️ cifmw-molecule-bm_sno SUCCESS in 6m 00s
✔️ cifmw-molecule-build_containers SUCCESS in 9m 24s
✔️ cifmw-molecule-build_openstack_packages SUCCESS in 11m 24s
✔️ cifmw-molecule-cert_manager SUCCESS in 12m 48s
✔️ cifmw-molecule-ci_gen_kustomize_values SUCCESS in 7m 31s
✔️ cifmw-molecule-ci_local_storage SUCCESS in 12m 50s
✔️ cifmw-molecule-ci_multus SUCCESS in 18m 54s
✔️ cifmw-molecule-ci_network SUCCESS in 5m 46s
✔️ cifmw-molecule-ci_nmstate SUCCESS in 24m 44s
✔️ cifmw-molecule-ci_setup SUCCESS in 5m 11s
✔️ cifmw-molecule-cifmw_block_device SUCCESS in 5m 54s
✔️ cifmw-molecule-cifmw_ceph_client SUCCESS in 5m 56s
✔️ cifmw-molecule-cifmw_ceph_spec SUCCESS in 6m 04s
✔️ cifmw-molecule-cifmw_cephadm SUCCESS in 6m 16s
✔️ cifmw-molecule-cifmw_create_admin SUCCESS in 9m 10s
✔️ cifmw-molecule-cifmw_helpers SUCCESS in 6m 22s
✔️ cifmw-molecule-cifmw_ntp SUCCESS in 4m 49s
✔️ cifmw-molecule-cifmw_snr_nhc SUCCESS in 6m 24s
✔️ cifmw-molecule-cifmw_test_role SUCCESS in 6m 09s
✔️ cifmw-molecule-compliance SUCCESS in 5m 42s
✔️ cifmw-molecule-config_drive SUCCESS in 6m 09s
✔️ cifmw-molecule-copy_container SUCCESS in 8m 34s
✔️ cifmw-molecule-deploy_bmh SUCCESS in 5m 11s
✔️ cifmw-molecule-devscripts SUCCESS in 10m 03s
✔️ cifmw-molecule-discover_latest_image SUCCESS in 6m 18s
✔️ cifmw-molecule-dlrn_promote SUCCESS in 7m 31s
✔️ cifmw-molecule-dlrn_report SUCCESS in 5m 44s
✔️ cifmw-molecule-dnsmasq SUCCESS in 6m 27s
✔️ cifmw-molecule-edpm_build_images SUCCESS in 6m 18s
✔️ cifmw-molecule-edpm_deploy SUCCESS in 5m 59s
✔️ cifmw-molecule-edpm_deploy_baremetal SUCCESS in 5m 55s
✔️ cifmw-molecule-edpm_kustomize SUCCESS in 6m 03s
✔️ cifmw-molecule-edpm_prepare SUCCESS in 5m 55s
✔️ cifmw-molecule-env_op_images SUCCESS in 22m 14s
✔️ cifmw-molecule-hci_prepare SUCCESS in 5m 46s
✔️ cifmw-molecule-hive SUCCESS in 5m 41s
✔️ cifmw-molecule-idrac_configuration SUCCESS in 4m 50s
✔️ cifmw-molecule-install_ca SUCCESS in 5m 57s
✔️ cifmw-molecule-install_openstack_ca SUCCESS in 31m 22s
✔️ cifmw-molecule-install_yamls SUCCESS in 5m 56s
✔️ cifmw-molecule-kustomize_deploy SUCCESS in 6m 30s
✔️ cifmw-molecule-libvirt_manager SUCCESS in 47m 56s
✔️ cifmw-molecule-manage_secrets SUCCESS in 17m 38s
✔️ cifmw-molecule-mirror_registry SUCCESS in 12m 05s
✔️ cifmw-molecule-nat64_appliance SUCCESS in 15m 35s
✔️ cifmw-molecule-networking_mapper SUCCESS in 6m 00s
✔️ cifmw-molecule-openshift_login SUCCESS in 21m 22s
✔️ cifmw-molecule-openshift_obs SUCCESS in 15m 04s
✔️ cifmw-molecule-openshift_provisioner_node SUCCESS in 6m 23s
✔️ cifmw-molecule-openshift_setup SUCCESS in 10m 01s
✔️ cifmw-molecule-operator_build SUCCESS in 7m 16s
✔️ cifmw-molecule-operator_deploy SUCCESS in 10m 59s
✔️ cifmw-molecule-os_must_gather SUCCESS in 23m 56s
✔️ cifmw-molecule-os_net_setup SUCCESS in 5m 41s
❌ cifmw-molecule-pkg_build FAILURE in 10m 58s (non-voting)
✔️ cifmw-molecule-podman SUCCESS in 5m 30s
✔️ cifmw-molecule-radvd SUCCESS in 5m 47s
✔️ cifmw-molecule-rally SUCCESS in 5m 55s
✔️ cifmw-molecule-registry_deploy SUCCESS in 6m 07s
✔️ cifmw-molecule-repo_setup SUCCESS in 5m 49s
✔️ cifmw-molecule-reportportal SUCCESS in 4m 36s
✔️ cifmw-molecule-reproducer SUCCESS in 15m 42s
✔️ cifmw-molecule-rhol_crc SUCCESS in 48m 43s
✔️ cifmw-molecule-run_hook SUCCESS in 5m 08s
✔️ cifmw-molecule-s2i_content_set SUCCESS in 5m 45s
✔️ cifmw-molecule-set_openstack_containers SUCCESS in 22m 40s
❌ cifmw-molecule-shiftstack FAILURE in 13m 18s
✔️ cifmw-molecule-ssh_jumper SUCCESS in 5m 49s
✔️ cifmw-molecule-sushy_emulator SUCCESS in 12m 39s
✔️ cifmw-molecule-test_deps SUCCESS in 6m 24s
✔️ cifmw-molecule-test_operator SUCCESS in 4m 36s
✔️ cifmw-molecule-tofu SUCCESS in 10m 28s
✔️ cifmw-molecule-update SUCCESS in 6m 06s
✔️ cifmw-molecule-update_containers SUCCESS in 5m 37s
✔️ cifmw-molecule-validations SUCCESS in 5m 29s
✔️ cifmw-molecule-virtualbmc SUCCESS in 10m 03s
✔️ edpm-ansible-molecule-edpm_podman SUCCESS in 9m 53s
✔️ edpm-ansible-molecule-edpm_ovs SUCCESS in 12m 51s
✔️ edpm-ansible-molecule-edpm_kernel SUCCESS in 23m 29s

Warning:
File .kube/http-cache/57b4a240b05e14143590c924faf8f5b9 found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-pre-commit. Add to preserve-home-paths if safe, or otherwise remove.
File .kube/http-cache/6a08f8b7f457cfb0bbd7f9d1e1cfc6f7 found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-pre-commit. Add to preserve-home-paths if safe, or otherwise remove.
File .kube/http-cache/f602b5784741105fba742abf7b02c24d found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-pre-commit. Add to preserve-home-paths if safe, or otherwise remove.
File .kube/cache/discovery/38.102.83.54_9023/servergroups.json found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-pre-commit. Add to preserve-home-paths if safe, or otherwise remove.
File .kube/cache/discovery/38.102.83.54_9023/v1/serverresources.json found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-pre-commit. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/config found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/pod-jobs.yml for job cifmw-pod-pre-commit. Add to preserve-home-paths if safe, or otherwise remove.
File .kube/http-cache/bdd7b2cb6584e62d442216995e51db5f found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-ansible-test. Add to preserve-home-paths if safe, or otherwise remove.
File .kube/http-cache/3418855402ab8666a195458ea6d5d4a2 found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-ansible-test. Add to preserve-home-paths if safe, or otherwise remove.
File .kube/http-cache/a0a4de7d63733803eeececaa48e4969f found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-ansible-test. Add to preserve-home-paths if safe, or otherwise remove.
File .kube/cache/discovery/38.102.83.139_9023/servergroups.json found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-ansible-test. Add to preserve-home-paths if safe, or otherwise remove.
File .kube/cache/discovery/38.102.83.139_9023/v1/serverresources.json found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-ansible-test. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/config found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/pod-jobs.yml for job cifmw-pod-ansible-test. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/89fdb10f80b444809fc9faa30a83ce50 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-multinode-kuttl. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/0122ab7011f64caf942135da4c3e94c2 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-multinode-kuttl. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/a2f30222cd2c4f769a19a1af1d6a4e5c found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-multinode-kuttl. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/598c96ea0ee8404f8081bb174933951b found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-multinode-kuttl. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/89fdb10f80b444809fc9faa30a83ce50 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job cifmw-multinode-kuttl. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/45c3f5ee546b431cbf47e9462334982e found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job podified-multinode-edpm-deployment-crc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/16db3255902f4cd98516606a2c2f3cdd found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job podified-multinode-edpm-deployment-crc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/45c3f5ee546b431cbf47e9462334982e found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job podified-multinode-edpm-deployment-crc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/16db3255902f4cd98516606a2c2f3cdd found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job podified-multinode-edpm-deployment-crc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/45c3f5ee546b431cbf47e9462334982e found in build home directory during playbook review.rdoproject.org/config/playbooks/crc/print-machineconfigpool.yaml for job podified-multinode-edpm-deployment-crc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/ded4336900bc499ca6f06ecaf9e7d8bb found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job podified-multinode-edpm-deployment-crc-centos-10. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/087abf7eec794afbb9b4cab7734787f7 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job podified-multinode-edpm-deployment-crc-centos-10. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/ded4336900bc499ca6f06ecaf9e7d8bb found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job podified-multinode-edpm-deployment-crc-centos-10. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/087abf7eec794afbb9b4cab7734787f7 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job podified-multinode-edpm-deployment-crc-centos-10. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/ded4336900bc499ca6f06ecaf9e7d8bb found in build home directory during playbook review.rdoproject.org/config/playbooks/crc/print-machineconfigpool.yaml for job podified-multinode-edpm-deployment-crc-centos-10. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/c4b95ff4f8ea4572a139ffe34191ac9f found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-crc-podified-edpm-baremetal. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/ead32a8bace84eefbbe214cb74b0c080 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-crc-podified-edpm-baremetal. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/83c5339042c94cfbb8fae1bde9e83f7c found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-crc-podified-edpm-baremetal. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/ccae9a7aea234412863417a8a848432a found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-crc-podified-edpm-baremetal. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/d2276c4ddd3f448b9aa723766b61b876 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-crc-podified-edpm-baremetal. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/8fc230190ee1450da01ce0471a3e3625 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-multinode-tempest. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/2d545b5c498e471792f4eeda116d78b2 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-multinode-tempest. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/0d66ff9a63e54b7a82d60d83e7627189 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-multinode-tempest. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/804576d4ab794a329e0bcf33cf2bbb4c found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-multinode-tempest. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/8fc230190ee1450da01ce0471a3e3625 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job cifmw-multinode-tempest. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/4ca3673304804811b9bfa1e82ccaee6e found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-crc-podified-edpm-baremetal-bootc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/85ef9521faf54d7a9bcd21d5a9ad06cd found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-crc-podified-edpm-baremetal-bootc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/25ea30c36fb4471980ad74e449d9d59e found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-crc-podified-edpm-baremetal-bootc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/8621cf1475b14c5cba3c8ca4fe2db8a1 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-crc-podified-edpm-baremetal-bootc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/6b9205d38e58486e93228791e2f040af found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-crc-podified-edpm-baremetal-bootc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/d9c1e3a3ce874d47814798f820a47996 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job podified-multinode-hci-deployment-crc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/9b67060c988642e4b430723dd610cca3 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job podified-multinode-hci-deployment-crc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/d9c1e3a3ce874d47814798f820a47996 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job podified-multinode-hci-deployment-crc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/9b67060c988642e4b430723dd610cca3 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job podified-multinode-hci-deployment-crc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/d9c1e3a3ce874d47814798f820a47996 found in build home directory during playbook review.rdoproject.org/config/playbooks/crc/print-machineconfigpool.yaml for job podified-multinode-hci-deployment-crc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/760cd08d35fa4e289601f1a7eaef3133 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-crc-podified-edpm-baremetal-minor-update. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/a916f718a58a4fc7acfca56c01527f5f found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-crc-podified-edpm-baremetal-minor-update. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/062450dc0c1f40b7b2b7c9befbd4447d found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-crc-podified-edpm-baremetal-minor-update. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/e550fdbdf14f41c9a4564ad600998660 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-crc-podified-edpm-baremetal-minor-update. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/5d57d8400caa49b18e9044d40a491b13 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job cifmw-crc-podified-edpm-baremetal-minor-update. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/77cee2d28fdd436089125cb17835ae07 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job adoption-standalone-to-crc-ceph-provider. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/fc666c05f2b84cb3ba12733fe0f80a72 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job adoption-standalone-to-crc-ceph-provider. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/5fe94cba38f640b6a74ada1a1c1d954b found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job adoption-standalone-to-crc-ceph-provider. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/c96412d695f64bb8adabde80a0f2cbfe found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job adoption-standalone-to-crc-ceph-provider. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/77cee2d28fdd436089125cb17835ae07 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job adoption-standalone-to-crc-ceph-provider. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/b8818f2e1efe4939b92250c5ffe1a702 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job periodic-podified-edpm-baremetal-minor-update-bootc-master-ocp-crc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/46ac77fe74dc42b187530a9962453d68 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job periodic-podified-edpm-baremetal-minor-update-bootc-master-ocp-crc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/fa9bc5a392104a4a80456ffd181f5650 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job periodic-podified-edpm-baremetal-minor-update-bootc-master-ocp-crc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/3c7c4c1460c744daa6dd57f6e5dea33d found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job periodic-podified-edpm-baremetal-minor-update-bootc-master-ocp-crc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/b8818f2e1efe4939b92250c5ffe1a702 found in build home directory during playbook review.rdoproject.org/config/playbooks/ci-framework-rdo-base/dlrn/dlrn-report.yaml for job periodic-podified-edpm-baremetal-minor-update-bootc-master-ocp-crc. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/c135d8c696da41268cbeab5bcd938e3f found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job whitebox-neutron-tempest-plugin-podified-multinode-edpm-deployment-crc-2comp. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/5567749db18247d59d1c8400ce8240e3 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job whitebox-neutron-tempest-plugin-podified-multinode-edpm-deployment-crc-2comp. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/363cf9c6ea5045dda5f80ad2333d7145 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job whitebox-neutron-tempest-plugin-podified-multinode-edpm-deployment-crc-2comp. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/7300fc13f3414208933ddd127582678b found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job whitebox-neutron-tempest-plugin-podified-multinode-edpm-deployment-crc-2comp. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/c135d8c696da41268cbeab5bcd938e3f found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job whitebox-neutron-tempest-plugin-podified-multinode-edpm-deployment-crc-2comp. Add to preserve-home-paths if safe, or otherwise remove.

…ompression

The first play in `ci/playbooks/collect-logs.yml` runs on every Zuul node
and only creates `~/ci-framework-data/logs`.
`ignore_errors` does not cover an unreachable host,
so one SSH timeout fails post-run even though the real collection
already runs on `cifmw_zuul_target_host`.

End hosts listed in `cifmw_collect_logs_skip_hosts` before opening a connection.
The list defaults to empty, so existing jobs are unchanged.

e2e-collect-logs and collect-logs both compress CRC kubelet logs; gzip
without -f failed when kubelet.log.gz already existed and caused
post_failure on multinode jobs. Use gzip -f, tolerate compress errors on
the controller always block, and treat empty ausearch/grep as success.

Assisted-By: Grok 4.7

Signed-off-by: Fiorella Yanac <fyanac@redhat.com>
@fyanac
fyanac force-pushed the add_skip_node_logs branch from 0b47e3f to 9d79f60 Compare November 3, 2026 17:28
@fyanac fyanac changed the title [ci] Let collect-logs skip hosts before SSH [ci] Let collect-logs skip hosts before SSH and harden post-run log compression Nov 3, 2026
@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/00b0ed17b12442c4bd668ed1c3103812

✔️ openstack-k8s-operators-content-provider SUCCESS in 4h 05m 55s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 27m 34s
✔️ podified-multinode-edpm-deployment-crc-centos-10 SUCCESS in 1h 24m 05s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 32m 01s
❌ cifmw-crc-podified-edpm-baremetal-minor-update FAILURE in 2h 06m 33s (non-voting)
✔️ periodic-podified-edpm-baremetal-minor-update-bootc-master-ocp-crc SUCCESS in 1h 55m 33s (non-voting)
✔️ podified-multinode-hci-deployment-crc SUCCESS in 2h 02m 39s
✔️ cifmw-multinode-tempest SUCCESS in 1h 42m 43s
❌ openstack-k8s-operators-content-provider-bootc FAILURE in 16m 58s
⚠️ cifmw-crc-podified-edpm-baremetal-bootc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider-bootc
❌ adoption-standalone-to-crc-ceph-provider FAILURE in 2h 01m 20s (non-voting)
✔️ whitebox-neutron-tempest-plugin-podified-multinode-edpm-deployment-crc-2comp SUCCESS in 3h 33m 54s (non-voting)
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 12m 05s
✔️ cifmw-pod-pre-commit SUCCESS in 9m 50s
✔️ cifmw-content-provider-build-images SUCCESS in 35m 27s
✔️ cifmw-edpm-build-images SUCCESS in 21m 57s
✔️ cifmw-multinode-kuttl SUCCESS in 3h 02m 48s
✔️ cifmw-tcib SUCCESS in 39m 35s
✔️ cifmw-architecture-validate-hci SUCCESS in 7m 20s
✔️ ci-framework-openstack-meta-content-provider SUCCESS in 19m 49s
✔️ cifmw-molecule-adoption_osp_deploy SUCCESS in 7m 50s
✔️ cifmw-molecule-artifacts SUCCESS in 8m 51s
✔️ cifmw-molecule-bm_sno SUCCESS in 6m 26s
✔️ cifmw-molecule-build_containers SUCCESS in 11m 58s
✔️ cifmw-molecule-build_openstack_packages SUCCESS in 14m 24s
✔️ cifmw-molecule-cert_manager SUCCESS in 16m 01s
✔️ cifmw-molecule-ci_gen_kustomize_values SUCCESS in 10m 16s
✔️ cifmw-molecule-ci_local_storage SUCCESS in 14m 59s
✔️ cifmw-molecule-ci_multus SUCCESS in 23m 06s
✔️ cifmw-molecule-ci_network SUCCESS in 8m 19s
✔️ cifmw-molecule-ci_nmstate SUCCESS in 24m 17s
✔️ cifmw-molecule-ci_setup SUCCESS in 7m 24s
✔️ cifmw-molecule-cifmw_block_device SUCCESS in 8m 17s
✔️ cifmw-molecule-cifmw_ceph_client SUCCESS in 8m 59s
✔️ cifmw-molecule-cifmw_ceph_spec SUCCESS in 8m 34s
✔️ cifmw-molecule-cifmw_cephadm SUCCESS in 8m 59s
✔️ cifmw-molecule-cifmw_create_admin SUCCESS in 14m 49s
✔️ cifmw-molecule-cifmw_helpers SUCCESS in 8m 49s
✔️ cifmw-molecule-cifmw_ntp SUCCESS in 7m 35s
✔️ cifmw-molecule-cifmw_snr_nhc SUCCESS in 8m 04s
✔️ cifmw-molecule-cifmw_test_role SUCCESS in 8m 35s
✔️ cifmw-molecule-compliance SUCCESS in 8m 19s
✔️ cifmw-molecule-config_drive SUCCESS in 8m 45s
✔️ cifmw-molecule-copy_container SUCCESS in 10m 47s
✔️ cifmw-molecule-deploy_bmh SUCCESS in 7m 29s
✔️ cifmw-molecule-devscripts SUCCESS in 16m 13s
✔️ cifmw-molecule-discover_latest_image SUCCESS in 8m 50s
✔️ cifmw-molecule-dlrn_promote SUCCESS in 11m 51s
✔️ cifmw-molecule-dlrn_report SUCCESS in 8m 59s
✔️ cifmw-molecule-dnsmasq SUCCESS in 10m 35s
✔️ cifmw-molecule-edpm_build_images SUCCESS in 10m 55s
✔️ cifmw-molecule-edpm_deploy SUCCESS in 9m 08s
✔️ cifmw-molecule-edpm_deploy_baremetal SUCCESS in 9m 50s
✔️ cifmw-molecule-edpm_kustomize SUCCESS in 9m 43s
✔️ cifmw-molecule-edpm_prepare SUCCESS in 9m 30s
✔️ cifmw-molecule-env_op_images SUCCESS in 25m 44s
✔️ cifmw-molecule-hci_prepare SUCCESS in 9m 06s
✔️ cifmw-molecule-hive SUCCESS in 9m 30s
✔️ cifmw-molecule-idrac_configuration SUCCESS in 7m 25s
✔️ cifmw-molecule-install_ca SUCCESS in 9m 16s
✔️ cifmw-molecule-install_openstack_ca SUCCESS in 35m 35s
✔️ cifmw-molecule-install_yamls SUCCESS in 9m 09s
✔️ cifmw-molecule-kustomize_deploy SUCCESS in 10m 16s
❌ cifmw-molecule-libvirt_manager TIMED_OUT in 1h 01m 02s
❌ cifmw-molecule-manage_secrets TIMED_OUT in 31m 12s
✔️ cifmw-molecule-mirror_registry SUCCESS in 14m 53s
✔️ cifmw-molecule-nat64_appliance SUCCESS in 20m 37s
✔️ cifmw-molecule-networking_mapper SUCCESS in 10m 48s
❌ cifmw-molecule-openshift_login TIMED_OUT in 31m 19s
✔️ cifmw-molecule-openshift_obs SUCCESS in 23m 38s
✔️ cifmw-molecule-openshift_provisioner_node SUCCESS in 11m 32s
✔️ cifmw-molecule-openshift_setup SUCCESS in 13m 47s
✔️ cifmw-molecule-operator_build SUCCESS in 12m 37s
✔️ cifmw-molecule-operator_deploy SUCCESS in 19m 11s
✔️ cifmw-molecule-os_must_gather SUCCESS in 40m 24s
✔️ cifmw-molecule-os_net_setup SUCCESS in 12m 46s
❌ cifmw-molecule-pkg_build FAILURE in 21m 07s (non-voting)
✔️ cifmw-molecule-podman SUCCESS in 12m 12s
✔️ cifmw-molecule-radvd SUCCESS in 12m 26s
✔️ cifmw-molecule-rally SUCCESS in 14m 29s
✔️ cifmw-molecule-registry_deploy SUCCESS in 17m 29s
✔️ cifmw-molecule-repo_setup SUCCESS in 13m 35s
✔️ cifmw-molecule-reportportal SUCCESS in 11m 04s
❌ cifmw-molecule-reproducer FAILURE in 27m 45s
✔️ cifmw-molecule-rhol_crc SUCCESS in 1h 10m 39s
✔️ cifmw-molecule-run_hook SUCCESS in 8m 08s
✔️ cifmw-molecule-s2i_content_set SUCCESS in 13m 33s
✔️ cifmw-molecule-set_openstack_containers SUCCESS in 25m 55s
✔️ cifmw-molecule-shiftstack SUCCESS in 22m 29s
✔️ cifmw-molecule-ssh_jumper SUCCESS in 12m 00s
✔️ cifmw-molecule-sushy_emulator SUCCESS in 18m 50s
✔️ cifmw-molecule-test_deps SUCCESS in 14m 31s
✔️ cifmw-molecule-test_operator SUCCESS in 10m 48s
✔️ cifmw-molecule-tofu SUCCESS in 16m 38s
✔️ cifmw-molecule-update SUCCESS in 13m 13s
✔️ cifmw-molecule-update_containers SUCCESS in 13m 17s
✔️ cifmw-molecule-validations SUCCESS in 12m 46s
✔️ cifmw-molecule-virtualbmc SUCCESS in 18m 08s
✔️ edpm-ansible-molecule-edpm_podman SUCCESS in 12m 55s
✔️ edpm-ansible-molecule-edpm_ovs SUCCESS in 13m 44s
✔️ edpm-ansible-molecule-edpm_kernel SUCCESS in 21m 59s

Warning:
File .kube/http-cache/bdd7b2cb6584e62d442216995e51db5f found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-pre-commit. Add to preserve-home-paths if safe, or otherwise remove.
File .kube/http-cache/3418855402ab8666a195458ea6d5d4a2 found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-pre-commit. Add to preserve-home-paths if safe, or otherwise remove.
File .kube/http-cache/a0a4de7d63733803eeececaa48e4969f found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-pre-commit. Add to preserve-home-paths if safe, or otherwise remove.
File .kube/cache/discovery/38.102.83.139_9023/servergroups.json found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-pre-commit. Add to preserve-home-paths if safe, or otherwise remove.
File .kube/cache/discovery/38.102.83.139_9023/v1/serverresources.json found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-pre-commit. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/config found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/pod-jobs.yml for job cifmw-pod-pre-commit. Add to preserve-home-paths if safe, or otherwise remove.
File .kube/http-cache/57b4a240b05e14143590c924faf8f5b9 found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-ansible-test. Add to preserve-home-paths if safe, or otherwise remove.
File .kube/http-cache/6a08f8b7f457cfb0bbd7f9d1e1cfc6f7 found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-ansible-test. Add to preserve-home-paths if safe, or otherwise remove.
File .kube/http-cache/f602b5784741105fba742abf7b02c24d found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-ansible-test. Add to preserve-home-paths if safe, or otherwise remove.
File .kube/cache/discovery/38.102.83.54_9023/servergroups.json found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-ansible-test. Add to preserve-home-paths if safe, or otherwise remove.
File .kube/cache/discovery/38.102.83.54_9023/v1/serverresources.json found in build home directory during playbook review.rdoproject.org/rdo-jobs/playbooks/base/pre.yaml for job cifmw-pod-ansible-test. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/config found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/pod-jobs.yml for job cifmw-pod-ansible-test. Add to preserve-home-paths if safe, or otherwise remove.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant