Skip to content

OCM-25174 | add: Backup jobs for all backup tests#79623

Open
elveeram wants to merge 2 commits into
openshift:mainfrom
elveeram:createBkpJobs
Open

OCM-25174 | add: Backup jobs for all backup tests#79623
elveeram wants to merge 2 commits into
openshift:mainfrom
elveeram:createBkpJobs

Conversation

@elveeram
Copy link
Copy Markdown

@elveeram elveeram commented May 21, 2026

Generated 5 new jobs for all backup tests.

Summary by CodeRabbit

This PR updates the OpenShift CI configuration for ROSA (openshift-online/rosa-e2e) by adding five new periodic ROSA HCP integration test jobs focused on backup and autoscaling scenarios.

What changed (practical impact):

  • The ci-operator config ci-operator/config/openshift-online/rosa-e2e/openshift-online-rosa-e2e-main__ocm-fvt-rosa-hcp-integration.yaml was extended with five new periodic jobs:
    • ocm-fvt-periodic-cs-rosa-hcp-backup-restore-integration-main
    • ocm-fvt-periodic-cs-rosa-hcp-autoscaling-int-main
    • ocm-fvt-periodic-cs-rosa-hcp-backup-autoscaling-2-int-main
    • ocm-fvt-periodic-cs-rosa-hcp-backup-cp-upgrade-2-int-main
    • ocm-fvt-periodic-cs-rosa-hcp-backup-cp-upgrade-int-main

How the jobs run:

  • Each job is scheduled daily at 08:00 UTC (cron: "0 8 * * *").
  • They execute inside a nested-podman container image (nested-podman) and mount cs-qe credentials read-only.
  • Environment setup exports AWS credential file locations, enables Jira reporting, sets OCM_ENV=integration, and sources OCM and Jira tokens.
  • The container runs the ocmci image to invoke ocmtest test --service cms with a job-specific --job value and --reportJiraTicket to report results to Jira.

Impact:

  • Adds regular, automated coverage for ROSA HCP backup, autoscaling recovery, and control-plane upgrade test scenarios within the OpenShift CI infrastructure.

@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented May 21, 2026

Important

Review skipped

Review was skipped due to path filters

⛔ Files ignored due to path filters (1)
  • ci-operator/jobs/openshift-online/rosa-e2e/openshift-online-rosa-e2e-main-periodics.yaml is excluded by !ci-operator/jobs/**

CodeRabbit blocks several paths by default. You can override this behavior by explicitly including those paths in the path filters. For example, including **/dist/** will override the default block on the dist directory, by removing the pattern from both the lists.

⚙️ Run configuration

Configuration used: Repository YAML (base), Central YAML (inherited)

Review profile: CHILL

Plan: Enterprise

Run ID: 2c427441-fa4a-407c-afa7-f66826b7e1c1

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review

Walkthrough

Five periodic ROSA HCP integration test job entries are added to the CI YAML. Each runs daily at 08:00 in a nested-podman container, mounts shared credentials, sets up Jira reporting env/job-link, and invokes ocmtest test --service cms --job <scenario> --reportJiraTicket.

Changes

ROSA HCP Periodic Integration Tests

Layer / File(s) Summary
Periodic test definitions for ROSA HCP scenarios
ci-operator/config/openshift-online/rosa-e2e/openshift-online-rosa-e2e-main__ocm-fvt-rosa-hcp-integration.yaml
Five test definitions added for: cs-rosa-hcp-autoscaling-integration-main, cs-rosa-hcp-backup-autoscaling-2-integration-main, cs-rosa-hcp-backup-cp-upgrade-2-integration-main, cs-rosa-hcp-backup-cp-upgrade-integration-main, and cs-rosa-hcp-backup-restore-2-integration-main. Each runs daily at 08:00 using nested-podman, mounts shared credentials, generates a job-link env, enables Jira reporting, and calls ocmtest test --service cms --job <name> --reportJiraTicket.

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~20 minutes

Suggested reviewers

  • ravitri
  • dustman9000
🚥 Pre-merge checks | ✅ 12
✅ Passed checks (12 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly and specifically describes the main change: adding backup jobs for backup tests, matching the 225 lines of additions that introduce five new periodic integration test entries for backup-related jobs.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Stable And Deterministic Test Names ✅ Passed PR modifies CI/CD job configuration in YAML, not Ginkgo test code. The check targets Ginkgo test titles (It/Describe/Context), which are absent in this PR.
Test Structure And Quality ✅ Passed PR only modifies YAML CI/CD configuration file, not Ginkgo test code. The check for Ginkgo test quality is not applicable to YAML configuration changes.
Microshift Test Compatibility ✅ Passed PR adds CI job configurations that invoke external test tools via containers, not Ginkgo e2e test code. MicroShift compatibility check is not applicable.
Single Node Openshift (Sno) Test Compatibility ✅ Passed PR adds CI job configurations, not Ginkgo e2e tests. Custom check applies specifically to "When new Ginkgo e2e tests are added"—this PR contains no It(), Describe(), Context(), or When() test code.
Topology-Aware Scheduling Compatibility ✅ Passed PR modifies ci-operator test config only, not deployment manifests or operator code. No scheduling constraints, affinity rules, or topology assumptions are introduced.
Ote Binary Stdout Contract ✅ Passed PR modifies only YAML CI configuration, not OTE binary source code. The check applies to stdout in process-level Go code; no such code changes present.
Ipv6 And Disconnected Network Test Compatibility ✅ Passed PR adds CI/CD job configurations only, not new Ginkgo e2e test code. Custom check for Ginkgo test IPv6/disconnected compatibility does not apply.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@openshift-ci openshift-ci Bot requested review from bmeng and jfrazierRedHat May 21, 2026 16:42
@openshift-ci
Copy link
Copy Markdown
Contributor

openshift-ci Bot commented May 21, 2026

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: elveeram
Once this PR has been reviewed and has the lgtm label, please assign ravitri for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Copy link
Copy Markdown
Contributor

@coderabbitai coderabbitai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

🧹 Nitpick comments (2)
ci-operator/config/openshift-online/rosa-e2e/openshift-online-rosa-e2e-main__ocm-fvt-rosa-hcp-integration.yaml (2)

70-70: 💤 Low value

Naming inconsistency: -int-main vs existing -integration-main suffix.

The pre-existing entry on Line 25 uses …-integration-main in its as: name, whereas the five new entries use the abbreviated …-int-main. Consider aligning on a single convention for discoverability and consistency in dashboards/test grids.

Also applies to: 115-115, 160-160, 205-205, 250-250

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In
`@ci-operator/config/openshift-online/rosa-e2e/openshift-online-rosa-e2e-main__ocm-fvt-rosa-hcp-integration.yaml`
at line 70, The as: names use an inconsistent suffix (e.g.,
ocm-fvt-periodic-cs-rosa-hcp-autoscaling-int-main) compared to the existing
convention (ocm-fvt-periodic-cs-rosa-hcp-autoscaling-integration-main); update
all five new as: entries (the ones ending with -int-main) to use the full
-integration-main suffix so they match the existing as: identifier and remain
discoverable/consistent in dashboards and test grids.

65-65: 💤 Low value

Consider staggering cron schedules to avoid load spike.

All six periodic jobs (existing + five new) fire at exactly 0 8 * * *, kicking off six concurrent nested-podman runs that each pull quay.io/redhat-services-prod/ocmci/ocmci:latest and hit the same CMS integration backend. Staggering minutes (e.g., 0 8 * * *, 15 8 * * *, 30 8 * * *, …) would smooth registry/integration load and reduce contention on shared credentials/quotas.

Also applies to: 110-110, 155-155, 200-200, 245-245, 290-290

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In
`@ci-operator/config/openshift-online/rosa-e2e/openshift-online-rosa-e2e-main__ocm-fvt-rosa-hcp-integration.yaml`
at line 65, Multiple periodic jobs all use the identical schedule "cron: 0 8 * *
*", causing concurrent runs; update each job's cron field (the "cron:" entries
currently set to "0 8 * * *") so the six periodic jobs are staggered across the
hour (e.g., 0, 15, 30, 45, 05, 20 minutes) to avoid simultaneous pulls and
backend load—apply this change to every occurrence of the "cron: 0 8 * * *"
entry referenced (the other occurrences noted in the review).
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In
`@ci-operator/config/openshift-online/rosa-e2e/openshift-online-rosa-e2e-main__ocm-fvt-rosa-hcp-integration.yaml`:
- Around line 70-294: New CI config added multiple jobs (examples: as:
ocm-fvt-periodic-cs-rosa-hcp-autoscaling-int-main,
ocm-fvt-periodic-cs-rosa-hcp-backup-autoscaling-2-int-main,
ocm-fvt-periodic-cs-rosa-hcp-backup-cp-upgrade-2-int-main, etc.) but the
generated ProwJob artifacts in ci-operator/jobs/ were not updated; run make
update to regenerate downstream ProwJob YAMLs and commit the updated artifacts
alongside this config change so the new "as:" entries are reflected in
ci-operator/jobs/.
- Around line 70-114: The PR title/description and the job in this config are
inconsistent: the config defines
ocm-fvt-periodic-cs-rosa-hcp-autoscaling-int-main and runs ocmtest with --job
cs-rosa-hcp-autoscaling-integration-main (an autoscaling test) while the PR is
titled “Backup jobs for all backup tests”; either update the PR
title/description to reflect that this change adds the autoscaling periodic job,
or modify the job/config to actually add the intended backup job; also ensure
any duplicate-check logic includes cs-rosa-hcp-autoscaling-integration-main (or
hcp-autoscaling-int-main) if you intended to prevent duplicates across the repo
so the autoscaling entry isn’t falsely flagged/missed.

---

Nitpick comments:
In
`@ci-operator/config/openshift-online/rosa-e2e/openshift-online-rosa-e2e-main__ocm-fvt-rosa-hcp-integration.yaml`:
- Line 70: The as: names use an inconsistent suffix (e.g.,
ocm-fvt-periodic-cs-rosa-hcp-autoscaling-int-main) compared to the existing
convention (ocm-fvt-periodic-cs-rosa-hcp-autoscaling-integration-main); update
all five new as: entries (the ones ending with -int-main) to use the full
-integration-main suffix so they match the existing as: identifier and remain
discoverable/consistent in dashboards and test grids.
- Line 65: Multiple periodic jobs all use the identical schedule "cron: 0 8 * *
*", causing concurrent runs; update each job's cron field (the "cron:" entries
currently set to "0 8 * * *") so the six periodic jobs are staggered across the
hour (e.g., 0, 15, 30, 45, 05, 20 minutes) to avoid simultaneous pulls and
backend load—apply this change to every occurrence of the "cron: 0 8 * * *"
entry referenced (the other occurrences noted in the review).
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Repository YAML (base), Central YAML (inherited)

Review profile: CHILL

Plan: Enterprise

Run ID: 97d114cd-93b0-41a1-87b7-e28d4ef18b05

📥 Commits

Reviewing files that changed from the base of the PR and between 96c4691 and cbd1f20.

⛔ Files ignored due to path filters (1)
  • ci-operator/jobs/openshift-online/rosa-e2e/openshift-online-rosa-e2e-main-periodics.yaml is excluded by !ci-operator/jobs/**
📒 Files selected for processing (1)
  • ci-operator/config/openshift-online/rosa-e2e/openshift-online-rosa-e2e-main__ocm-fvt-rosa-hcp-integration.yaml

@jfrazierRedHat
Copy link
Copy Markdown
Contributor

/retest

1 similar comment
@elveeram
Copy link
Copy Markdown
Author

/retest

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@openshift-merge-bot
Copy link
Copy Markdown
Contributor

[REHEARSALNOTIFIER]
@elveeram: the pj-rehearse plugin accommodates running rehearsal tests for the changes in this PR. Expand 'Interacting with pj-rehearse' for usage details. The following rehearsable tests have been affected by this change:

Test name Repo Type Reason
periodic-ci-openshift-online-rosa-e2e-main-ocm-fvt-rosa-hcp-integration-ocm-fvt-periodic-cs-rosa-hcp-autoscaling-int-main N/A periodic Periodic changed
periodic-ci-openshift-online-rosa-e2e-main-ocm-fvt-rosa-hcp-integration-ocm-fvt-periodic-cs-rosa-hcp-backup-cp-upgrade-2-int-main N/A periodic Periodic changed
periodic-ci-openshift-online-rosa-e2e-main-ocm-fvt-rosa-hcp-integration-ocm-fvt-periodic-cs-rosa-hcp-backup-autoscaling-2-int-main N/A periodic Periodic changed
periodic-ci-openshift-online-rosa-e2e-main-ocm-fvt-rosa-hcp-integration-ocm-fvt-periodic-cs-rosa-hcp-backup-restore-2-int-main N/A periodic Periodic changed
periodic-ci-openshift-online-rosa-e2e-main-ocm-fvt-rosa-hcp-integration-ocm-fvt-periodic-cs-rosa-hcp-backup-cp-upgrade-int-main N/A periodic Periodic changed
Interacting with pj-rehearse

Comment: /pj-rehearse to run up to 5 rehearsals
Comment: /pj-rehearse skip to opt-out of rehearsals
Comment: /pj-rehearse {test-name}, with each test separated by a space, to run one or more specific rehearsals
Comment: /pj-rehearse more to run up to 10 rehearsals
Comment: /pj-rehearse max to run up to 25 rehearsals
Comment: /pj-rehearse auto-ack to run up to 5 rehearsals, and add the rehearsals-ack label on success
Comment: /pj-rehearse list to get an up-to-date list of affected jobs
Comment: /pj-rehearse abort to abort all active rehearsals
Comment: /pj-rehearse network-access-allowed to allow rehearsals of tests that have the restrict_network_access field set to false. This must be executed by an openshift org member who is not the PR author

Once you are satisfied with the results of the rehearsals, comment: /pj-rehearse ack to unblock merge. When the rehearsals-ack label is present on your PR, merge will no longer be blocked by rehearsals.
If you would like the rehearsals-ack label removed, comment: /pj-rehearse reject to re-block merging.

@jfrazierRedHat
Copy link
Copy Markdown
Contributor

/pj-rehearse periodic-ci-openshift-online-rosa-e2e-main-ocm-fvt-rosa-hcp-integration-ocm-fvt-periodic-cs-rosa-hcp-autoscaling-int-main

@openshift-merge-bot
Copy link
Copy Markdown
Contributor

@jfrazierRedHat: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-ci
Copy link
Copy Markdown
Contributor

openshift-ci Bot commented May 21, 2026

@elveeram: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/rehearse/periodic-ci-openshift-online-rosa-e2e-main-ocm-fvt-rosa-hcp-integration-ocm-fvt-periodic-cs-rosa-hcp-autoscaling-int-main c596d08 link unknown /pj-rehearse periodic-ci-openshift-online-rosa-e2e-main-ocm-fvt-rosa-hcp-integration-ocm-fvt-periodic-cs-rosa-hcp-autoscaling-int-main

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants