Skip to content

test: skip orchestrator failswitch-workflow tests on AKS - #4443

Merged
openshift-merge-bot[bot] merged 5 commits into
redhat-developer:release-1.9from
gustavolira:fix/skip-orchestrator-aks-release-1.9
Mar 23, 2026
Merged

test: skip orchestrator failswitch-workflow tests on AKS#4443
openshift-merge-bot[bot] merged 5 commits into
redhat-developer:release-1.9from
gustavolira:fix/skip-orchestrator-aks-release-1.9

Conversation

@gustavolira

Copy link
Copy Markdown
Member

Summary

  • Skip failswitch-workflow.spec.ts orchestrator tests on AKS, where the Orchestrator plugin is disabled
  • The other two orchestrator test suites (greeting-workflow.spec.ts and workflow-all-runs-validations.spec.ts) already skip AKS
  • Orchestrator infrastructure and plugins are already disabled for AKS in helm values — this just aligns the test skip

Test plan

  • Verify nightly AKS jobs no longer fail on failswitch-workflow.spec.ts

🤖 Generated with Claude Code

Orchestrator plugin is disabled on AKS but this test suite was
not being skipped, causing consistent timeout failures.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@rhdh-qodo-merge

Copy link
Copy Markdown

PR Reviewer Guide 🔍

Here are some key observations to aid the review process:

⏱️ Estimated effort to review: 1 🔵⚪⚪⚪⚪
🔒 No security concerns identified
⚡ Recommended focus areas for review

Coverage Gap

Skipping this suite on AKS reduces signal for AKS-specific regressions; confirm there is alternative AKS coverage for the underlying workflows (or an explicit justification that orchestrator functionality is intentionally unsupported on AKS).

test.describe("Orchestrator failswitch workflow tests", () => {
  test.skip(() => skipIfJobName(JOB_NAME_PATTERNS.OSD_GCP)); // skipping orchestrator tests on OSD-GCP due to infra not being installed
  test.skip(() => skipIfJobName(JOB_NAME_PATTERNS.GKE)); // skipping orchestrator tests on GKE - plugins disabled to save disk space
  test.skip(() => skipIfJobName(JOB_NAME_PATTERNS.AKS)); // skipping orchestrator tests on AKS - plugins disabled
Maintainability

Repeated per-suite skip logic can drift over time; consider centralizing environment-based orchestrator skipping (e.g., shared helper or a single guard used by all orchestrator specs) to ensure consistency across suites.

test.skip(() => skipIfJobName(JOB_NAME_PATTERNS.OSD_GCP)); // skipping orchestrator tests on OSD-GCP due to infra not being installed
test.skip(() => skipIfJobName(JOB_NAME_PATTERNS.GKE)); // skipping orchestrator tests on GKE - plugins disabled to save disk space
test.skip(() => skipIfJobName(JOB_NAME_PATTERNS.AKS)); // skipping orchestrator tests on AKS - plugins disabled
📄 References
  1. redhat-developer/rhdh/e2e-tests/playwright/e2e/plugins/orchestrator/workflow-all-runs-validations.spec.ts [1-31]
  2. redhat-developer/rhdh/e2e-tests/playwright/e2e/plugins/orchestrator/token-propagation-workflow.spec.ts [37-239]

@rhdh-qodo-merge

Copy link
Copy Markdown

PR Type

Tests


Description

  • Skip orchestrator failswitch-workflow tests on AKS

  • Aligns test configuration with disabled orchestrator plugins

  • Prevents timeout failures in AKS test environments


File Walkthrough

Relevant files
Tests
failswitch-workflow.spec.ts
Add AKS skip condition to orchestrator tests                         

e2e-tests/playwright/e2e/plugins/orchestrator/failswitch-workflow.spec.ts

  • Added skip condition for AKS environment to
    failswitch-workflow.spec.ts
  • Prevents orchestrator tests from running on AKS where plugins are
    disabled
  • Aligns with existing skip patterns for OSD-GCP and GKE environments
+1/-0     

@rhdh-qodo-merge

rhdh-qodo-merge Bot commented Mar 23, 2026

Copy link
Copy Markdown

PR Code Suggestions ✨

Explore these optional code suggestions:

CategorySuggestion                                                                                                                                    Impact
Possible issue
Use boolean condition for test.skip
Suggestion Impact:The explicit test.skip callback usages (including AKS) were removed and replaced with a shared helper (skipOrchestratorOnUnsupportedPlatforms(test)) to handle skipping on unsupported platforms, changing how skipping is expressed rather than applying the exact boolean+reason call.

code diff:

-import { skipIfJobName } from "../../../utils/helper";
-import { JOB_NAME_PATTERNS } from "../../../utils/constants";
+import { skipOrchestratorOnUnsupportedPlatforms } from "../../../utils/helper";
 import { LogUtils } from "../../audit-log/log-utils";
 
 test.describe("Orchestrator failswitch workflow tests", () => {
-  test.skip(() => skipIfJobName(JOB_NAME_PATTERNS.OSD_GCP)); // skipping orchestrator tests on OSD-GCP due to infra not being installed
-  test.skip(() => skipIfJobName(JOB_NAME_PATTERNS.GKE)); // skipping orchestrator tests on GKE - plugins disabled to save disk space
-  test.skip(() => skipIfJobName(JOB_NAME_PATTERNS.AKS)); // skipping orchestrator tests on AKS - plugins disabled
+  skipOrchestratorOnUnsupportedPlatforms(test);
 

Modify the test.skip call for JOB_NAME_PATTERNS.AKS to pass the boolean
condition from skipIfJobName and the reason as separate arguments, instead of
using a callback function.

e2e-tests/playwright/e2e/plugins/orchestrator/failswitch-workflow.spec.ts [12]

-test.skip(() => skipIfJobName(JOB_NAME_PATTERNS.AKS)); // skipping orchestrator tests on AKS - plugins disabled
+test.skip(skipIfJobName(JOB_NAME_PATTERNS.AKS), 'skipping orchestrator tests on AKS - plugins disabled');

[Suggestion processed]

Suggestion importance[1-10]: 2

__

Why: The suggestion proposes a minor stylistic change to the test.skip syntax which is functionally equivalent and a matter of developer preference, offering minimal impact.

Low
  • Update

@gustavolira

Copy link
Copy Markdown
Member Author

/test ?

@gustavolira

Copy link
Copy Markdown
Member Author

/test e2e-aks-helm-nightly

Comment thread e2e-tests/playwright/e2e/plugins/orchestrator/failswitch-workflow.spec.ts Outdated
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

The container image build workflow finished with status: cancelled.

Consolidate repeated skip blocks across all orchestrator test files
into a single reusable helper function, so adding a new platform
only requires a one-line change.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

The container image build workflow finished with status: cancelled.

@gustavolira

Copy link
Copy Markdown
Member Author

/test e2e-aks-helm-nightly

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

The container image build workflow finished with status: cancelled.

@gustavolira

Copy link
Copy Markdown
Member Author

/test e2e-aks-helm-nightly

@github-actions

Copy link
Copy Markdown
Contributor

Image was built and published successfully. It is available at:

Use IS_OPENSHIFT env var in playwright.config.ts to skip orchestrator
tests on all non-OpenShift platforms (AKS, EKS, GKE) instead of
per-file skip calls. This removes the need to update every test file
when a new platform is added.

Reverts the skipOrchestratorOnUnsupportedPlatforms helper in favor
of this cleaner config-level approach.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

The container image build and publish workflows were skipped (either due to [skip-build] tag or no relevant changes with existing image).

@sonarqubecloud

Copy link
Copy Markdown

@zdrapela zdrapela left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@openshift-ci openshift-ci Bot added the lgtm label Mar 23, 2026
@openshift-merge-bot
openshift-merge-bot Bot merged commit 88c5a53 into redhat-developer:release-1.9 Mar 23, 2026
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants