Skip to content

Conversation

@gangwgr
Copy link
Contributor

@gangwgr gangwgr commented Jan 6, 2026

Add support for extracting and running oc-tests-ext from the cli image in the release payload.

Changes:

  • Add cli image tag to extensionBinaries list
  • Configure binary path as /usr/bin/oc-tests-ext.gz

This enables the test framework to automatically:

  • Extract oc-tests-ext binary from the cli-tests image
  • Decompress and execute extension tests
  • Integrate oc CLI tests with the OpenShift test suite

The cli image keeps the test binary separate from the main CLI product image, avoiding size bloat while making tests available for CI.

@openshift-ci-robot
Copy link

Pipeline controller notification
This repo is configured to use the pipeline controller. Second-stage tests will be triggered either automatically or after lgtm label is added, depending on the repository configuration. The pipeline controller will automatically detect which contexts are required and will utilize /test Prow commands to trigger the second stage.

For optional jobs, comment /test ? to see a list of all defined jobs. To trigger manually all jobs from second stage use /pipeline required command.

This repository is configured in: automatic mode

@gangwgr
Copy link
Contributor Author

gangwgr commented Jan 6, 2026

/pipeline required

@openshift-ci-robot
Copy link

Scheduling required tests:
/test e2e-aws-csi
/test e2e-aws-ovn-fips
/test e2e-aws-ovn-microshift
/test e2e-aws-ovn-microshift-serial
/test e2e-aws-ovn-serial-1of2
/test e2e-aws-ovn-serial-2of2
/test e2e-gcp-csi
/test e2e-gcp-ovn
/test e2e-gcp-ovn-upgrade
/test e2e-metal-ipi-ovn-ipv6
/test e2e-vsphere-ovn
/test e2e-vsphere-ovn-upi

@gangwgr
Copy link
Contributor Author

gangwgr commented Jan 6, 2026

/retest-required

@gangwgr
Copy link
Contributor Author

gangwgr commented Jan 7, 2026

/retest

@gangwgr
Copy link
Contributor Author

gangwgr commented Jan 7, 2026

/retest/retest-required

@gangwgr
Copy link
Contributor Author

gangwgr commented Jan 7, 2026

/retest-required

@gangwgr
Copy link
Contributor Author

gangwgr commented Jan 7, 2026

/retest

@gangwgr
Copy link
Contributor Author

gangwgr commented Jan 7, 2026

/retest-required

@openshift-trt
Copy link

openshift-trt bot commented Jan 7, 2026

Job Failure Risk Analysis for sha: 866c9d8

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-aws-csi IncompleteTests
Tests for this run (55) are below the historical average (1547): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-fips IncompleteTests
Tests for this run (57) are below the historical average (2896): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-microshift IncompleteTests
Tests for this run (20) are below the historical average (1184): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-microshift-serial IncompleteTests
Tests for this run (20) are below the historical average (693): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-serial-1of2 IncompleteTests
Tests for this run (55) are below the historical average (1673): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-serial-2of2 IncompleteTests
Tests for this run (55) are below the historical average (1659): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-gcp-csi IncompleteTests
Tests for this run (57) are below the historical average (1637): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-gcp-ovn IncompleteTests
Tests for this run (57) are below the historical average (2887): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade IncompleteTests
Tests for this run (49) are below the historical average (1633): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-ipv6 IncompleteTests
Tests for this run (72) are below the historical average (2560): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-vsphere-ovn IncompleteTests
Tests for this run (53) are below the historical average (2700): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-vsphere-ovn-upi IncompleteTests
Tests for this run (48) are below the historical average (2766): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

@gangwgr
Copy link
Contributor Author

gangwgr commented Jan 8, 2026

/retest

binaryPath: "/usr/bin/cluster-version-operator-tests.gz",
},
{
imageTag: "cli-tests",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@gangwgr imageTag needs to be cli?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

my bad i forgot

Add support for extracting and running oc-tests-ext from the cli-tests
image in the release payload.

Changes:
- Add cli-tests image tag to extensionBinaries list
- Configure binary path as /usr/bin/oc-tests-ext.gz

This enables the test framework to automatically:
- Extract oc-tests-ext binary from the cli-tests image
- Decompress and execute extension tests
- Integrate oc CLI tests with the OpenShift test suite

The cli-tests image keeps the test binary separate from the main CLI
product image, avoiding size bloat while making tests available for CI.
@openshift-ci-robot
Copy link

Scheduling required tests:
/test e2e-aws-csi
/test e2e-aws-ovn-fips
/test e2e-aws-ovn-microshift
/test e2e-aws-ovn-microshift-serial
/test e2e-aws-ovn-serial-1of2
/test e2e-aws-ovn-serial-2of2
/test e2e-gcp-csi
/test e2e-gcp-ovn
/test e2e-gcp-ovn-upgrade
/test e2e-metal-ipi-ovn-ipv6
/test e2e-vsphere-ovn
/test e2e-vsphere-ovn-upi

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jan 8, 2026

@gangwgr: all tests passed!

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@gangwgr gangwgr changed the title [WIP]Add oc-tests-ext to extension binaries Add oc-tests-ext to extension binaries Jan 9, 2026
@openshift-ci openshift-ci bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jan 9, 2026
@gangwgr gangwgr changed the title Add oc-tests-ext to extension binaries CNTRLPLANE-2167:Add oc-tests-ext to extension binaries Jan 9, 2026
@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Jan 9, 2026
@openshift-ci-robot
Copy link

openshift-ci-robot commented Jan 9, 2026

@gangwgr: This pull request references CNTRLPLANE-2167 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the task to target the "4.22.0" version, but no target version was set.

Details

In response to this:

Add support for extracting and running oc-tests-ext from the cli-tests image in the release payload.

Changes:

  • Add cli-tests image tag to extensionBinaries list
  • Configure binary path as /usr/bin/oc-tests-ext.gz

This enables the test framework to automatically:

  • Extract oc-tests-ext binary from the cli-tests image
  • Decompress and execute extension tests
  • Integrate oc CLI tests with the OpenShift test suite

The cli-tests image keeps the test binary separate from the main CLI product image, avoiding size bloat while making tests available for CI.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@gangwgr
Copy link
Contributor Author

gangwgr commented Jan 9, 2026

/verified by ci runs

@openshift-ci-robot openshift-ci-robot added the verified Signifies that the PR passed pre-merge verification criteria label Jan 9, 2026
@openshift-ci-robot
Copy link

@gangwgr: This PR has been marked as verified by ci runs.

Details

In response to this:

/verified by ci runs

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@ardaguclu
Copy link
Member

@gangwgr do we expect that current CI jobs run any external test for us to confirm that it works properly.

@ardaguclu
Copy link
Member

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Jan 9, 2026
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jan 9, 2026

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: ardaguclu, gangwgr
Once this PR has been reviewed and has the lgtm label, please assign petr-muller for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@gangwgr
Copy link
Contributor Author

gangwgr commented Jan 9, 2026

@gangwgr do we expect that current CI jobs run any external test for us to confirm that it works properly.

as in current setup we don't have cases in oc repo but we can verify from this https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/pr-logs/pull/30653/pull-ci-openshift-origin-main-e2e-aws-ovn-serial-1of2/2009280872091488256/artifacts/e2e-aws-ovn-serial/openshift-e2e-test/build-log.txt

optional-capability=marketplace --optional-capability=openshift-samples --topology=HighlyAvailable --version=4.22.0-0.ci-2026-01-08-153615-test-ci-op-s90skg59-latest" binary=oc-tests-ext
time="2026-01-08T16:31:36Z" level=info msg="Listed 83 tests in 75.464606ms" binary=olmv1-tests-ext
time="2026-01-08T16:31:36Z" level=info msg="Listed 0 tests in 12.161839ms" binary=cluster-kube-scheduler-operator-tests-ext
time="2026-01-08T16:31:36Z" level=info msg="Listed 0 tests in 11.109294ms" binary=cluster-image-registry-operator-tests-ext
time="2026-01-08T16:31:36Z" level=info msg="Listed 1 tests in 8.524138ms" binary=cluster-version-operator-tests
time="2026-01-08T16:31:36Z" level=info msg="Listed 0 tests in 22.378406ms" binary=oc-tests-ext
time="2026-01-08T16:31:36Z" level=info msg="Listed 32 tests in 102.715438ms" binary=machine-config-tests-ext
time="2026-01-08T16:31:36Z" level=info msg="Listed 175 tests in 78.422942ms" binary=olmv0-tests-ext
time="2026-01-08T16:31:37Z" level=info msg="Listed 0 tests in 354.933673ms" binary=machine-api-tests-ext
time="2026-01-08T16:31:37Z" level=info msg="Listed 1046 tests in 527.419398ms" binary=openshift-tests
time="2026-01-08T16:31:37Z" level=info msg="Listed 6959 tests in 643.110318ms" binary=k8s-tests-ext
time="2026-01-08T16:31:37Z" level=info msg="Discovered 8336 total tests"

that our setup works fine, after this we can start moving our case to oc repo from qe repo and we create one job for ote tests if we don't want to create job then our cases will run with openshift conformance suite.
I'm planning this

  1. After this merge will create one job oc ote cases which will run our oc repo cases.
  2. Also add conformance suite in oc ote main.go which run our cases in conformance suite also

@ardaguclu
Copy link
Member

Adding specific OTE job makes sense to me. Thank you.

@gangwgr
Copy link
Contributor Author

gangwgr commented Jan 9, 2026

Adding specific OTE job makes sense to me. Thank you.

Yes

@openshift-ci-robot
Copy link

openshift-ci-robot commented Jan 9, 2026

@gangwgr: This pull request references CNTRLPLANE-2167 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the task to target the "4.22.0" version, but no target version was set.

Details

In response to this:

Add support for extracting and running oc-tests-ext from the cli image in the release payload.

Changes:

  • Add cli image tag to extensionBinaries list
  • Configure binary path as /usr/bin/oc-tests-ext.gz

This enables the test framework to automatically:

  • Extract oc-tests-ext binary from the cli-tests image
  • Decompress and execute extension tests
  • Integrate oc CLI tests with the OpenShift test suite

The cli image keeps the test binary separate from the main CLI product image, avoiding size bloat while making tests available for CI.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged. verified Signifies that the PR passed pre-merge verification criteria

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants