Skip to content
This repository was archived by the owner on Jul 14, 2026. It is now read-only.

[tests-only] Do not retry failed acceptance tests in cron nightly#5979

Merged
phil-davis merged 1 commit into
masterfrom
do-not-retry-in-cron
Nov 5, 2021
Merged

[tests-only] Do not retry failed acceptance tests in cron nightly#5979
phil-davis merged 1 commit into
masterfrom
do-not-retry-in-cron

Conversation

@phil-davis

Copy link
Copy Markdown
Contributor

Description

PR #5409 tries to report failed scenarios to RocketChat when a scenario fails and has to be rerun. That would be useful in the nightly CI run, because in that case there is no PR to post a comment to on GitHub. But that had difficulty getting a flexible message to be posted (rather than just a pass/fail kind of message)

Rather than keep trying to achieve individual RocketChat notifications for each failed test, this PR simply runs the nightly CI without the --retry 1 parameter. Any test scenario(s) that fails will cause the drone pipeline to fail. When the whole nightly job finishes it reports overall success or failure to RocketChat already. (That is like what all the other nightly jobs do in other repos). When we see a nightly failure in RocketChat it has a link to drone. We can follow that link and easily see which pipelines failed, and which test scenario(s) failed in the pipeline.

We will get failure for any test that fails the first time. And we want to know about those possibly intermittent tests so that we can work to improve them.

How Has This Been Tested?

I ran PR #5978 with the retry logic on and ff to check that both work.

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)
  • Technical debt
  • Tests

Checklist:

  • Code changes
  • Unit tests added
  • Acceptance tests added
  • Documentation ticket raised:

@phil-davis phil-davis self-assigned this Nov 5, 2021
@phil-davis phil-davis changed the title Do not retry failed acceptance tests in cron nightly [tests-only] Do not retry failed acceptance tests in cron nightly Nov 5, 2021
@owncloud owncloud deleted a comment from update-docs Bot Nov 5, 2021
@sonarqubecloud

sonarqubecloud Bot commented Nov 5, 2021

Copy link
Copy Markdown

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
No Duplication information No Duplication information

@ownclouders

Copy link
Copy Markdown
Contributor

Results for oC10SharingAccept https://drone.owncloud.com/owncloud/web/20057/14/1
The following scenarios passed on retry:

  • webUISharingAcceptSharesToRoot/acceptShares.feature:108

@phil-davis phil-davis merged commit ba63a45 into master Nov 5, 2021
@phil-davis phil-davis deleted the do-not-retry-in-cron branch November 5, 2021 08:53
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants