Skip to content

fix(ci): skip native ChonkPinnedIvcInputsTest in CI (nightly debug build)#23669

Closed
AztecBot wants to merge 1 commit into
nextfrom
cb/skip-native-chonk-pinned-inputs-test
Closed

fix(ci): skip native ChonkPinnedIvcInputsTest in CI (nightly debug build)#23669
AztecBot wants to merge 1 commit into
nextfrom
cb/skip-native-chonk-pinned-inputs-test

Conversation

@AztecBot

Copy link
Copy Markdown
Collaborator

Problem

The Nightly Debug Build (barretenberg-nightly-debug-build.yml) has failed every night for the last several days:

  • run 98 (May 26)
  • run 99 (May 27)
  • run 100 (May 28)
  • run 101 (May 29) — transient spot-instance SSM Undeliverable (responseCode=-1); never reached the test

The persistent failure (runs 98–100) is the C++ test:

FAILED: barretenberg/cpp/scripts/run_test.sh bbapi_tests ChonkPinnedIvcInputsTest.AllPinnedFlows (code: 1)

Assertion failed: (kernel_return_data_match)
Reason: kernel_return_data mismatch: proof contains
  { 0x183227397098d014dc2822db40c0ac2ecbc0b548b438e5469e10460b6c3e7ea4, 0x0 }
but kernel_calldata commitment is { 0x..01, 0x..02 }

The pinned Chonk IVC inputs (chonk-pinned-flows/*/ivc-inputs.msgpack) are stale relative to the current protocol circuits, so re-proving them trips the databus consistency check (the calldata commitment is the default generator point {1,2}).

Root cause

This is the same failure #23643 ("chore: skip failing chonk_pinned_inputs.test in CI") meant to silence. That PR added a skip with regex bbapi/chonk_pinned_inputs.test, which only matches the bb.js test command (barretenberg/ts/scripts/run_test.sh bbapi/chonk_pinned_inputs.test.js).

The native gtest is emitted by barretenberg/cpp/bootstrap.sh:276 as:

…/run_test.sh bbapi_tests ChonkPinnedIvcInputsTest.AllPinnedFlows

ci3/filter_test_cmds skips commands by grep -Ev against the skip regexes — and that command line contains no bbapi/chonk_pinned_inputs.test substring, so it escaped the skip and kept running (and failing) in the nightly debug build.

Fix

Add a second skip entry to .test_patterns.yml matching the native gtest command, mirroring the existing bb.js skip (same owner). Verified that the new regex skips only the failing proving command and leaves the chonk_inputs.sh check VK-check and all other bbapi_tests running.

This completes the intent of #23643. The proper long-term fix is to refresh the pinned inputs (ci-refresh-chonk) so both tests can be re-enabled; that requires regenerating the pinned tarball and is left to the test owner.


Created by claudebox · group: slackbot

@AztecBot AztecBot added ci-barretenberg Run all barretenberg/cpp checks. claudebox Owned by claudebox. it can push to this PR. labels May 29, 2026
@AztecBot

AztecBot commented Jun 3, 2026

Copy link
Copy Markdown
Collaborator Author

Automatically closing this stale claudebox draft PR (no updates for 5+ days). Re-open if still needed.

@AztecBot AztecBot closed this Jun 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci-barretenberg Run all barretenberg/cpp checks. claudebox Owned by claudebox. it can push to this PR.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant