Skip to content

fix: update hallucination_detection fixture for upstream NA enum addition - #918

Merged
ajbozarth merged 1 commit into
generative-computing:mainfrom
ajbozarth:fix/hallucination-detection-fixture
Apr 23, 2026
Merged

fix: update hallucination_detection fixture for upstream NA enum addition#918
ajbozarth merged 1 commit into
generative-computing:mainfrom
ajbozarth:fix/hallucination-detection-fixture

Conversation

@ajbozarth

@ajbozarth ajbozarth commented Apr 23, 2026

Copy link
Copy Markdown
Contributor

Misc PR

Type of PR

  • Bug Fix
  • New Feature
  • Documentation
  • Other

Description

The upstream YAML in ibm-granite/granitelib-rag-r1.0 added "NA" as a valid enum value for the faithfulness field in HallucinationOutputEntry (for sentences that do not contain factual claims requiring grounding, e.g. greetings or opinions). The test_canned_input/hallucination_detection.json fixture was not updated to match, causing test_canned_input[hallucination_detection] to fail in CI. Same fix pattern as #897.

Testing

  • Tests added to the respective file if code was changed
  • New code has 100% coverage if code was added
  • Ensure existing tests and github automation passes (a maintainer will kick off the github automation when the rest of the PR is populated)

Attribution

  • AI coding assistants used

…tion

The upstream YAML in ibm-granite/granitelib-rag-r1.0 added "NA" as a
valid enum value for the faithfulness field. Update the test fixture to
match, fixing test_canned_input[hallucination_detection] CI failure.

Closes generative-computing#915

Assisted-by: Claude Code
Signed-off-by: Alex Bozarth <ajbozart@us.ibm.com>
@ajbozarth
ajbozarth requested a review from a team as a code owner April 23, 2026 20:33
@github-actions github-actions Bot added the bug Something isn't working label Apr 23, 2026
@ajbozarth ajbozarth self-assigned this Apr 23, 2026
@github-actions

Copy link
Copy Markdown
Contributor

The PR description has been updated. Please fill out the template for your PR to be reviewed.

@ajbozarth
ajbozarth enabled auto-merge April 23, 2026 20:42
@ajbozarth
ajbozarth added this pull request to the merge queue Apr 23, 2026
Merged via the queue into generative-computing:main with commit abb8cc9 Apr 23, 2026
9 of 10 checks passed
@ajbozarth
ajbozarth deleted the fix/hallucination-detection-fixture branch April 23, 2026 21:15
akihikokuroda pushed a commit to akihikokuroda/mellea that referenced this pull request May 27, 2026
…tion (generative-computing#918)

The upstream YAML in ibm-granite/granitelib-rag-r1.0 added "NA" as a
valid enum value for the faithfulness field. Update the test fixture to
match, fixing test_canned_input[hallucination_detection] CI failure.

Closes generative-computing#915

Assisted-by: Claude Code

Signed-off-by: Alex Bozarth <ajbozart@us.ibm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

fix: update hallucination_detection test fixture for upstream NA enum addition

2 participants