Skip to content

Enhance extensibility with learning from first LLM Judge category#650

Merged
haoranpb merged 3 commits into
mainfrom
feature/extensibility-from-nl2al
May 26, 2026
Merged

Enhance extensibility with learning from first LLM Judge category#650
haoranpb merged 3 commits into
mainfrom
feature/extensibility-from-nl2al

Conversation

@haoranpb
Copy link
Copy Markdown
Collaborator

@haoranpb haoranpb commented May 26, 2026

Some findings after enabling our first LLM judge category.

  • Allow skip leaderboard for categories that don't need it
  • Introduce Judge Based eval category class
  • Enhanced display for different categories

github-code-quality[bot]
github-code-quality Bot found potential problems May 26, 2026
View reviewed changes
Comment thread src/bcbench/types.py Dismissed
Comment thread src/bcbench/types.py Dismissed
@haoranpb haoranpb enabled auto-merge (squash) May 26, 2026 08:15
@haoranpb haoranpb merged commit 83c2eee into main May 26, 2026
13 checks passed
@haoranpb haoranpb deleted the feature/extensibility-from-nl2al branch May 26, 2026 08:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Jiawen-CS Jiawen-CS Jiawen-CS approved these changes

+1 more reviewer

@github-code-quality github-code-quality[bot] github-code-quality[bot] left review comments

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@haoranpb @Jiawen-CS