Added DocumentRetrievalEvaluator to Azure AI Evaluation to support evaluation of document search - #39929

Merged

singankit merged 20 commits into

mainfrom

abhahn/document_retrieval_evaluator

Apr 19, 2025

Commits on Mar 4, 2025

Added new evaluator code for Azure AI Evaluation
Abby Hartman
committed

Commits on Mar 6, 2025

Added TypedDict for input validation and created json schema specs for input and output schemas
Abby Hartman
committed
Added a temporary hack to make the example runnable; updated schema
Abby Hartman
committed

Commits on Mar 13, 2025

Implementation improvements to align with applied science recommendations
Abby Hartman
committed
Added docstrings and cleaned up input schema file
Abby Hartman
committed

Commits on Apr 1, 2025

Updates based on in-person feedback
Abby Hartman
committed

Commits on Apr 11, 2025

Addressed comments from the PR and SDK review
Abby Hartman
committed

Commits on Apr 17, 2025

small fix for threshold dict update
Abby Hartman
committed
Merge branch 'main' of https://github.com/Azure/azure-sdk-for-python into abhahn/document_retrieval_evaluator
Abby Hartman
committed
Updates to support complex object inputs in DocumentRetrievalEvaluator
Abby Hartman
committed
Silence cspell errors for metric names'
Abby Hartman
committed
Updates to cspell.json
Abby Hartman
committed

Commits on Apr 18, 2025

Some updates for style enforcement; removed json schema files
Abby Hartman
committed
Reformatted with black
Abby Hartman
committed
Added tests, addressed a few comments and handled some edge cases
Abby Hartman
committed
Updates to tests and a few code fixes
Abby Hartman
committed
Docstring updates and added samples
Abby Hartman
committed
PR comments
Abby Hartman
committed
A few small test updates
Abby Hartman
committed
cspell update
Abby Hartman
committed