Skip to content

[bot] Missing instrumentation for Azure AI Foundry Agents Java SDK (azure-ai-agents-persistent) #149

Description

@braintrust-bot

Summary

The Braintrust Java SDK instruments the Azure OpenAI-adjacent surface only indirectly via unrelated modules and has an open gap issue for com.azure:azure-ai-openai (#68) and com.azure:azure-ai-inference (#118), but does not instrument — and no open issue tracks — com.azure:azure-ai-agents-persistent, Microsoft's official Java SDK for Azure AI Foundry Agent Service. This is a distinct Maven artifact and client hierarchy (PersistentAgentsClient) providing a stateful, server-side agent-run execution surface (threads, runs, tool calls) comparable in kind to OpenAI's Assistants/Responses agent-run APIs.

What is missing

The com.azure:azure-ai-agents-persistent SDK provides these execution-oriented surfaces, none of which are instrumented:

API Class Description
createAgent() PersistentAgentsClient Defines a server-hosted agent (model, instructions, tools)
createThread() / createMessage() PersistentAgentsClient Manages a persistent conversation thread that an agent run executes over
createRun() / createRunAsync() / streaming run updates PersistentAgentsClient Executes an agent run against a thread — the core "agent execution" surface, including tool-call submission (submitToolOutputsToRun) and run status polling/streaming
createThreadAndRun() PersistentAgentsClient Combined thread-creation-and-run execution

Why existing instrumentation does not cover this

Braintrust docs status

Upstream sources

Local repo files inspected

  • settings.gradle (lines 28–33) — lists all instrumentation modules; no Azure Agents module present
  • braintrust-sdk/instrumentation/ — contains openai_2_15_0, anthropic_2_2_0, genai_1_18_0, langchain_1_8_0, springai_1_0_0, aws_bedrock_2_30_0; no Azure directory
  • Full-repo grep for azure.ai.agents, azure-ai-agents, PersistentAgent — zero matches

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions