Skip to content

[BOT ISSUE] Missing instrumentation for Azure OpenAI Java SDK #68

Description

@braintrust-bot

Summary

The Braintrust Java SDK does not instrument the Azure OpenAI Java SDK (com.azure:azure-ai-openai). This is Microsoft's official SDK for accessing OpenAI models deployed on Azure, with chat completions, embeddings, and streaming execution surfaces. Braintrust lists Azure AI Foundry as a supported cloud provider, but the Java SDK has no instrumentation for Azure OpenAI calls.

The existing OpenAI instrumentation (openai_2_8_0) wraps the com.openai:openai-java SDK's HTTP client, which does not intercept calls made through com.azure:azure-ai-openai — the Azure SDK uses its own com.azure.core HTTP pipeline, completely separate from the OpenAI Java SDK's client.

What is missing

The com.azure:azure-ai-openai module provides these execution surfaces, none of which are instrumented:

API Description
getChatCompletions Synchronous chat completions
getChatCompletionsStream Streaming chat completions with ChatCompletions chunks
getEmbeddings Embedding generation
getCompletions Legacy text completions

The SDK is available on Maven Central at version 1.0.0-beta.16 and is actively maintained as part of the Azure SDK for Java.

There is no reference to com.azure, azure-ai-openai, or AzureOpenAi anywhere in this repository — no instrumentation module, no tests, no examples, no dependencies.

Braintrust docs status

Upstream sources

Local files inspected

  • settings.gradle — lists all instrumentation modules; no Azure module present
  • braintrust-sdk/instrumentation/ — contains openai_2_8_0, anthropic_2_2_0, genai_1_18_0, langchain_1_8_0, springai_1_0_0; no Azure directory
  • Full-repo grep for com.azure, azure-ai-openai, AzureOpenAi — zero matches

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions