feat: add token usage metrics with OpenTelemetry integration - #563

Merged

ajbozarth merged 19 commits into

generative-computing:mainfrom

ajbozarth:feat/token-usage-metrics-v2

Mar 10, 2026

Commits on Feb 26, 2026

feat: add token usage counter metrics
ajbozarth
committed
50f0aa6
feat: integrate token metrics into OpenAI, Ollama, WatsonX, and LiteLLM backends
ajbozarth
committed
8159466
feat: add token metrics to HuggingFace backend
ajbozarth
committed
8dc02c1
test: add token metrics integration tests for all backends
ajbozarth
committed
061242a
fix: use module-scoped fixture to prevent tracer provider reinitialization
ajbozarth
committed
4c9788e
docs: add token usage metrics documentation and examples
ajbozarth
committed
2fb96b7
fix: lazy import is_metrics_enabled in backends
ajbozarth
committed
03e3663

Commits on Feb 27, 2026

test: add streaming token metrics test and document timing
ajbozarth
committed
5bb388c

Commits on Mar 3, 2026

refactor: consolidate duplicate get_value function
ajbozarth
committed
9e5a8f7
feat: add streaming token usage metrics support
ajbozarth
committed
dde2dca

Commits on Mar 4, 2026

Merge branch 'main' into feat/token-usage-metrics-v2
ajbozarth
committed
940e86d
test: update to non-deprecated Granite 4 hybrid models
ajbozarth
committed
9724db3
style: apply ruff formatting to test signatures
ajbozarth
committed
b2df82c

Commits on Mar 5, 2026

Commits on Mar 6, 2026

Merge branch 'main' into feat/token-usage-metrics-v2
ajbozarth
committed
a3aa12f

Commits on Mar 7, 2026

test: add unit tests and reorganize telemetry tests
ajbozarth
committed
b2fe9aa

Commits on Mar 9, 2026

Merge branch 'main' into feat/token-usage-metrics-v2
jakelorocco
authored
efa1e4e
doc: addressed review comments
ajbozarth
committed
29f2c15