Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 0 additions & 5 deletions .changeset/agent-id-deployment-resource-attrs.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/avatar-gateway-minted-token.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/defer-interim-interruptions-vad.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/deprecate-legacy-dev-mode.md

This file was deleted.

22 changes: 0 additions & 22 deletions .changeset/fix-interrupted-speech-wedges-session.md

This file was deleted.

13 changes: 0 additions & 13 deletions .changeset/fix-krisp-frame-identity.md

This file was deleted.

7 changes: 0 additions & 7 deletions .changeset/fuzzy-flushes-commit.md

This file was deleted.

11 changes: 0 additions & 11 deletions .changeset/google-genai-2-history-config.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/green-mice-hear.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/lucky-otters-listen.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/phonic-configs-for-tools.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/report-ink-speech-onset.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/stale-ravens-crash.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/tame-clocks-agree.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/tidy-pears-listen.md

This file was deleted.

6 changes: 0 additions & 6 deletions .changeset/tidy-stt-alignment.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/tolerate-list-deltas.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/type-cartesia-turn-detection.md

This file was deleted.

7 changes: 0 additions & 7 deletions .changeset/update-rtc-node-0-13-33.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/xai-stt-turn-options.md

This file was deleted.

54 changes: 54 additions & 0 deletions agents/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,59 @@
# @livekit/agents

## 1.6.1

### Patch Changes

- Add cloud agent id and deployment to telemetry resource attributes (`lk.cloud_agent_id` / `lk.deployment_id`) when running on LiveKit Cloud. - [#2137](https://github.com/livekit/agents-js/pull/2137) ([@jmcclanahan](https://github.com/jmcclanahan))

- Let the inference gateway mint avatar worker tokens instead of signing them locally. - [#2152](https://github.com/livekit/agents-js/pull/2152) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- fix(voice): defer interim transcript interruptions to local VAD when configured - [#2159](https://github.com/livekit/agents-js/pull/2159) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Deprecate direct dev mode in favor of `lk agent dev`. - [#2194](https://github.com/livekit/agents-js/pull/2194) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- fix(voice): stop an interrupted reply from muting the session forever - [#2127](https://github.com/livekit/agents-js/pull/2127) ([@toubatbrian](https://github.com/toubatbrian))

A reply interrupted before its audio started playing could leave its pipeline reply task
parked in the post-interrupt `waitForPlayout()`, which races only the reply's own abort
signal — a signal nothing on the ordinary interrupt path ever fires. The speech scheduling
loop waits on that reply's generation, so `_currentSpeech` stayed pinned on the interrupted
handle and every later turn was queued but never authorized: the agent went silent for the
rest of the session. On the evidence so far this needs an audio sink whose playback-finished
event the pipeline does not produce itself — remote avatar outputs (`DataStreamAudioOutput`
and the avatar plugins built on it) and user-supplied `AudioOutput`s; a plain room output
settled both of the affected waits on its own across six live runs.

`SpeechHandle` now arms a 5s watchdog when a speech is interrupted (a port of python's
`INTERRUPTION_TIMEOUT`): if the speech has not finished by then, its tasks are cancelled —
firing exactly the abort signal those waits are already watching — and the handle is marked
done, releasing the scheduler.

Fixes #2065.

- Send turn finalization messages when flushing streaming STT with no buffered audio. - [#2172](https://github.com/livekit/agents-js/pull/2172) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Preserve concrete STT language hints when later transcripts report non-specific language codes. - [#2149](https://github.com/livekit/agents-js/pull/2149) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- fix realtime user turns appearing after the reply they prompted, by placing the user message at the time its turn began rather than at the time the provider delivered the transcript - [#2165](https://github.com/livekit/agents-js/pull/2165) ([@toubatbrian](https://github.com/toubatbrian))

- Report speech onset immediately when an inference STT provider detects it server-side. - [#2182](https://github.com/livekit/agents-js/pull/2182) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- stamp a tool call's `createdAt` when its execution begins rather than when it was parsed off the model stream, so it no longer sorts ahead of the assistant message that requested it - [#2171](https://github.com/livekit/agents-js/pull/2171) ([@u9g](https://github.com/u9g))

- Avoid emitting `playbackStarted` again when room audio resumes mid-segment. - [#2184](https://github.com/livekit/agents-js/pull/2184) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Report word-aligned transcripts only when the inference STT model and every fallback are verified - [#2181](https://github.com/livekit/agents-js/pull/2181) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))
to provide word timings.

- Handle list-shaped content parts in streamed LLM deltas when stripping thinking tokens. - [#2188](https://github.com/livekit/agents-js/pull/2188) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Type Cartesia turn-detection parameters in inference STT model options. - [#2173](https://github.com/livekit/agents-js/pull/2173) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- chore(deps): update @livekit/rtc-node to 0.13.33 - [#2191](https://github.com/livekit/agents-js/pull/2191) ([@theomonnom](https://github.com/theomonnom))

Picks up livekit-ffi 0.12.73 and a fix for the dual package hazard (livekit/node-sdks#700, livekit/node-sdks#698).

## 1.6.0

### Minor Changes
Expand Down
2 changes: 1 addition & 1 deletion agents/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@livekit/agents",
"version": "1.6.0",
"version": "1.6.1",
"description": "LiveKit Agents - Node.js",
"main": "dist/index.js",
"require": "dist/index.cjs",
Expand Down
7 changes: 7 additions & 0 deletions plugins/anam/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,12 @@
# @livekit/agents-plugin-anam

## 1.6.1

### Patch Changes

- Updated dependencies [[`5010952`](https://github.com/livekit/agents-js/commit/5010952de1bae7b66c72981966f79f450dc8fc8c), [`db3263b`](https://github.com/livekit/agents-js/commit/db3263b47e940760570548c8cae76f83bb1b621e), [`37eda82`](https://github.com/livekit/agents-js/commit/37eda821631e44e182dbc4331df68715d471c3f0), [`6b6ba2b`](https://github.com/livekit/agents-js/commit/6b6ba2b8a11bf96ab48950edbb633127620f7f5a), [`67620fb`](https://github.com/livekit/agents-js/commit/67620fb963310fb26cef0f2d862023c705fd93f0), [`fd46904`](https://github.com/livekit/agents-js/commit/fd46904eeb91817dce99680876c50162573028cb), [`d4edb58`](https://github.com/livekit/agents-js/commit/d4edb58c1f7dc1636f516ef7d379da3a473d97b4), [`2446c9e`](https://github.com/livekit/agents-js/commit/2446c9e2a38f4595dfb3c474be36294bb09cd3db), [`262a602`](https://github.com/livekit/agents-js/commit/262a602e2452e946ad3c79212ac7412de5cdb704), [`d5d8d04`](https://github.com/livekit/agents-js/commit/d5d8d0487d2e99f49a1b56ab6b9e82b481491955), [`0daf8d6`](https://github.com/livekit/agents-js/commit/0daf8d61d92bfba5267d76a3871e7634a9111648), [`9d38c3e`](https://github.com/livekit/agents-js/commit/9d38c3ed8e6add6c8cfabb7c17a178e882db79b1), [`238a58c`](https://github.com/livekit/agents-js/commit/238a58c6bedbcea041676c2dfd6e72be1e3ac912), [`f7e9c0c`](https://github.com/livekit/agents-js/commit/f7e9c0c5295381051a7a50401383d975b3ce22b8), [`16c30ca`](https://github.com/livekit/agents-js/commit/16c30caec4a1d5b61ba8358fa69f81dea84915c1)]:
- @livekit/agents@1.6.1

## 1.6.0

### Patch Changes
Expand Down
2 changes: 1 addition & 1 deletion plugins/anam/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@livekit/agents-plugin-anam",
"version": "1.6.0",
"version": "1.6.1",
"description": "Anam plugin for LiveKit Node Agents",
"main": "dist/index.js",
"require": "dist/index.cjs",
Expand Down
7 changes: 7 additions & 0 deletions plugins/anthropic/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,12 @@
# @livekit/agents-plugin-anthropic

## 1.6.1

### Patch Changes

- Updated dependencies [[`5010952`](https://github.com/livekit/agents-js/commit/5010952de1bae7b66c72981966f79f450dc8fc8c), [`db3263b`](https://github.com/livekit/agents-js/commit/db3263b47e940760570548c8cae76f83bb1b621e), [`37eda82`](https://github.com/livekit/agents-js/commit/37eda821631e44e182dbc4331df68715d471c3f0), [`6b6ba2b`](https://github.com/livekit/agents-js/commit/6b6ba2b8a11bf96ab48950edbb633127620f7f5a), [`67620fb`](https://github.com/livekit/agents-js/commit/67620fb963310fb26cef0f2d862023c705fd93f0), [`fd46904`](https://github.com/livekit/agents-js/commit/fd46904eeb91817dce99680876c50162573028cb), [`d4edb58`](https://github.com/livekit/agents-js/commit/d4edb58c1f7dc1636f516ef7d379da3a473d97b4), [`2446c9e`](https://github.com/livekit/agents-js/commit/2446c9e2a38f4595dfb3c474be36294bb09cd3db), [`262a602`](https://github.com/livekit/agents-js/commit/262a602e2452e946ad3c79212ac7412de5cdb704), [`d5d8d04`](https://github.com/livekit/agents-js/commit/d5d8d0487d2e99f49a1b56ab6b9e82b481491955), [`0daf8d6`](https://github.com/livekit/agents-js/commit/0daf8d61d92bfba5267d76a3871e7634a9111648), [`9d38c3e`](https://github.com/livekit/agents-js/commit/9d38c3ed8e6add6c8cfabb7c17a178e882db79b1), [`238a58c`](https://github.com/livekit/agents-js/commit/238a58c6bedbcea041676c2dfd6e72be1e3ac912), [`f7e9c0c`](https://github.com/livekit/agents-js/commit/f7e9c0c5295381051a7a50401383d975b3ce22b8), [`16c30ca`](https://github.com/livekit/agents-js/commit/16c30caec4a1d5b61ba8358fa69f81dea84915c1)]:
- @livekit/agents@1.6.1

## 1.6.0

### Patch Changes
Expand Down
2 changes: 1 addition & 1 deletion plugins/anthropic/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@livekit/agents-plugin-anthropic",
"version": "1.6.0",
"version": "1.6.1",
"description": "Anthropic plugin for LiveKit Node Agents",
"main": "dist/index.js",
"require": "dist/index.cjs",
Expand Down
7 changes: 7 additions & 0 deletions plugins/assemblyai/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,12 @@
# @livekit/agents-plugin-assemblyai

## 1.6.1

### Patch Changes

- Updated dependencies [[`5010952`](https://github.com/livekit/agents-js/commit/5010952de1bae7b66c72981966f79f450dc8fc8c), [`db3263b`](https://github.com/livekit/agents-js/commit/db3263b47e940760570548c8cae76f83bb1b621e), [`37eda82`](https://github.com/livekit/agents-js/commit/37eda821631e44e182dbc4331df68715d471c3f0), [`6b6ba2b`](https://github.com/livekit/agents-js/commit/6b6ba2b8a11bf96ab48950edbb633127620f7f5a), [`67620fb`](https://github.com/livekit/agents-js/commit/67620fb963310fb26cef0f2d862023c705fd93f0), [`fd46904`](https://github.com/livekit/agents-js/commit/fd46904eeb91817dce99680876c50162573028cb), [`d4edb58`](https://github.com/livekit/agents-js/commit/d4edb58c1f7dc1636f516ef7d379da3a473d97b4), [`2446c9e`](https://github.com/livekit/agents-js/commit/2446c9e2a38f4595dfb3c474be36294bb09cd3db), [`262a602`](https://github.com/livekit/agents-js/commit/262a602e2452e946ad3c79212ac7412de5cdb704), [`d5d8d04`](https://github.com/livekit/agents-js/commit/d5d8d0487d2e99f49a1b56ab6b9e82b481491955), [`0daf8d6`](https://github.com/livekit/agents-js/commit/0daf8d61d92bfba5267d76a3871e7634a9111648), [`9d38c3e`](https://github.com/livekit/agents-js/commit/9d38c3ed8e6add6c8cfabb7c17a178e882db79b1), [`238a58c`](https://github.com/livekit/agents-js/commit/238a58c6bedbcea041676c2dfd6e72be1e3ac912), [`f7e9c0c`](https://github.com/livekit/agents-js/commit/f7e9c0c5295381051a7a50401383d975b3ce22b8), [`16c30ca`](https://github.com/livekit/agents-js/commit/16c30caec4a1d5b61ba8358fa69f81dea84915c1)]:
- @livekit/agents@1.6.1

## 1.6.0

### Patch Changes
Expand Down
2 changes: 1 addition & 1 deletion plugins/assemblyai/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@livekit/agents-plugin-assemblyai",
"version": "1.6.0",
"version": "1.6.1",
"description": "AssemblyAI plugin for LiveKit Agents for Node.js",
"main": "dist/index.js",
"require": "dist/index.cjs",
Expand Down
7 changes: 7 additions & 0 deletions plugins/azure/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,12 @@
# @livekit/agents-plugin-azure

## 1.6.1

### Patch Changes

- Updated dependencies [[`5010952`](https://github.com/livekit/agents-js/commit/5010952de1bae7b66c72981966f79f450dc8fc8c), [`db3263b`](https://github.com/livekit/agents-js/commit/db3263b47e940760570548c8cae76f83bb1b621e), [`37eda82`](https://github.com/livekit/agents-js/commit/37eda821631e44e182dbc4331df68715d471c3f0), [`6b6ba2b`](https://github.com/livekit/agents-js/commit/6b6ba2b8a11bf96ab48950edbb633127620f7f5a), [`67620fb`](https://github.com/livekit/agents-js/commit/67620fb963310fb26cef0f2d862023c705fd93f0), [`fd46904`](https://github.com/livekit/agents-js/commit/fd46904eeb91817dce99680876c50162573028cb), [`d4edb58`](https://github.com/livekit/agents-js/commit/d4edb58c1f7dc1636f516ef7d379da3a473d97b4), [`2446c9e`](https://github.com/livekit/agents-js/commit/2446c9e2a38f4595dfb3c474be36294bb09cd3db), [`262a602`](https://github.com/livekit/agents-js/commit/262a602e2452e946ad3c79212ac7412de5cdb704), [`d5d8d04`](https://github.com/livekit/agents-js/commit/d5d8d0487d2e99f49a1b56ab6b9e82b481491955), [`0daf8d6`](https://github.com/livekit/agents-js/commit/0daf8d61d92bfba5267d76a3871e7634a9111648), [`9d38c3e`](https://github.com/livekit/agents-js/commit/9d38c3ed8e6add6c8cfabb7c17a178e882db79b1), [`238a58c`](https://github.com/livekit/agents-js/commit/238a58c6bedbcea041676c2dfd6e72be1e3ac912), [`f7e9c0c`](https://github.com/livekit/agents-js/commit/f7e9c0c5295381051a7a50401383d975b3ce22b8), [`16c30ca`](https://github.com/livekit/agents-js/commit/16c30caec4a1d5b61ba8358fa69f81dea84915c1)]:
- @livekit/agents@1.6.1

## 1.6.0

### Patch Changes
Expand Down
2 changes: 1 addition & 1 deletion plugins/azure/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@livekit/agents-plugin-azure",
"version": "1.6.0",
"version": "1.6.1",
"description": "Azure plugin for LiveKit Agents for Node.js",
"main": "dist/index.js",
"require": "dist/index.cjs",
Expand Down
Loading
Loading