[Discussion] Voice support

[abaudhuin]

Goal of this issue is to start a discussion on adding voice prompting in T3code.

I've worked on a demo of voice support.
A simple button to start recording + associated config.
You can out the code here: abaudhuin#1

recording_20260309-111328.mp4

My current thing has important compromises, just a starting point for the discussion.
It uses a local Parakeet 0.6B v2 model running on CPU https://huggingface.co/nvidia/parakeet-tdt-0.6b-v2. Which comes with its rust sidecar...
But it works.

Is voice something you are considering?
I'm willing to contribute on this topic on whatever your vision would be.

[aaditagrawal]

I think most people already use third-party apps for voice TTS, but this could be a good addition.

But for those who already have it, it's also duplication, both in compute and memory.

I would prefer if this would be an opt-in feature.

[abaudhuin]

Clearly, it should be opt-in.
The question of using a local model is also questionable (this one is multi-platform, multi language).
Could be using one/multiple cloud provider for the voice model.

[maria-rcks]

out of scope, there are apps that do this already.

[tusharhqq]

openai provides there speech to text model usage in there subscriptions, an voice input can be made, would be an awesome quality of life feature