[BUG] Docker GPU branch not using GPU (upstream issue)

[jxlarrea]

Is there an existing issue for this?

• I have searched the existing issues

Current Behavior

The lscr.io/linuxserver/piper:gpu image posted today does not use my RTX 4000 Ada GPU. It behaves exactly as the non-GPU branch.

Expected Behavior

Should be using the GPU.

Steps To Reproduce

Run the container.

Environment

- OS: Debian 12 LXC running on Proxmox.

CPU architecture

x86-64

Docker creation

services:
  piper:
    image: lscr.io/linuxserver/piper:gpu
    container_name: piper
    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              count: 1
              capabilities: [gpu]
    pull_policy: always
    environment:
      - PIPER_VOICE=en_US-lessac-medium
      - NVIDIA_VISIBLE_DEVICES=all
      - NVIDIA_DRIVER_CAPABILITIES=all
    runtime: nvidia
    volumes:
      - /mnt/model/linuxserver-piper:/config
    ports:
      - 10200:10200
    restart: unless-stopped

Container logs

[migrations] started

[migrations] no migrations found

usermod: no changes

───────────────────────────────────────

      ██╗     ███████╗██╗ ██████╗

      ██║     ██╔════╝██║██╔═══██╗

      ██║     ███████╗██║██║   ██║

      ██║     ╚════██║██║██║   ██║

      ███████╗███████║██║╚██████╔╝

      ╚══════╝╚══════╝╚═╝ ╚═════╝

   Brought to you by linuxserver.io

───────────────────────────────────────

To support LSIO projects visit:

https://www.linuxserver.io/donate/

───────────────────────────────────────

GID/UID

───────────────────────────────────────

User UID:    911

User GID:    911

───────────────────────────────────────

Linuxserver.io version: 1.4.0-ls7

Build-date: 2025-01-27T09:11:53+00:00

───────────────────────────────────────

    

[custom-init] No custom files found, skipping...

INFO:__main__:Ready

Connection to localhost (127.0.0.1) 10200 port [tcp/*] succeeded!

[ls.io-init] done.

[github-actions]

Thanks for opening your first issue here! Be sure to follow the relevant issue templates, or risk having this issue marked as invalid.

[systemofapwne]

I see the same issue: I just switched to the GPU branch in hope, that it utilizes the GPU. Apparently, it doesn't. The official docs even do not state GPU support yet.
I would honestly appreciate GPU support working.

[michnovka]

I can confirm the package does not use my GPU, despite the same config with faster-whisper works:

  piper:
    image: lscr.io/linuxserver/piper:gpu
    container_name: piper
    environment:
      - PIPER_VOICE=en_US-lessac-high
    volumes:
      - ./piper/data:/config
    network_mode: host
    runtime: nvidia
    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              count: all
              capabilities:
                - gpu
                - utility
                - compute

[michnovka]

FYI this repo provides a workaround until it is fixed - https://github.com/slackr31337/wyoming-piper-gpu

[jxlarrea]

FYI this repo provides a workaround until it is fixed - https://github.com/slackr31337/wyoming-piper-gpu

Thank you for this. I can confirm that this repo actually uses the GPU and it is insanely fast.

[systemofapwne]

Can also confirm. Piper is insanely fast now. Switched the container until this one here fixes GPU support.

[LinuxServer-CI]

This issue has been automatically marked as stale because it has not had recent activity. This might be due to missing feedback from OP. It will be closed if no further activity occurs. Thank you for your contributions.

[Impact123]

Unstale.

[LinuxServer-CI]

This issue has been automatically marked as stale because it has not had recent activity. This might be due to missing feedback from OP. It will be closed if no further activity occurs. Thank you for your contributions.