Skip to content

diffusers / stablediffusion still broken in v4.3.0 - v4.4.0 #9979

Description

@K4r0qtuYNE5G4qgZ

LocalAI version:
v4.3.0

Environment, CPU architecture, OS, and Version:
Linux 6.8.0-117-generic #117-Ubuntu SMP PREEMPT_DYNAMIC Tue May 5 19:26:24 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Intel Xeon E5-2695 v4 / 128GB DDR4
NVIDIA GeForce RTX 3050

Describe the bug
diffusers backend / stablediffusion broken since ~May 12, Local AI v4.2.3

To Reproduce
Go to Studio Tab
Select stablediffusion in Model Pull out menu
Try to Generate

Expected behavior
That it works like it did prior Local AI v4.0.0 ~v4.2.3

Logs

07:09:01.545
stdout
Initializing libbackend for cuda13-diffusers
07:09:01.551
stdout
Using portable Python
07:09:01.776
stdout
Added /data/LocalAI/backends/cuda13-diffusers/lib to LD_LIBRARY_PATH for GPU libraries
07:09:07.211
stderr
Server started. Listening on: 127.0.0.1:35045
07:09:07.544
stderr
Loading model DreamShaper_8_pruned.safetensors...
07:09:07.544
stderr
Request Model: "DreamShaper_8_pruned.safetensors"
07:09:07.544
stderr
ContextSize: 4096
07:09:07.544
stderr
Seed: 833854170
07:09:07.544
stderr
NBatch: 512
07:09:07.544
stderr
F16Memory: true
07:09:07.544
stderr
MMap: true
07:09:07.544
stderr
NGPULayers: 9999999
07:09:07.544
stderr
Threads: 18
07:09:07.544
stderr
ModelFile: "/data/LocalAI/models/DreamShaper_8_pruned.safetensors"
07:09:07.544
stderr
PipelineType: "StableDiffusionPipeline"
07:09:07.544
stderr
SchedulerType: "k_dpmpp_2m"
07:09:07.544
stderr
CUDA: true
07:09:07.544
stderr
FlashAttention: "auto"
07:09:07.544
stderr
ModelPath: "/data/LocalAI/models"
07:09:07.544
stderr
07:09:07.544
stderr
Options: {}
07:09:07.544
stderr
LoadModel: PipelineType from request: StableDiffusionPipeline
07:09:07.767
stderr
Modular Diffusers is currently an experimental feature under active development. The API is subject to breaking changes in future releases.
07:09:08.006
stderr
[transformers] `Siglip2ImageProcessorFast` is deprecated. The `Fast` suffix for image processors has been removed; use `Siglip2ImageProcessor` instead.
07:09:08.914
stderr

Fetching 11 files:   0%|          | 0/11 [00:00<?, ?it/s]
Fetching 11 files: 100%|██████████| 11/11 [00:00<00:00, 6182.14it/s]
07:09:09.010
stderr

Loading pipeline components...:   0%|          | 0/6 [00:00<?, ?it/s]
Loading pipeline components...:  33%|███▎      | 2/6 [00:00<00:00, 21.54it/s]
07:09:09.013
stdout
Received termination signal. Shutting down...

Additional context
It 100% worked <Local AI v4.0.0 ~v4.2.3 then it said that there were updates for the backends and I guess around there it did break.

Current diffusers Backend:
Version 8830fd803042
Source: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-diffusers

When trying to Reinstall Backend, it installs cuda-12-diffusers instead of the already installed cuda-13-diffusers and ends up with both installed. But it doesn't matter which one is set manually, both crash when using stablediffusion.

Also Model: sd-3.5-medium-ggml with Backend: stablediffusion-ggml still works fine without errors.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions