[Bug] z-image-turbo very slow on mac

[bjoernrenzel-optadata]

Git commit

My MacBook with an M3 chip takes 600 seconds per iteration. With ComfyUI, it only takes 19 seconds per iteration. Is this normal? Or am I doing something wrong?

Operating System & Version

macOS 26.1

GGML backends

Metal

Command-line arguments used

./sd --diffusion-model z_image_turbo-Q3_K.gguf --vae vae.sft --llm Qwen3-4B-Instruct-2507-Q4_K_M.gguf -p "A cinematic, melancholic photograph of a solitary hooded figure walking through a sprawling, rain-slicked metropolis at night." --cfg-scale 1.0 -v --offload-to-cpu --diffusion-fa -H 1024 -W 512

Steps to reproduce

download
https://github.com/leejet/stable-diffusion.cpp/releases/download/master-387-e4c50f1/sd-master-e4c50f1-bin-Darwin-macOS-15.7.2-arm64.zip

unzip

copy models to folder

SET DYLD_LIBRARY_PATH to folder of binary

run
./sd --diffusion-model z_image_turbo-Q3_K.gguf --vae vae.sft --llm Qwen3-4B-Instruct-2507-Q4_K_M.gguf -p "A cinematic, melancholic photograph of a solitary hooded figure walking through a sprawling, rain-slicked metropolis at night." --cfg-scale 1.0 -v --offload-to-cpu --diffusion-fa -H 1024 -W 512

What you expected to happen

Iteration of 20 seconds per step

What actually happened

Iteration of 600 seconds per step

Logs / error messages / stack trace

No response

Additional context / environment details

No response

[Green-Sky]

Can you post the log with -v ?

[bjoernrenzel-optadata]

./sd --diffusion-model z_image_turbo-Q2_K.gguf --vae z-image-vae.safetensors --llm Qwen3-4B-Instruct-2507-Q2_K.gguf -p "A cinematic, melancholic photograph of a solitary hooded figure walking through a sprawling, rain-slicked metropolis at night." --cfg-scale 1.0 -H 1024 -W 512 --steps 1 -v --offload-to-cpu --diffusion-fa
Option:
n_threads: 6
mode: img_gen
model_path:
wtype: unspecified
clip_l_path:
clip_g_path:
clip_vision_path:
t5xxl_path:
llm_path: Qwen3-4B-Instruct-2507-Q2_K.gguf
llm_vision_path:
diffusion_model_path: z_image_turbo-Q2_K.gguf
high_noise_diffusion_model_path:
vae_path: z-image-vae.safetensors
taesd_path:
esrgan_path:
control_net_path:
embedding_dir:
photo_maker_path:
pm_id_images_dir:
pm_id_embed_path:
pm_style_strength: 20.00
output_path: output.png
init_image_path:
end_image_path:
mask_image_path:
control_image_path:
ref_images_paths:
control_video_path:
auto_resize_ref_image: true
increase_ref_index: false
offload_params_to_cpu: true
clip_on_cpu: false
control_net_cpu: false
vae_on_cpu: false
diffusion flash attention: true
diffusion Conv2d direct: false
vae_conv_direct: false
control_strength: 0.90
prompt: A cinematic, melancholic photograph of a solitary hooded figure walking through a sprawling, rain-slicked metropolis at night.
negative_prompt:
clip_skip: -1
width: 512
height: 1024
sample_params: (txt_cfg: 1.00, img_cfg: 1.00, distilled_guidance: 3.50, slg.layer_count: 3, slg.layer_start: 0.01, slg.layer_end: 0.20, slg.scale: 0.00, scheduler: NONE, sample_method: NONE, sample_steps: 1, eta: 0.00, shifted_timestep: 0)
high_noise_sample_params: (txt_cfg: 7.00, img_cfg: 7.00, distilled_guidance: 3.50, slg.layer_count: 3, slg.layer_start: 0.01, slg.layer_end: 0.20, slg.scale: 0.00, scheduler: NONE, sample_method: NONE, sample_steps: -1, eta: 0.00, shifted_timestep: 0)
moe_boundary: 0.875
prediction: default
lora_apply_mode: auto
flow_shift: inf
strength(img2img): 0.75
rng: cuda
sampler rng: NONE
seed: 42
batch_count: 1
vae_tiling: false
force_sdxl_vae_conv_scale: false
upscale_repeats: 1
chroma_use_dit_mask: true
chroma_use_t5_mask: false
chroma_t5_mask_pad: 1
video_frames: 1
easycache: disabled (threshold=0.200, start=0.15, end=0.95)
vace_strength: 1.00
fps: 16
preview_mode: none (denoised)
preview_interval: 1
System Info:
SSE3 = 0
AVX = 0
AVX2 = 0
AVX512 = 0
AVX512_VBMI = 0
AVX512_VNNI = 0
FMA = 0
NEON = 1
ARM_FMA = 1
F16C = 0
FP16_VA = 1
WASM_SIMD = 0
VSX = 0
[DEBUG] stable-diffusion.cpp:189 - Using CPU backend
[INFO ] stable-diffusion.cpp:234 - loading diffusion model from 'z_image_turbo-Q2_K.gguf'
[INFO ] model.cpp:378 - load z_image_turbo-Q2_K.gguf using gguf format
[DEBUG] model.cpp:420 - init from 'z_image_turbo-Q2_K.gguf'
[INFO ] stable-diffusion.cpp:281 - loading llm from 'Qwen3-4B-Instruct-2507-Q2_K.gguf'
[INFO ] model.cpp:378 - load Qwen3-4B-Instruct-2507-Q2_K.gguf using gguf format
[DEBUG] model.cpp:420 - init from 'Qwen3-4B-Instruct-2507-Q2_K.gguf'
[INFO ] stable-diffusion.cpp:295 - loading vae from 'z-image-vae.safetensors'
[INFO ] model.cpp:381 - load z-image-vae.safetensors using safetensors format
[DEBUG] model.cpp:511 - init from 'z-image-vae.safetensors', prefix = 'vae.'
[INFO ] stable-diffusion.cpp:318 - Version: Z-Image
[INFO ] stable-diffusion.cpp:346 - Weight type stat: f32: 640 | q8_0: 22 | q2_K: 324 | q3_K: 72 | q4_K: 36 | q6_K: 1
[INFO ] stable-diffusion.cpp:347 - Conditioner weight type stat: f32: 145 | q2_K: 144 | q3_K: 72 | q4_K: 36 | q6_K: 1
[INFO ] stable-diffusion.cpp:348 - Diffusion model weight type stat: f32: 251 | q8_0: 22 | q2_K: 180
[INFO ] stable-diffusion.cpp:349 - VAE weight type stat: f32: 244
[DEBUG] stable-diffusion.cpp:351 - ggml tensor size = 400 bytes
[DEBUG] llm.hpp:285 - merges size 151387
[DEBUG] llm.hpp:317 - vocab size: 151665
[INFO ] stable-diffusion.cpp:535 - Using flash attention in the diffusion model
[DEBUG] ggml_extend.hpp:1877 - qwen3 params backend buffer size = 2765.94 MB(RAM) (398 tensors)
[DEBUG] ggml_extend.hpp:1877 - z_image params backend buffer size = 2472.32 MB(RAM) (453 tensors)
[DEBUG] ggml_extend.hpp:1877 - vae params backend buffer size = 94.57 MB(RAM) (138 tensors)
[DEBUG] stable-diffusion.cpp:683 - loading weights
[DEBUG] model.cpp:1359 - using 6 threads for model loading
[DEBUG] model.cpp:1381 - loading tensors from z_image_turbo-Q2_K.gguf
|====================> | 453/1095 - 1126.87it/s
[DEBUG] model.cpp:1381 - loading tensors from Qwen3-4B-Instruct-2507-Q2_K.gguf
|======================================> | 851/1095 - 1049.32it/s
[DEBUG] model.cpp:1381 - loading tensors from z-image-vae.safetensors
|==================================================| 1095/1095 - 1080.95it/s
[INFO ] model.cpp:1590 - loading tensors completed, taking 1.01s (process: 0.00s, read: 0.58s, memcpy: 0.00s, convert: 0.02s, copy_to_backend: 0.00s)
[INFO ] stable-diffusion.cpp:782 - total params memory size = 5332.83MB (VRAM 0.00MB, RAM 5332.83MB): text_encoders 2765.94MB(RAM), diffusion_model 2472.32MB(RAM), vae 94.57MB(RAM), controlnet 0.00MB(VRAM), pmid 0.00MB(RAM)
[INFO ] stable-diffusion.cpp:883 - running in FLOW mode
[DEBUG] stable-diffusion.cpp:908 - finished loaded file
[DEBUG] stable-diffusion.cpp:3138 - generate_image 512x1024
[INFO ] stable-diffusion.cpp:3169 - sampling using Euler method
[INFO ] denoiser.hpp:364 - get_sigmas with discrete scheduler
[INFO ] stable-diffusion.cpp:3282 - TXT2IMG
[INFO ] stable-diffusion.cpp:1167 - apply at runtime
[DEBUG] conditioner.hpp:1701 - parse '<|im_start|>user
A cinematic, melancholic photograph of a solitary hooded figure walking through a sprawling, rain-slicked metropolis at night.<|im_end|>
<|im_start|>assistant
' to [['<|im_start|>user
', 1], ['A cinematic, melancholic photograph of a solitary hooded figure walking through a sprawling, rain-slicked metropolis at night.', 1], ['<|im_end|>
<|im_start|>assistant
', 1], ]
[DEBUG] llm.hpp:259 - split prompt "<|im_start|>user
" to tokens ["<|im_start|>", "user", "Ċ", ]
[DEBUG] llm.hpp:259 - split prompt "A cinematic, melancholic photograph of a solitary hooded figure walking through a sprawling, rain-slicked metropolis at night." to tokens ["A", "Ġcinematic", ",", "Ġmelanch", "olic", "Ġphotograph", "Ġof", "Ġa", "Ġsolitary", "Ġhood", "ed", "Ġfigure", "Ġwalking", "Ġthrough", "Ġa", "Ġsprawling", ",", "Ġrain", "-s", "lick", "ed", "Ġmet", "ropolis", "Ġat", "Ġnight", ".", ]
[DEBUG] llm.hpp:259 - split prompt "<|im_end|>
<|im_start|>assistant
" to tokens ["<|im_end|>", "Ċ", "<|im_start|>", "assistant", "Ċ", ]
[DEBUG] ggml_extend.hpp:1691 - qwen3 compute buffer size: 3.72 MB(RAM)
[DEBUG] conditioner.hpp:1896 - computing condition graph completed, taking 4440 ms
[INFO ] stable-diffusion.cpp:2917 - get_learned_condition completed, taking 4441 ms
[INFO ] stable-diffusion.cpp:3028 - generating image: 1/1 - seed 42
[DEBUG] ggml_extend.hpp:1691 - z_image compute buffer size: 281.77 MB(RAM)
|==================================================| 1/1 - 570.76s/it
[INFO ] stable-diffusion.cpp:3069 - sampling completed, taking 570.80s
[INFO ] stable-diffusion.cpp:3077 - generating 1 latent images completed, taking 570.84s
[INFO ] stable-diffusion.cpp:3080 - decoding 1 latents
[DEBUG] ggml_extend.hpp:1691 - vae compute buffer size: 3328.00 MB(RAM)
[DEBUG] stable-diffusion.cpp:2286 - computing vae decode graph completed, taking 19.75s
[INFO ] stable-diffusion.cpp:3090 - latent 1 decoded, taking 19.75s
[INFO ] stable-diffusion.cpp:3094 - decode_first_stage completed, taking 19.75s
[INFO ] stable-diffusion.cpp:3390 - generate_image completed in 595.03s
save result PNG image to 'output.png' (success)

[stduhpf]

[DEBUG] stable-diffusion.cpp:189 - Using CPU backend

Looks like it's not using Metal

[bjoernrenzel-optadata]

I used the pre compiled release version. Can I enable metal?

[leejet]

The precompiled version does not support Metal. If you need Metal support, you will have to compile it yourself. You can refer to this guide for compilation: https://github.com/leejet/stable-diffusion.cpp/blob/master/docs/build.md

[brenzel]

After compiling, metal is used. Unfortunately, I get another error when loading the GGUF text encoder.

`./sd --diffusion-model z_image_turbo-Q2_K.gguf --vae z-image-vae.safetensors --llm Qwen3-4B-Instruct-2507-Q2_K.gguf -p "A cinematic, melancholic photograph of a solitary hooded figure walking through a sprawling, rain-slicked metropolis at night." --cfg-scale 1.0 -H 1024 -W 512 --steps 1 -v --offload-to-cpu --diffusion-fa
Option:
n_threads: 6
mode: img_gen
model_path:
wtype: unspecified
clip_l_path:
clip_g_path:
clip_vision_path:
t5xxl_path:
llm_path: Qwen3-4B-Instruct-2507-Q2_K.gguf
llm_vision_path:
diffusion_model_path: z_image_turbo-Q2_K.gguf
high_noise_diffusion_model_path:
vae_path: z-image-vae.safetensors
taesd_path:
esrgan_path:
control_net_path:
embedding_dir:
photo_maker_path:
pm_id_images_dir:
pm_id_embed_path:
pm_style_strength: 20.00
output_path: output.png
init_image_path:
end_image_path:
mask_image_path:
control_image_path:
ref_images_paths:
control_video_path:
auto_resize_ref_image: true
increase_ref_index: false
offload_params_to_cpu: true
clip_on_cpu: false
control_net_cpu: false
vae_on_cpu: false
diffusion flash attention: true
diffusion Conv2d direct: false
vae_conv_direct: false
control_strength: 0.90
prompt: A cinematic, melancholic photograph of a solitary hooded figure walking through a sprawling, rain-slicked metropolis at night.
negative_prompt:
clip_skip: -1
width: 512
height: 1024
sample_params: (txt_cfg: 1.00, img_cfg: 1.00, distilled_guidance: 3.50, slg.layer_count: 3, slg.layer_start: 0.01, slg.layer_end: 0.20, slg.scale: 0.00, scheduler: NONE, sample_method: NONE, sample_steps: 1, eta: 0.00, shifted_timestep: 0)
high_noise_sample_params: (txt_cfg: 7.00, img_cfg: 7.00, distilled_guidance: 3.50, slg.layer_count: 3, slg.layer_start: 0.01, slg.layer_end: 0.20, slg.scale: 0.00, scheduler: NONE, sample_method: NONE, sample_steps: -1, eta: 0.00, shifted_timestep: 0)
moe_boundary: 0.875
prediction: default
lora_apply_mode: auto
flow_shift: inf
strength(img2img): 0.75
rng: cuda
sampler rng: NONE
seed: 42
batch_count: 1
vae_tiling: false
force_sdxl_vae_conv_scale: false
upscale_repeats: 1
chroma_use_dit_mask: true
chroma_use_t5_mask: false
chroma_t5_mask_pad: 1
video_frames: 1
easycache: disabled (threshold=0.200, start=0.15, end=0.95)
vace_strength: 1.00
fps: 16
preview_mode: none (denoised)
preview_interval: 1
System Info:
SSE3 = 0
AVX = 0
AVX2 = 0
AVX512 = 0
AVX512_VBMI = 0
AVX512_VNNI = 0
FMA = 0
NEON = 1
ARM_FMA = 1
F16C = 0
FP16_VA = 1
WASM_SIMD = 0
VSX = 0
[DEBUG] stable-diffusion.cpp:163 - Using Metal backend
[INFO ] ggml_extend.hpp:69 - ggml_metal_library_init: using embedded metal library
[INFO ] ggml_extend.hpp:69 - ggml_metal_library_init: loaded in 0.006 sec
[INFO ] ggml_extend.hpp:69 - ggml_metal_device_init: GPU name: Apple M3 Pro
[INFO ] ggml_extend.hpp:69 - ggml_metal_device_init: GPU family: MTLGPUFamilyApple9 (1009)
[INFO ] ggml_extend.hpp:69 - ggml_metal_device_init: GPU family: MTLGPUFamilyCommon3 (3003)
[INFO ] ggml_extend.hpp:69 - ggml_metal_device_init: GPU family: MTLGPUFamilyMetal4 (5002)
[INFO ] ggml_extend.hpp:69 - ggml_metal_device_init: simdgroup reduction = true
[INFO ] ggml_extend.hpp:69 - ggml_metal_device_init: simdgroup matrix mul. = true
[INFO ] ggml_extend.hpp:69 - ggml_metal_device_init: has unified memory = true
[INFO ] ggml_extend.hpp:69 - ggml_metal_device_init: has bfloat = true
[INFO ] ggml_extend.hpp:69 - ggml_metal_device_init: use residency sets = true
[INFO ] ggml_extend.hpp:69 - ggml_metal_device_init: use shared buffers = true
[INFO ] ggml_extend.hpp:69 - ggml_metal_device_init: recommendedMaxWorkingSetSize = 30150.67 MB
[INFO ] ggml_extend.hpp:69 - ggml_metal_init: allocating
[INFO ] ggml_extend.hpp:69 - ggml_metal_init: found device: Apple M3 Pro
[INFO ] ggml_extend.hpp:69 - ggml_metal_init: picking default device: Apple M3 Pro
[INFO ] ggml_extend.hpp:69 - ggml_metal_init: use bfloat = true
[INFO ] ggml_extend.hpp:69 - ggml_metal_init: use fusion = true
[INFO ] ggml_extend.hpp:69 - ggml_metal_init: use concurrency = true
[INFO ] ggml_extend.hpp:69 - ggml_metal_init: use graph optimize = true
[INFO ] stable-diffusion.cpp:234 - loading diffusion model from 'z_image_turbo-Q2_K.gguf'
[INFO ] model.cpp:378 - load z_image_turbo-Q2_K.gguf using gguf format
[DEBUG] model.cpp:420 - init from 'z_image_turbo-Q2_K.gguf'
[INFO ] stable-diffusion.cpp:281 - loading llm from 'Qwen3-4B-Instruct-2507-Q2_K.gguf'
[INFO ] model.cpp:378 - load Qwen3-4B-Instruct-2507-Q2_K.gguf using gguf format
[DEBUG] model.cpp:420 - init from 'Qwen3-4B-Instruct-2507-Q2_K.gguf'
[INFO ] stable-diffusion.cpp:295 - loading vae from 'z-image-vae.safetensors'
[INFO ] model.cpp:381 - load z-image-vae.safetensors using safetensors format
[DEBUG] model.cpp:511 - init from 'z-image-vae.safetensors', prefix = 'vae.'
[INFO ] stable-diffusion.cpp:318 - Version: Z-Image
[INFO ] stable-diffusion.cpp:346 - Weight type stat: f32: 640 | q8_0: 22 | q2_K: 324 | q3_K: 72 | q4_K: 36 | q6_K: 1
[INFO ] stable-diffusion.cpp:347 - Conditioner weight type stat: f32: 145 | q2_K: 144 | q3_K: 72 | q4_K: 36 | q6_K: 1
[INFO ] stable-diffusion.cpp:348 - Diffusion model weight type stat: f32: 251 | q8_0: 22 | q2_K: 180
[INFO ] stable-diffusion.cpp:349 - VAE weight type stat: f32: 244
[DEBUG] stable-diffusion.cpp:351 - ggml tensor size = 400 bytes
[DEBUG] llm.hpp:285 - merges size 151387
[DEBUG] llm.hpp:317 - vocab size: 151665
[INFO ] stable-diffusion.cpp:535 - Using flash attention in the diffusion model
[DEBUG] ggml_extend.hpp:1877 - qwen3 params backend buffer size = 2765.94 MB(RAM) (398 tensors)
[DEBUG] ggml_extend.hpp:1877 - z_image params backend buffer size = 2472.32 MB(RAM) (453 tensors)
[DEBUG] ggml_extend.hpp:1877 - vae params backend buffer size = 94.57 MB(RAM) (138 tensors)
[DEBUG] stable-diffusion.cpp:683 - loading weights
[DEBUG] model.cpp:1359 - using 6 threads for model loading
[DEBUG] model.cpp:1381 - loading tensors from z_image_turbo-Q2_K.gguf
|====================> | 453/1095 - 1104.88it/s
[DEBUG] model.cpp:1381 - loading tensors from Qwen3-4B-Instruct-2507-Q2_K.gguf
|======================================> | 851/1095 - 1049.32it/s
[DEBUG] model.cpp:1381 - loading tensors from z-image-vae.safetensors
|==================================================| 1095/1095 - 1078.82it/s
[INFO ] model.cpp:1590 - loading tensors completed, taking 1.02s (process: 0.00s, read: 0.57s, memcpy: 0.00s, convert: 0.02s, copy_to_backend: 0.00s)
[INFO ] stable-diffusion.cpp:782 - total params memory size = 5332.83MB (VRAM 5332.83MB, RAM 0.00MB): text_encoders 2765.94MB(VRAM), diffusion_model 2472.32MB(VRAM), vae 94.57MB(VRAM), controlnet 0.00MB(VRAM), pmid 0.00MB(VRAM)
[INFO ] stable-diffusion.cpp:883 - running in FLOW mode
[DEBUG] stable-diffusion.cpp:908 - finished loaded file
[DEBUG] stable-diffusion.cpp:3138 - generate_image 512x1024
[INFO ] stable-diffusion.cpp:3169 - sampling using Euler method
[INFO ] denoiser.hpp:364 - get_sigmas with discrete scheduler
[INFO ] stable-diffusion.cpp:3282 - TXT2IMG
[INFO ] stable-diffusion.cpp:1167 - apply at runtime
[DEBUG] conditioner.hpp:1701 - parse '<|im_start|>user
A cinematic, melancholic photograph of a solitary hooded figure walking through a sprawling, rain-slicked metropolis at night.<|im_end|>
<|im_start|>assistant
' to [['<|im_start|>user
', 1], ['A cinematic, melancholic photograph of a solitary hooded figure walking through a sprawling, rain-slicked metropolis at night.', 1], ['<|im_end|>
<|im_start|>assistant
', 1], ]
[DEBUG] llm.hpp:259 - split prompt "<|im_start|>user
" to tokens ["<|im_start|>", "user", "Ċ", ]
[DEBUG] llm.hpp:259 - split prompt "A cinematic, melancholic photograph of a solitary hooded figure walking through a sprawling, rain-slicked metropolis at night." to tokens ["A", "Ġcinematic", ",", "Ġmelanch", "olic", "Ġphotograph", "Ġof", "Ġa", "Ġsolitary", "Ġhood", "ed", "Ġfigure", "Ġwalking", "Ġthrough", "Ġa", "Ġsprawling", ",", "Ġrain", "-s", "lick", "ed", "Ġmet", "ropolis", "Ġat", "Ġnight", ".", ]
[DEBUG] llm.hpp:259 - split prompt "<|im_end|>
<|im_start|>assistant
" to tokens ["<|im_end|>", "Ċ", "<|im_start|>", "assistant", "Ċ", ]
[INFO ] ggml_extend.hpp:1791 - qwen3 offload params (2765.94 MB, 398 tensors) to runtime backend (Metal), taking 0.28s
[DEBUG] ggml_extend.hpp:1691 - qwen3 compute buffer size: 3.72 MB(VRAM)
[DEBUG] ggml_extend.hpp:66 - ggml_metal_library_compile_pipeline: compiling pipeline: base = 'kernel_get_rows_f32', name = 'kernel_get_rows_f32'
[DEBUG] ggml_extend.hpp:66 - ggml_metal_library_compile_pipeline: loaded kernel_get_rows_f32 0x10692af70 | th_max = 1024 | th_width = 32
[DEBUG] ggml_extend.hpp:66 - ggml_metal_library_compile_pipeline: compiling pipeline: base = 'kernel_rms_norm_mul_f32_4', name = 'kernel_rms_norm_mul_f32_4'
[DEBUG] ggml_extend.hpp:66 - ggml_metal_library_compile_pipeline: loaded kernel_rms_norm_mul_f32_4 0x10692b770 | th_max = 1024 | th_width = 32
[DEBUG] ggml_extend.hpp:66 - ggml_metal_library_compile_pipeline: compiling pipeline: base = 'kernel_mul_mm_q4_K_f32', name = 'kernel_mul_mm_q4_K_f32_bci=0_bco=1'
[DEBUG] ggml_extend.hpp:66 - ggml_metal_library_compile_pipeline: loaded kernel_mul_mm_q4_K_f32_bci=0_bco=1 0x10692bf70 | th_max = 1024 | th_width = 32
[DEBUG] ggml_extend.hpp:66 - ggml_metal_library_compile_pipeline: compiling pipeline: base = 'kernel_cpy_f32_f32', name = 'kernel_cpy_f32_f32'
[DEBUG] ggml_extend.hpp:66 - ggml_metal_library_compile_pipeline: loaded kernel_cpy_f32_f32 0x10692c770 | th_max = 1024 | th_width = 32
[DEBUG] ggml_extend.hpp:66 - ggml_metal_library_compile_pipeline: compiling pipeline: base = 'kernel_mul_mm_q2_K_f32', name = 'kernel_mul_mm_q2_K_f32_bci=0_bco=1'
[DEBUG] ggml_extend.hpp:66 - ggml_metal_library_compile_pipeline: loaded kernel_mul_mm_q2_K_f32_bci=0_bco=1 0x10692cf70 | th_max = 1024 | th_width = 32
[DEBUG] ggml_extend.hpp:66 - ggml_metal_library_compile_pipeline: compiling pipeline: base = 'kernel_rope_neox_f32', name = 'kernel_rope_neox_f32'
[DEBUG] ggml_extend.hpp:66 - ggml_metal_library_compile_pipeline: loaded kernel_rope_neox_f32 0x10692d270 | th_max = 1024 | th_width = 32
[DEBUG] ggml_extend.hpp:66 - ggml_metal_library_compile_pipeline: compiling pipeline: base = 'kernel_mul_mm_f32_f32', name = 'kernel_mul_mm_f32_f32_bci=0_bco=1'
[DEBUG] ggml_extend.hpp:66 - ggml_metal_library_compile_pipeline: loaded kernel_mul_mm_f32_f32_bci=0_bco=1 0x10692d570 | th_max = 1024 | th_width = 32
[DEBUG] ggml_extend.hpp:66 - ggml_metal_library_compile_pipeline: compiling pipeline: base = 'kernel_scale_f32_4', name = 'kernel_scale_f32_4'
[DEBUG] ggml_extend.hpp:66 - ggml_metal_library_compile_pipeline: loaded kernel_scale_f32_4 0x10692dd70 | th_max = 1024 | th_width = 32
[ERROR] ggml_extend.hpp:75 - ggml_metal_op_encode_impl: error: unsupported op 'DIAG_MASK_INF'
/Users/admin/Downloads/stable-diffusion.cpp/ggml/src/ggml-metal/ggml-metal-ops.cpp:201: unsupported op
(lldb) process attach --pid 38923
Process 38923 stopped

• thread First impressions info dump #1, queue = 'com.apple.main-thread', stop reason = signal SIGSTOP
  frame #0: 0x0000000197b5242c libsystem_kernel.dylib__wait4 + 8 libsystem_kernel.dylib__wait4:
  -> 0x197b5242c <+8>: b.lo 0x197b5244c ; <+40>
  0x197b52430 <+12>: pacibsp
  0x197b52434 <+16>: stp x29, x30, [sp, #-0x10]!
  0x197b52438 <+20>: mov x29, sp
  Target 0: (sd) stopped.
  Executable binary set to "/Users/admin/Downloads/stable-diffusion.cpp/build/bin/sd".
  Architecture set to: arm64-apple-macosx-.
  (lldb) bt
• thread First impressions info dump #1, queue = 'com.apple.main-thread', stop reason = signal SIGSTOP
  • frame #0: 0x0000000197b5242c libsystem_kernel.dylib__wait4 + 8 frame #1: 0x0000000104c6300c sdggml_abort + 156
    frame Minor build fixes #2: 0x0000000104c5af7c sdggml_metal_op_encode + 2348 frame #3: 0x0000000104c5a470 sd__ggml_metal_set_n_cb_block_invoke + 180
    frame Add build script for Microsoft Visual Studio #4: 0x0000000104c5a0b4 sdggml_metal_graph_compute + 400 frame #5: 0x0000000104c7a7fc sdggml_backend_graph_compute + 32
    frame Enabling cuda GPU acceleration #6: 0x0000000104b11c38 sdGGMLRunner::compute(std::__1::function<ggml_cgraph* ()>, int, bool, ggml_tensor**, ggml_context*) + 584 frame #7: 0x0000000104b37f04 sdLLMEmbedder::get_learned_condition(ggml_context*, int, ConditionerParams const&) + 2356
    frame Error while loading weight #8: 0x0000000104add914 sdgenerate_image_internal(sd_ctx_t*, ggml_context*, ggml_tensor*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, int, sd_guidance_params_t, float, int, int, int, sample_method_t, std::__1::vector<float, std::__1::allocator<float>> const&, long long, int, sd_image_t, float, sd_pm_params_t, std::__1::vector<sd_image_t*, std::__1::allocator<sd_image_t*>>, std::__1::vector<ggml_tensor*, std::__1::allocator<ggml_tensor*>>, bool, ggml_tensor*, ggml_tensor*, sd_easycache_params_t const*) + 3232 frame #9: 0x0000000104ae50f8 sdgenerate_image + 5720
    frame [Feature Request]: SD XL support #10: 0x0000000104a6a45c sdmain + 4356 frame #11: 0x00000001977c5d54 dyldstart + 7184
    (lldb) quit
    zsh: abort ./sd --diffusion-model z_image_turbo-Q2_K.gguf --vae z-image-vae.safetensors`

[calvin2021y]

precompiled

What’s the point of releasing an Apple binary without Metal support?