feat(minimax-h3): load the bf16 TEXT ENCODER (14 shards, 63 GB) and measure what Q4_K_M costs the conditioning - #100

feat(minimax-h3): load the bf16 TEXT ENCODER (14 shards, 63 GB) and measure what Q4_K_M costs the conditioning#100

localai-bot merged 2 commits into

mainmudler/vllm.cpp:mainfrom

row/H3-ENC-BF16-COND-DIFFmudler/vllm.cpp:row/H3-ENC-BF16-COND-DIFFCopy head branch name to clipboard