feat(minimax-h3): stream the ORIGINAL bf16 DiT to the device, one tensor at a time - #105

feat(minimax-h3): stream the ORIGINAL bf16 DiT to the device, one tensor at a time#105

localai-bot merged 1 commit into

mainmudler/vllm.cpp:mainfrom

row/H3-BF16-SHARDED-STREAMmudler/vllm.cpp:row/H3-BF16-SHARDED-STREAMCopy head branch name to clipboard