fix(moe): the weights own their resident device state, not a static address map (#237) - #276

fix(moe): the weights own their resident device state, not a static address map (#237)#276

mudler merged 2 commits into

mainmudler/vllm.cpp:mainfrom

row/ENG-MOE-RESIDENT-LIFETIMEmudler/vllm.cpp:row/ENG-MOE-RESIDENT-LIFETIMECopy head branch name to clipboard