[Runtime] Use preferred host memory (pinned memory) in KV cache#17036

tqchen merged 1 commit intoapache:mainapache/tvm:mainfrom

MasterJH5574:tvm-dev/2024-05-28-kv-cache-pinned-memMasterJH5574/tvm:tvm-dev/2024-05-28-kv-cache-pinned-memCopy head branch name to clipboard