Skip to content

Upstream Sync#80

Merged
robertgshaw2-redhat merged 21 commits intoneuralmagic:disagg_pd_devfrom
robertgshaw2-redhat:merge-with-main
May 6, 2025
Merged

Upstream Sync#80
robertgshaw2-redhat merged 21 commits intoneuralmagic:disagg_pd_devfrom
robertgshaw2-redhat:merge-with-main

Conversation

@robertgshaw2-redhat
Copy link
Copy Markdown
Collaborator

@robertgshaw2-redhat robertgshaw2-redhat commented May 6, 2025 •
edited by github-actions bot
Loading

  • Merge with main
  • Hybrid memory allocator 😨

s3woz and others added 21 commits May 6, 2025 12:00
@s3woz @bohnstingl
@DarkLight1337 @tlrmchlsmth
[Model] Add GraniteMoeHybrid 4.0 model (vllm-project#17497)
999328b 
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Thomas Ortner <boh@zurich.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
@zou3519
[easy] Fix logspam on PiecewiseBackend errors (vllm-project#17138)
edbf2d6 
Signed-off-by: rzou <zou3519@gmail.com>
@Xarbirus
[Bugfix] Fixed prompt length for random dataset (vllm-project#17408)
dc47ba3 
Signed-off-by: Mikhail Podvitskii <podvitskiymichael@gmail.com>
@DarkLight1337
[Doc] Update notes for H2O-VL and Gemma3 (vllm-project#17219)
63ced7b 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
@LucasWilkinson
[Misc] Fix ScalarType float4 naming (vllm-project#17690)
6eae345 
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
@hmellor
Fix dockerfilegraph pre-commit hook (vllm-project#17698)
05e1f96 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
@MengqingCao
[Bugfix] Fix triton import with local TritonPlaceholder (vllm-project…
f9bc5a0 
…#17446)

Signed-off-by: Mengqing Cao <cmq0113@163.com>
@mgoin
[V1] Enable TPU V1 backend by default (vllm-project#17673)
d419aa5 
Signed-off-by: mgoin <mgoin64@gmail.com>
@bigPYJ1151
[V1][PP] Support PP for MultiprocExecutor (vllm-project#14219)
a6fed02 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: jiang.li <jiang1.li@intel.com>
@heheda12345
[v1] AttentionMetadata for each layer (vllm-project#17394)
cba31c4 
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
@aarnphm
[Feat] Add deprecated=True to CLI args (vllm-project#17426)
175bda6 
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
@windsonsea
[Docs] Use gh-file to add links to tool_calling.md (vllm-project#17709)
0d11546 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
@heheda12345
[v1] Introduce KVCacheBlocks as interface between Scheduler and KVCac…
aabcd2c 
…heManager (vllm-project#17479)

Signed-off-by: Chen Zhang <zhangch99@outlook.com>
@reidliu41
[doc] Add RAG Integration example (vllm-project#17692)
7525d5f 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
@DarkLight1337
[Bugfix] Fix modality limits in vision language example (vllm-project…
5b8c390 
…#17721)

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
@hmellor
Make right sidebar more readable in "Supported Models" (vllm-project#…
6115b11 
…17723)

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
@bythew3i
[TPU] Increase block size and reset block shapes (vllm-project#16458)
621ca2c
@dtransposed
[Misc] Add Next Edit Prediction (NEP) datasets support in `benchmark_…
d456aea 
…serving.py` (vllm-project#16839)

Signed-off-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Signed-off-by: dtransposed <>
Co-authored-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
@gshtras
[Bugfix] Fix for the condition to accept empty encoder inputs for mll…
de906b9 
…ama (vllm-project#17732)

Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
@tdoublep @LucasWilkinson
[Kernel] Unified Triton kernel that doesn't distinguish between prefi…
2f925e5 
…ll + decode (vllm-project#16828)

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
@robertgshaw2-redhat
updated
42b869e 
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
@github-actions
Copy link
Copy Markdown

github-actions bot commented May 6, 2025

👋 Hi! Thank you for contributing to the vLLM project.

💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels.

Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run fastcheck CI which starts running only a small and essential subset of CI tests to quickly catch errors. You can run other CI tests on top of those by going to your fastcheck build on Buildkite UI (linked in the PR checks section) and unblock them. If you do not have permission to unblock, ping simon-mo or khluu to add you in our Buildkite org.

Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging.

To run CI, PR reviewers can either: Add ready label to the PR or enable auto-merge.

🚀

@robertgshaw2-redhat robertgshaw2-redhat marked this pull request as ready for review May 6, 2025 22:59
@robertgshaw2-redhat robertgshaw2-redhat merged commit 76186b9 into neuralmagic:disagg_pd_dev May 6, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@tlrmchlsmth tlrmchlsmth tlrmchlsmth approved these changes

@youkaichao youkaichao Awaiting requested review from youkaichao youkaichao is a code owner

@njhill njhill Awaiting requested review from njhill

@alexm-redhat alexm-redhat Awaiting requested review from alexm-redhat alexm-redhat is a code owner

@mgoin mgoin Awaiting requested review from mgoin mgoin is a code owner

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.