Skip to content

Pull requests: llm-d/llm-d-inference-scheduler

New pull request New
26 Open 463 Closed
26 Open 463 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[build] Optimize docker build (local and CICD)
#740 opened Mar 19, 2026 by elevran Loading…
2
Remove UDS tokenizer image build from inference scheduler repo do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress.
#739 opened Mar 19, 2026 by elevran Loading…
1
1
deps(go): bump github.com/llm-d/llm-d-kv-cache from 0.6.1-0.20260317211430-786d9c8cd8f6 to 0.6.1 in the go-dependencies group across 1 directory dependencies Pull requests that update a dependency file release-note-none release notes not required
#738 opened Mar 19, 2026 by dependabot bot Loading…
test: add disruption e2e tests for scheduler failure scenarios
#735 opened Mar 18, 2026 by hexfusion Loading…
1
1
[DO_NOT_MERGE] Tracker PR for testing GIE v1.4.0-rc.3
#734 opened Mar 18, 2026 by Gregory-Pereira • Draft
Unified Disaggregate Handler
#732 opened Mar 17, 2026 by roytman Loading…
17
fix: support podman-docker in e2e tests and Makefile
#730 opened Mar 17, 2026 by hexfusion Loading…
1
1
Basic implementation of dynamic LoRA adapters placement, based on shuffle sharding algorithm do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress.
#720 opened Mar 15, 2026 by dmitripikus • Draft
8
fix(test): Increase test coverage for prefix_based_pd_decider.go
#715 opened Mar 12, 2026 by gyliu513 Loading…
4
Add program aware plugin
#707 opened Mar 11, 2026 by praveingk • Draft
6
Optimize TTFT: send first token immediately after prefill for streaming
#701 opened Mar 10, 2026 by RishabhSaini Loading…
10
refactor: improve config validation in precise-prefix-cache-scorer
#690 opened Mar 9, 2026 by lisperz Loading…
Adds configuration file for sidecar proxy
#683 opened Mar 6, 2026 by DhritiShikhar Loading…
11
Add PrepareRequestData hook support with new PodScoreResult API
#681 opened Mar 5, 2026 by RishabhSaini Loading…
1
Add idle pod config to active-request-scorer
#669 opened Mar 2, 2026 by dagrayvid Loading…
11
Create PrecisePrefixBasedPDDecider plugin
#667 opened Mar 1, 2026 by RishabhSaini Loading…
feat: speculative indexing for PrecisePrefixCacheScorer
#659 opened Feb 27, 2026 by bongwoobak Loading…
19
Align repository with llm-d repo template do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. lifecycle/stale
#649 opened Feb 24, 2026 by InfraWhisperer Loading…
1
2
Initial E/PD extension for kind deployment
#648 opened Feb 24, 2026 by revit13 Loading…
1
🌱 Standardize governance workflows, pre-commit, and remove legacy CI lifecycle/stale
#633 opened Feb 18, 2026 by clubanderson Loading…
3 tasks
66
Enable chunked decode in the routing proxy
#603 opened Feb 9, 2026 by andreyod • Draft
2
add cookie-based affinity support lgtm "Looks good to me", indicates that a PR is ready to be merged.
#600 opened Feb 5, 2026 by roytman Loading…
1
50
Add support for responses and conversations API
#599 opened Feb 4, 2026 by asharkhan3101 Loading…
1
2
refactor(sidecar): encapsulate code better in order to share protocol implementation between different connectors
#566 opened Jan 15, 2026 by kyanokashi Loading… v0.7
50
implement context-length-aware plugin (scorer/filter)
#550 opened Jan 10, 2026 by vMaroon Loading… v0.7
48
ProTip! Exclude everything labeled bug with -label:bug.