[modular] improve auto offload - #14304

Open

yiyixuxu wants to merge 18 commits into

mainfrom

auto-offload-v2

Commits on Jul 27, 2026

[modular] auto offload: tunable memory reserve, OOM retry, non-disruptive add/remove

yiyixuxu
and
claude
committed

Commits on Jul 28, 2026

[modular] drop stale "dynamic mode" wording from the offload test comments

yiyixuxu
and
claude
committed
Record what the auto-offloader does

yiyixuxu
and
claude
committed

Commits on Jul 29, 2026

Group the offload record table by decision

yiyi@huggingface.co
and
claude
committed
Split display helpers into components_manager_utils; drop activation measurement; cover encode/decode in the OOM retry

yiyixuxu
and
claude
committed
Trim the offload record to consumed fields; hook reads available memory itself

yiyixuxu
and
claude
committed
Make offload record events pure moves

yiyixuxu
and
claude
committed
Drop OffloadRecord.summary(): the table is the record

yiyixuxu
and
claude
committed
Address review: discover entry points via an apply_forward_hook marker

yiyixuxu
and
claude
committed
Inline the OOM-retry helper into wrap_forward, its only caller

yiyixuxu
and
claude
committed
Shrink ComponentsManager to its used surface

yiyixuxu
and
claude
committed
link issue to TODO
yiyixuxu
committed

Commits on Jul 30, 2026

Commits on Jul 31, 2026