Skip to content

feat: add standard PPO training with GAE and value critic (Transformers/FSDP) - #256

Open
xxyyrr598 wants to merge 7 commits into
modelscope:mainfrom
xxyyrr598:add-ppo
Open

feat: add standard PPO training with GAE and value critic (Transformers/FSDP)#256
xxyyrr598 wants to merge 7 commits into
modelscope:mainfrom
xxyyrr598:add-ppo

feat(loss): add loss_agg_mode to PPOLoss, default to token-mean

1ce486d
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 error
Job log options

This job was cancelled