feat(ppo): warm-start the value model from a critic-pretrain checkpoint - #3821

Merged

terrykong merged 6 commits into

mainfrom

yukih/sc-warm-start-critic

Aug 28, 2026

Commits on Aug 28, 2026

feat(ppo): warm-start the value model from a critic-pretrain checkpoint
yuki-97
committed
8822753
test(ppo): cover resume-wins for the value warm start, add the new key to the megatron reference config
yuki-97
committed
a825c17
fix(ppo): reject a warm-start checkpoint that does not resolve, document the value-scheduler constraint
yuki-97
committed
d8ee93c
fix(sc): reject a non-positive max_num_epochs
yuki-97
committed
7107664
fix(ppo): correct value-scheduler doc fields, reject empty warm-start path, add ppo.py setup coverage
yuki-97
committed
95c03dc
test(sc): assert the empty warm-start message on its own parametrization
yuki-97
committed
c39b179