Pass the Baton: Trajectory-Relayed On-Policy Distillation
By Haolei Xu · Paper · cs.CL
On-policy distillation (OPD) grounds token-level supervision in the student's own trajectory, yet suffers from prefix failure: once the student commits to a wrong reasoning direction, all subsequent generation builds on this deviation, producing misdirected continuations that eli