DemoPSD: Disagreement-Modulated Policy Self-Distillation
By Yunhe Li · Paper · cs.LG
On-policy self-distillation (OPSD) has emerged as a practical method for training large language models (LLMs) to reason, where a single model acts as both the teacher and the student with different levels of information access. However, recent studies have found that the teacher