AI4AI at Test-Time: Strong-to-Weak Capability Transfer via Harnesses
By Cheng Qian · Paper · cs.LG
Recent work on distillation transfers the capabilities of large models to smaller ones often by updating the latter's parameters, through teacher forcing, on-policy distillation, and related training-time methods. In this paper, we ask whether such transfer can instead occur at t