Preprint Open access
Learning from Repaired Reasoning: Root-Cause-Guided On-Policy Distillation
On-policy self-distillation (OPSD) uses reference solutions as privileged hindsight to supervise student-generated reasoning trajectories. However, reference-based guidance may explain a correct solution without addressing why the student's own reasoning fails. This reasoning mismatch between the guidance provided and …