Preprint Open access
From Dissonance to Orchestration: Teacher Intervention in On-Policy Distillation
On-policy distillation (OPD) trains a student on its own reasoning trajectories using feedback from a stronger teacher. Teacher interventions can improve these trajectories, but also change the distribution on which the student learns. Our controlled studies show that rollout quality alone is an incomplete criterion fo …