Preprint Open access
Interpolated Policy Distillation: A Controllable Continuum Between Off-Policy and On-Policy Distillation
Off-policy and on-policy distillation have traditionally been formulated as separate paradigms, each favoring a different property of distillation trajectories. Teacher-generated (off-policy) traces are typically high-quality but lie far from the student's distribution, whereas student-generated (on-policy) rollouts ar …