نسخة أولية وصول مفتوح
How Should Teachers Be Prepared? RL on Student-Induced States for On-Policy Distillation
On-policy distillation (OPD) improves the reasoning capabilities of small language models through token-level teacher supervision on student-generated trajectories. Yet can teachers that excel at solving problems independently also guide student reasoning effectively? Prior work shows that when student prefixes follow …