Preprint Open access
Transfer-Stratified On-Policy Distillation for RL-Improved Reasoning Teachers
Reinforcement learning can substantially improve a reasoning teacher, but it is unclear which of those improvements survive when the teacher supervises a smaller on-policy student. We study this question in mathematical reasoning by comparing teacher lineages before and after GRPO, multiple student scales, direct GRPO, …