Preprint Open access
Look Before You Select: Rethinking Vocabulary Sparsification in On-Policy Distillation
On-policy distillation (OPD) uses teacher correction on student-generated responses. Full-vocabulary correction can provide important corrections even for tokens that the student assigns low probability, but backpropagating through all token logits becomes memory-intensive for long sequences. Existing memory-saving app …