Preprint Open access
SPECTRUM: Proximal Spectral Modulation for Looped Self-Distillation
A model that learns from its own outputs inherits more than their correctness: it inherits which solutions it produces. We formulate Looped Self-Distillation, a self-evolution framework for code generation in which a model repeatedly generates and learns from its own raw outputs, under a fixed information budget, witho …