Preprint Open access
GFD-OPD: Guidance-Folded On-Policy Distillation of Diffusion Models Across Scales
On-policy distillation (OPD) has demonstrated two important capabilities in language models: compressing large teachers into smaller students and merging expert models into a single model. Existing diffusion OPD, however, mostly focus on the latter, with teachers and students sharing the same backbone and scale. We inv …