نسخة أولية وصول مفتوح
Smaller Models, Better Rejects: Preference Distillation Scaling
Preference distillation typically treats a teacher response as preferred and the student's own response as rejected. This assumes that self-generated failures are the most informative negatives and that rejects must come from a model at least as large as the student, making generation costly at scale. We find neither a …