الباحثون

Yifan Gao

المنشورات 4

نسخة أولية وصول مفتوح

SAGE: Subspace Alignment for Classifier-Free Guidance in Mixture-of-Experts Diffusion Models

Boyu Zhang, Yangming Cheng, Ning Zhang وآخرون · 2026

Diffusion Transformers with Mixture-of-Experts (MoE) routing are a leading recipe for scaling generative models. Classifier-Free Guidance (CFG) is essential for generation quality, yet excessively high guidance scales trigger collapse. We identify a previously unreported failure mode in their combination: the two CFG b …

نسخة أولية وصول مفتوح

Rethinking Token Reweighting for SFT: Suppress, Reverse, and Extrapolate Learned Features

Cunchun Li, Haonan He, Yifan Gao وآخرون · 2026

Supervised fine-tuning (SFT) learns most aggressively from tokens that the model deems least likely. This helps acquire new behaviors, but also amplifies noisy or conflicting supervision and can overwrite useful pretrained knowledge. Through a unified policy-loss view, we revisit existing token-reweighting methods and …

المؤلفون المشاركون