الباحثون

Can Wang

المنشورات 5

نسخة أولية وصول مفتوح

The Hidden Ratio in Adam: Stable Structure, Compression, and Sign Dynamics

Yihe Zhou, Tongtian Zhu, Yingxiao Huo وآخرون · 2026

Adam is the default optimizer for training modern deep neural networks, yet its adaptive behavior remains poorly understood due to the complex interaction between its first- and second-moment exponential moving averages (EMAs). We study Adam in the tied-$β$ regime, where the two EMA decay rates are equal, and show that …

نسخة أولية وصول مفتوح

Spectral Amplitude Purification in Distribution Matching for Diffusion Distillation

Zhenyu Zhou, Can Wang, Chun Chen وآخرون · 2026

Distribution Matching Distillation (DMD) enables high-quality diffusion sampling in only a few steps, but its optimization dynamics remain dominated by coarse, low-frequency signals, delaying the recovery of fine-grained details. We identify a pronounced concentration of spectral amplitudes at low frequencies in the DM …

المؤلفون المشاركون