الملخص
Conditional diffusion models generate diverse, novel, and high-quality samples under prescribed conditions. However, theoretical understanding of their memorization and generalization remains limited, while recent works have characterized these behaviors primarily in unconditional settings. In this work, we analyze a random-feature conditional score model in the high-dimensional proportional limit, deriving asymptotic expressions for training and test losses. By decomposing the test loss, we show that in the overparameterized regime, increasing model width improves prediction of the condition-dependent mean while reducing within-condition prediction variance, a phenomenon we term "malign generalization." Furthermore, analyzing the training loss reveals that more informative conditions lead to memorization of training samples at smaller widths. These theoretical findings are supported by experiments with U-Net architectures on realistic data.
الكلمات المفتاحية
بيانات النشر
- المجلة
- غير متاح
- وصول مفتوح
- وصول مفتوح أخضر
اقتبس هذه المقالة
APA 7
Kim, G., & Lee, S. (2026). Memorization and Malign Generalization in Conditional Diffusion Models with Random Features. https://omanscience.com/ar/articles/memorization-and-malign-generalization-in-conditional-diffusion-models-with-random-features
MLA 9
Kim, Gwangho, and Sungyoon Lee. "Memorization and Malign Generalization in Conditional Diffusion Models with Random Features." https://omanscience.com/ar/articles/memorization-and-malign-generalization-in-conditional-diffusion-models-with-random-features.
شيكاغو (المؤلف–التاريخ)
Kim, Gwangho, and Sungyoon Lee. 2026. "Memorization and Malign Generalization in Conditional Diffusion Models with Random Features." https://omanscience.com/ar/articles/memorization-and-malign-generalization-in-conditional-diffusion-models-with-random-features.
هارفارد
Kim, G. and Lee, S. (2026) 'Memorization and Malign Generalization in Conditional Diffusion Models with Random Features', Available at: https://omanscience.com/ar/articles/memorization-and-malign-generalization-in-conditional-diffusion-models-with-random-features.
فانكوفر
Kim G, Lee S. Memorization and Malign Generalization in Conditional Diffusion Models with Random Features. https://omanscience.com/ar/articles/memorization-and-malign-generalization-in-conditional-diffusion-models-with-random-features
IEEE
G. Kim, and S. Lee, "Memorization and Malign Generalization in Conditional Diffusion Models with Random Features," https://omanscience.com/ar/articles/memorization-and-malign-generalization-in-conditional-diffusion-models-with-random-features.