نسخة أولية وصول مفتوح
SMAT: Simple and Efficient Merge-Aware Training
Model merging integrates the capabilities of multiple experts without joint retraining, but standard expert training optimizes task loss alone and does not guarantee good performance after merging. Merge-aware training (MAT) aims to improve merged performance, but existing methods do not fully account for common mergin …