نسخة أولية وصول مفتوح
$α$Transfer: Coefficient Transfer for Efficient Model Merging
Model merging offers a promising solution for combining multiple fine-tuned checkpoints into a single model through parameter arithmetic. However, finding optimal merging coefficients requires an extensive search that becomes prohibitively expensive as models scale in both size and number, due to high memory requiremen …