نسخة أولية وصول مفتوح
Gated Slot Attention-2: Two-Sided Associative Memory Correction in Linear Attention
Linear attention models have emerged as efficient alternatives to standard attention, but effectively managing their fixed-size recurrent memory remains challenging. To improve memory, recent work has explored two distinct directions: delta-rule variants for precise correction of values associated with keys, and slot-b …