الباحثون

Jiaxi Hu

المنشورات 2

نسخة أولية وصول مفتوح

PHBA: Prefix-State Hybrid Block Attention

Ruijie Li, Jiaxi Hu, Shiyu Wang وآخرون · 2026

Hybrid architectures combining linear sequence models with softmax attention provide an effective balance between efficient long-context modeling and precise token retrieval. Existing designs such as Native Hybrid Attention (NHA) combine compressed long-term states with sliding-window attention, but their exact attenti …

نسخة أولية وصول مفتوح

Gated Slot Attention-2: Two-Sided Associative Memory Correction in Linear Attention

Ruijie Li, Shengnan Ding, Weimin Zhang وآخرون · 2026

Linear attention models have emerged as efficient alternatives to standard attention, but effectively managing their fixed-size recurrent memory remains challenging. To improve memory, recent work has explored two distinct directions: delta-rule variants for precise correction of values associated with keys, and slot-b …

المؤلفون المشاركون