الباحثون

Lizi Liao

المنشورات 3

نسخة أولية وصول مفتوح

Learning to Accumulate Knowledge with Mutual Information

Yuyang Zhao, Lizi Liao, Leyang Shen وآخرون · 2026

Large language model (LLM) agents can improve their performance by reusing knowledge distilled from past interactions. However, curating new experiences into a knowledge bank that becomes more useful as it grows remains challenging. Effective knowledge accumulation should limit redundant overlap among entries and ensur …

نسخة أولية وصول مفتوح

Learn the Directions, Normalize the Gains: Post-Training Normalization for LoRA

Zailong Tian, Yanzhe Chen, Zhuoheng Han وآخرون · 2026

While Low-Rank Adaptation (LoRA) enables efficient task specialization, its learned updates can compromise capabilities beyond the target task. We identify \textbf{adaptation imbalance}: a few singular directions dominate the trained update, leaving its performance sensitive to how gains are allocated. We argue that \t …

المؤلفون المشاركون