Authors

Zhiyun Shi

Publications 2

Preprint Open access

Rehearse Everything, Remember Nothing: Attic-KV Rehearses What Will Be Read

Zhiyun Shi · 2026

Many key-value (KV) caches are compressed before anyone knows what will be asked of them: a document cached for retrieval, a prompt prefix shared across requests, the memory of a long conversation. The prevailing approach scores KV entries by rehearsal: the model rereads the context and keeps the entries it attends to, …

Preprint Open access

Madeleine: Learning Involuntary Recall for Conversational Memory from Simulated Lives

Zhiyun Shi · 2026

A long-term conversational assistant must recall the right memory at the right moment, yet the memory that matters most is often not similar to what the user says now. Current systems recover such associations by letting an LLM reason at write or read time, at a cost of hundreds to over a thousand LLM calls per memory …