Preprint Open access
DeltaS: Reading the Gated Linear Attention State for KV Cache Eviction in Streaming Video
Recent video-language models increasingly adopt hybrid architectures that interleave linear and full attention layers for efficient long-context processing. While the recurrent state of linear attention remains fixed in size, the KV cache of full attention continues to grow with the video stream, making eviction necess …