Preprint Open access
QuantMLA: Function-Aligned Dual-Path Quantization for Low-Bit MLA KV Caching
Multi-Head Latent Attention (MLA) enables expressive multi-head attention with compact caches for its content and decoupled RoPE paths, yet cache memory still scales linearly with context length and batch size. In this work, we establish a systematic model of MLA's dual-path quantization errors, characterizing their di …