Authors

Yuxuan Sun

Publications 2

Preprint Open access

QuantMLA: Function-Aligned Dual-Path Quantization for Low-Bit MLA KV Caching

Zunhai Su, Yuxuan Sun, Jianchao Tan et al. · 2026

Multi-Head Latent Attention (MLA) enables expressive multi-head attention with compact caches for its content and decoupled RoPE paths, yet cache memory still scales linearly with context length and batch size. In this work, we establish a systematic model of MLA's dual-path quantization errors, characterizing their di …

Preprint Open access

G$^2$PTQ: Improving LLM Post-Training Quantization with Generalized Gradient Compensation

Ruikang Liu, Haoli Bai, Yuxuan Sun et al. · 2026

Post-training quantization (PTQ) is a practical approach to reducing the memory and computational footprint of large language models (LLMs) without retraining. GPTQ-based methods have become the de facto standard, yet they suffer from two complementary limitations. Methods with local, layer-wise objectives lack global …

Co-authors

Zunhai Su Jianchao Tan Tao Zhang Ruihan Hu Yuchen Xie Xunliang Cai Ngai Wong Ruikang Liu Haoli Bai Qian Zhang Wenzheng Cai Yanqi Hao