Preprint Open access
P4Q: Co-designing Token Pruning and Quantization for Vision-Language Model Acceleration
Vision language models have achieved strong performance across a wide range of multimodal applications, yet their substantial computational and memory costs hinder efficient deployment. Visual token pruning and post-training quantization reduce inference overhead along two complementary dimensions, namely sequence leng …