Preprint Open access
Block-Sparse Attention with Semantic-Geometric Decoupled Routing
Long-context inference has become a defining capability of large language models, but exact dense attention remains costly due to its quadratic scaling with sequence length. Block-sparse attention offers a hardware-friendly alternative by routing each query block to a small set of relevant key blocks, yet accurate trai …