Preprint Open access
VALSE: Vertical Adaptive Layer Skipping for Efficient Inference in Large Language Models
This paper establishes a theoretical framework for vertical adaptive layer skipping, proving three foundational results: (i) an Expected FLOPs formula (theorem 2) giving a closed-form expression for the computational cost of arbitrary per-sample skip schedules as a function of layer-wise skip probabilities; (ii) functi …