Preprint Open access
Stochastic Heavy Ball with Polyak Step Size and Armijo Line Search: A General Convergence Analysis
Polyak step size (PS) and Armijo line search (ALS) have received increasing attention in stochastic optimization, with encouraging empirical performance and theoretical guarantees. However, their convergence theory for stochastic heavy ball (SHB) methods remains limited. In this work, we develop a unified convergence a …