Preprint Open access
Moment-Accurate Gaussian Mixtures for Constant-Step Stochastic Approximation
Local Gaussian models of constant-step learning predict output variability and expected losses, but weak convergence alone does not justify these moment predictions. We establish moment-accurate Gaussian mixtures by matching stationary energy with local Ornstein--Uhlenbeck limits, ruling out quadratic tail mass invisib …