Preprint Open access
From Geometry to Generalization: Why Row Normalization Can Beat Adam and Muon
Different optimizers can fit the same training data while selecting classifiers with substantially different geometries, but whether this difference provably affects population performance remains unclear. We show that row-wise normalization can achieve strictly higher population accuracy than full-batch Adam, a proxy …