Preprint Open access
Probability-Signature Dynamics: Unpacking Modular Addition Learning Within Two-Layer Networks
Neural networks trained on modular addition tasks often develop Fourier-structured representations that support exact generalization. While prior work has identified these Fourier circuits, the mechanism by which gradient-based training selects them from the data distribution remains unclear. We address this question u …