Preprint Open access
A Tilted Bowl Is Not a Slippery Slope: Compressing Looped Models
Looped models reason by applying the same block of weights many times, so compressing that block saves memory traffic on every loop. Compressed looped models, however, often collapse, and the collapse is usually blamed on rounding error that accumulates from loop to loop. In this work we test that account on more than …