Preprint Open access
Riccati State Space Models: Non-iterative Parallelization for Nonlinear Sequence Modeling
State space models (SSMs) achieve efficient sequence processing because their affine state updates are closed under composition and can therefore be evaluated with an associative parallel scan. Nonlinear recurrent models can provide richer, state-dependent dynamics, but generally lose this compositional structure: para …