Preprint Open access
Looped Actor: Depth-Recurrent Reasoning Models for Reinforcement Learning
Looped reasoning models repeatedly apply a shared set of parameters, enabling more computation without increasing the model size. These models also support input-dependent computation by dynamically deciding when to stop looping. Motivated by the recent success of looped transformers in language modeling and reasoning, …