Preprint Open access
Asynchronous Is Nearly Free for Evolution Strategies on Long-Horizon Agentic Tasks
LLM-based long-horizon agentic post-training is often bottlenecked by rollout generation: trajectories span many interaction turns, completion times vary substantially, and synchronous update barriers leave faster workers waiting for stragglers. Asynchronous reinforcement learning which has been adopted in LLM post-tra …