Preprint Open access
CounterPlay: Counterfactual Post-Training for Self-Play Driving Policies
Self-play in high-throughput simulators yields driving policies with robust closed-loop performance, but improvement per unit of simulation diminishes as training scales. Policies learn to handle common situations early, while further rollouts repeatedly encounter unresolved failures. Post-training offers an opportunit …