Li, M., & Tsuchiya, T. (2026). Closing the Horizon Gap in Policy Optimization for Adversarial MDPs. https://omanscience.com/en/articles/closing-the-horizon-gap-in-policy-optimization-for-adversarial-mdps