Abstract
Numerous agentic workflows are based on a generator-verifier loop: a generator proposes candidates, a cheap verifier scores them, and the workflow terminates when a proposal is verified as good enough. The verifier typically proxies a more costly ground-truth oracle, and as the generator searches adaptively against it, false acceptances may accumulate. Proposals can pass the proxy but fail under the costlier ground-truth check. We study when to stop these loops while controlling the false discovery rate of the accepted proposals. Our construction introduces tools of independent interest in distribution-free statistical testing and conformal risk control, including analysis of $e$-values constructed through index betting and a novel conformal risk control procedure for non-monotone losses. We validate the approach in synthetic settings and on a protein-design benchmark.
Keywords
Subject
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Hegazy, M., Jordan, M. I., & Dieuleveut, A. (2026). Valid Stopping in Adaptive Generator-Verifier Loops. https://omanscience.com/en/articles/valid-stopping-in-adaptive-generator-verifier-loops
MLA 9
Hegazy, Mahmoud, et al. "Valid Stopping in Adaptive Generator-Verifier Loops." https://omanscience.com/en/articles/valid-stopping-in-adaptive-generator-verifier-loops.
Chicago (author–date)
Hegazy, Mahmoud, Michael I. Jordan, and Aymeric Dieuleveut. 2026. "Valid Stopping in Adaptive Generator-Verifier Loops." https://omanscience.com/en/articles/valid-stopping-in-adaptive-generator-verifier-loops.
Harvard
Hegazy, M., Jordan, M. I. and Dieuleveut, A. (2026) 'Valid Stopping in Adaptive Generator-Verifier Loops', Available at: https://omanscience.com/en/articles/valid-stopping-in-adaptive-generator-verifier-loops.
Vancouver
Hegazy M, Jordan MI, Dieuleveut A. Valid Stopping in Adaptive Generator-Verifier Loops. https://omanscience.com/en/articles/valid-stopping-in-adaptive-generator-verifier-loops
IEEE
M. Hegazy, M. I. Jordan, and A. Dieuleveut, "Valid Stopping in Adaptive Generator-Verifier Loops," https://omanscience.com/en/articles/valid-stopping-in-adaptive-generator-verifier-loops.