Abstract
Recursive self-improvement (RSI) enables agents to iteratively optimize their workflows via execution feedback. However, standard RSI typically operates as a first-order optimizer: it repeatedly patches surface-level parameters in response to immediate failure symptoms, often leading to trial-and-error thrashing without resolving underlying mechanisms. To address this limitation, we introduce SO-RSI, a framework that elevates workflow optimization to a second-order diagnostic inquiry, investigating why failures occur before committing to structural interventions. SO-RSI passively monitors execution traces for three structural anomalies (recurrence, opposing edits, and expectation mismatch) to trigger targeted mechanism investigations. By executing lightweight diagnostic probes and maintaining persistent inquiry memory across RSI rounds, SO-RSI accumulates causal evidence to guide systematic workflow edits rather than parameter patches. Across Lean 4 proof generation and Verus-based verifiable code generation, SO-RSI improves final held-out pass rates over Naive RSI by 21.8 and 25.8 percentage points under matched 24-hour search budgets. Behavioral analyses further confirm that SO-RSI substantially suppresses failure recurrence and eliminates unproductive zero-progress optimization loops.
Keywords
Subject
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Jiang, Y., Vempaty, A., & Jagmohan, A. (2026). Second-Order Problem Solving for Recursive Self-Improvement in Formal Verification. https://omanscience.com/en/articles/second-order-problem-solving-for-recursive-self-improvement-in-formal-verification
MLA 9
Jiang, Yuxuan, et al. "Second-Order Problem Solving for Recursive Self-Improvement in Formal Verification." https://omanscience.com/en/articles/second-order-problem-solving-for-recursive-self-improvement-in-formal-verification.
Chicago (author–date)
Jiang, Yuxuan, Aditya Vempaty, and Ashish Jagmohan. 2026. "Second-Order Problem Solving for Recursive Self-Improvement in Formal Verification." https://omanscience.com/en/articles/second-order-problem-solving-for-recursive-self-improvement-in-formal-verification.
Harvard
Jiang, Y., Vempaty, A. and Jagmohan, A. (2026) 'Second-Order Problem Solving for Recursive Self-Improvement in Formal Verification', Available at: https://omanscience.com/en/articles/second-order-problem-solving-for-recursive-self-improvement-in-formal-verification.
Vancouver
Jiang Y, Vempaty A, Jagmohan A. Second-Order Problem Solving for Recursive Self-Improvement in Formal Verification. https://omanscience.com/en/articles/second-order-problem-solving-for-recursive-self-improvement-in-formal-verification
IEEE
Y. Jiang, A. Vempaty, and A. Jagmohan, "Second-Order Problem Solving for Recursive Self-Improvement in Formal Verification," https://omanscience.com/en/articles/second-order-problem-solving-for-recursive-self-improvement-in-formal-verification.