Abstract
Structured tool calls often fail after only a small number of fields violate a schema or an execution contract. Regenerating the complete object enlarges the action surface and makes repeated repair difficult to audit. We introduce ContractRL, a contract-constrained sequential repair protocol that models verifier-guided JSON repair as a bounded decision process. At each step the policy observes the candidate, typed verifier feedback, JSON Pointer, immutable repair history, and remaining budget; a contract-derived action mask filters malformed or prohibited RFC-6902 operations before a deterministic validator performs the transition. We specify a contract-constrained group-relative objective for patch, retry, and abstention decisions while keeping canonical targets and semantic labels outside the online state until trace freeze. Under identical verifier information, ContractRL attains 0.9362 semantic success with 34.4 generated tokens, compared with 0.9076 and 44.9 tokens for Patch-SFT and 0.9148 and 137.2 tokens for full regeneration over 192 cases per seed and five seeds. Policy optimization improves semantic success from 0.9186 for supervised ContractRL to 0.9375. A separate three-seed paired evaluation against Patch-SFT yields a semantic difference of +0.0396 (95% CI $[+0.0137,+0.0662], p=0.0039$). Feedback, action-mask, budget, and schema-shift analyses connect these gains to localized correction, while adversarial and multi-turn evaluations characterize the remaining failure modes.
Keywords
Subject
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Hu, M., Hu, S., Guo, X., Wang, X., Wang, B., Sa, Y., Zha, D., & Xiao, J. (2026). ContractRL: Shielded Group-Relative Policy Optimization for Auditable Tool-Call Repair. https://omanscience.com/en/articles/contractrl-shielded-group-relative-policy-optimization-for-auditable-tool-call-repair
MLA 9
Hu, Miaobo, et al. "ContractRL: Shielded Group-Relative Policy Optimization for Auditable Tool-Call Repair." https://omanscience.com/en/articles/contractrl-shielded-group-relative-policy-optimization-for-auditable-tool-call-repair.
Chicago (author–date)
Hu, Miaobo, Shuhao Hu, Xiaobo Guo, Xin Wang, Bokun Wang, Yina Sa, Daren Zha, and Jun Xiao. 2026. "ContractRL: Shielded Group-Relative Policy Optimization for Auditable Tool-Call Repair." https://omanscience.com/en/articles/contractrl-shielded-group-relative-policy-optimization-for-auditable-tool-call-repair.
Harvard
Hu, M., Hu, S., Guo, X., Wang, X., Wang, B., Sa, Y., Zha, D. and Xiao, J. (2026) 'ContractRL: Shielded Group-Relative Policy Optimization for Auditable Tool-Call Repair', Available at: https://omanscience.com/en/articles/contractrl-shielded-group-relative-policy-optimization-for-auditable-tool-call-repair.
Vancouver
Hu M, Hu S, Guo X, Wang X, Wang B, Sa Y, et al. ContractRL: Shielded Group-Relative Policy Optimization for Auditable Tool-Call Repair. https://omanscience.com/en/articles/contractrl-shielded-group-relative-policy-optimization-for-auditable-tool-call-repair
IEEE
M. Hu, S. Hu, X. Guo, X. Wang, B. Wang, Y. Sa, D. Zha, and J. Xiao, "ContractRL: Shielded Group-Relative Policy Optimization for Auditable Tool-Call Repair," https://omanscience.com/en/articles/contractrl-shielded-group-relative-policy-optimization-for-auditable-tool-call-repair.