الملخص
Structured tool calls often fail after only a small number of fields violate a schema or an execution contract. Regenerating the complete object enlarges the action surface and makes repeated repair difficult to audit. We introduce ContractRL, a contract-constrained sequential repair protocol that models verifier-guided JSON repair as a bounded decision process. At each step the policy observes the candidate, typed verifier feedback, JSON Pointer, immutable repair history, and remaining budget; a contract-derived action mask filters malformed or prohibited RFC-6902 operations before a deterministic validator performs the transition. We specify a contract-constrained group-relative objective for patch, retry, and abstention decisions while keeping canonical targets and semantic labels outside the online state until trace freeze. Under identical verifier information, ContractRL attains 0.9362 semantic success with 34.4 generated tokens, compared with 0.9076 and 44.9 tokens for Patch-SFT and 0.9148 and 137.2 tokens for full regeneration over 192 cases per seed and five seeds. Policy optimization improves semantic success from 0.9186 for supervised ContractRL to 0.9375. A separate three-seed paired evaluation against Patch-SFT yields a semantic difference of +0.0396 (95% CI $[+0.0137,+0.0662], p=0.0039$). Feedback, action-mask, budget, and schema-shift analyses connect these gains to localized correction, while adversarial and multi-turn evaluations characterize the remaining failure modes.
الكلمات المفتاحية
الموضوع
بيانات النشر
- المجلة
- غير متاح
- وصول مفتوح
- وصول مفتوح أخضر
اقتبس هذه المقالة
APA 7
Hu, M., Hu, S., Guo, X., Wang, X., Wang, B., Sa, Y., Zha, D., & Xiao, J. (2026). ContractRL: Shielded Group-Relative Policy Optimization for Auditable Tool-Call Repair. https://omanscience.com/ar/articles/contractrl-shielded-group-relative-policy-optimization-for-auditable-tool-call-repair
MLA 9
Hu, Miaobo, et al. "ContractRL: Shielded Group-Relative Policy Optimization for Auditable Tool-Call Repair." https://omanscience.com/ar/articles/contractrl-shielded-group-relative-policy-optimization-for-auditable-tool-call-repair.
شيكاغو (المؤلف–التاريخ)
Hu, Miaobo, Shuhao Hu, Xiaobo Guo, Xin Wang, Bokun Wang, Yina Sa, Daren Zha, and Jun Xiao. 2026. "ContractRL: Shielded Group-Relative Policy Optimization for Auditable Tool-Call Repair." https://omanscience.com/ar/articles/contractrl-shielded-group-relative-policy-optimization-for-auditable-tool-call-repair.
هارفارد
Hu, M., Hu, S., Guo, X., Wang, X., Wang, B., Sa, Y., Zha, D. and Xiao, J. (2026) 'ContractRL: Shielded Group-Relative Policy Optimization for Auditable Tool-Call Repair', Available at: https://omanscience.com/ar/articles/contractrl-shielded-group-relative-policy-optimization-for-auditable-tool-call-repair.
فانكوفر
Hu M, Hu S, Guo X, Wang X, Wang B, Sa Y, et al. ContractRL: Shielded Group-Relative Policy Optimization for Auditable Tool-Call Repair. https://omanscience.com/ar/articles/contractrl-shielded-group-relative-policy-optimization-for-auditable-tool-call-repair
IEEE
M. Hu, S. Hu, X. Guo, X. Wang, B. Wang, Y. Sa, D. Zha, and J. Xiao, "ContractRL: Shielded Group-Relative Policy Optimization for Auditable Tool-Call Repair," https://omanscience.com/ar/articles/contractrl-shielded-group-relative-policy-optimization-for-auditable-tool-call-repair.