Abstract
As agents evolve from single-tool systems into modular, composite architectures, skills are becoming an important mechanism for capability development and distribution. However, the academic community lacks a structured framework for systematically analyzing and evaluating skills. Drawing on information gain and behavioral constraint, we propose the four-dimensional MCRI Framework and operationalize it as MCRI-Eval, a large language model-based evaluation method. We evaluate MCRI-Eval using 63,812 public skills from the OpenClaw skill Hub, with 58,275 skill-conditioned model executions across BigCodeBench, BFCL-Fundamental, and Mind2Web. MCRI-Eval scores are positively associated with community popularity signals and achieve the highest downstream ranking agreement among the evaluated methods. MCRI-Eval also improves top-1 skill selection across all three benchmarks: compared with the strongest baseline on each benchmark, the skills selected by MCRI-Eval advance by 17.7, 22.8, and 19.6 percentile points in downstream performance rank on BigCodeBench, BFCL-Fundamental, and Mind2Web, respectively. These results indicate that MCRI-Eval provides a useful pre-execution signal for prioritizing promising skills before costly execution-based evaluation.
Keywords
Subject
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Yang, Z., Xintong, L., Xu, R., Wang, Z., Lin, Z., Li, H., & Liu, J. (2026). MCRI: A Four-Dimensional Framework for Analyzing and Evaluating Agent Skills. https://omanscience.com/en/articles/mcri-a-four-dimensional-framework-for-analyzing-and-evaluating-agent-skills
MLA 9
Yang, Zongrui, et al. "MCRI: A Four-Dimensional Framework for Analyzing and Evaluating Agent Skills." https://omanscience.com/en/articles/mcri-a-four-dimensional-framework-for-analyzing-and-evaluating-agent-skills.
Chicago (author–date)
Yang, Zongrui, Li Xintong, Runchen Xu, Zhongsheng Wang, Zhedong Lin, Haoyuan Li, and Jiamou Liu. 2026. "MCRI: A Four-Dimensional Framework for Analyzing and Evaluating Agent Skills." https://omanscience.com/en/articles/mcri-a-four-dimensional-framework-for-analyzing-and-evaluating-agent-skills.
Harvard
Yang, Z., Xintong, L., Xu, R., Wang, Z., Lin, Z., Li, H. and Liu, J. (2026) 'MCRI: A Four-Dimensional Framework for Analyzing and Evaluating Agent Skills', Available at: https://omanscience.com/en/articles/mcri-a-four-dimensional-framework-for-analyzing-and-evaluating-agent-skills.
Vancouver
Yang Z, Xintong L, Xu R, Wang Z, Lin Z, Li H, et al. MCRI: A Four-Dimensional Framework for Analyzing and Evaluating Agent Skills. https://omanscience.com/en/articles/mcri-a-four-dimensional-framework-for-analyzing-and-evaluating-agent-skills
IEEE
Z. Yang, L. Xintong, R. Xu, Z. Wang, Z. Lin, H. Li, and J. Liu, "MCRI: A Four-Dimensional Framework for Analyzing and Evaluating Agent Skills," https://omanscience.com/en/articles/mcri-a-four-dimensional-framework-for-analyzing-and-evaluating-agent-skills.