Abstract

In multiclass probabilistic prediction, Utility Calibration (UC), which focuses auditing on specified utilities, has recently received attention as a way to guarantee downstream decisions while controlling computational and sample requirements. At the same time, some multiclass problems have meaningful label hierarchies that play important roles in medicine and image classification, yet how UC evaluates utility within a hierarchy remains insufficiently understood. We show that the difference between realized utility and predicted mean utility admits an exact decomposition into a sum of contributions from the internal nodes of the label tree. This decomposition shows that positive and negative contributions from different nodes can cancel, and that even when UC is small, the utility errors remaining in parts of the hierarchy need not be small. To address this problem, we propose Hierarchical Utility Calibration (HUC), which evaluates each node contribution before summation while retaining the same target utility, subgroup, and predicted-utility interval. We further provide finite-sample evaluation over all predicted-utility intervals and propose HUC-Boost, which updates only violated internal nodes, with theoretical guarantees for both.

Keywords

Subject

Publication details

Journal
Not available
Open access
Green open access

Cite this article

APA 7

Futami, F., Huang, J., & Takeuchi, I. (2026). Hierarchical Utility Calibration for Structured Multiclass Decisions. https://omanscience.com/en/articles/hierarchical-utility-calibration-for-structured-multiclass-decisions

MLA 9

Futami, Futoshi, et al. "Hierarchical Utility Calibration for Structured Multiclass Decisions." https://omanscience.com/en/articles/hierarchical-utility-calibration-for-structured-multiclass-decisions.

Chicago (author–date)

Futami, Futoshi, Jerry Huang, and Ichiro Takeuchi. 2026. "Hierarchical Utility Calibration for Structured Multiclass Decisions." https://omanscience.com/en/articles/hierarchical-utility-calibration-for-structured-multiclass-decisions.

Harvard

Futami, F., Huang, J. and Takeuchi, I. (2026) 'Hierarchical Utility Calibration for Structured Multiclass Decisions', Available at: https://omanscience.com/en/articles/hierarchical-utility-calibration-for-structured-multiclass-decisions.

Vancouver

Futami F, Huang J, Takeuchi I. Hierarchical Utility Calibration for Structured Multiclass Decisions. https://omanscience.com/en/articles/hierarchical-utility-calibration-for-structured-multiclass-decisions

IEEE

F. Futami, J. Huang, and I. Takeuchi, "Hierarchical Utility Calibration for Structured Multiclass Decisions," https://omanscience.com/en/articles/hierarchical-utility-calibration-for-structured-multiclass-decisions.