Abstract
As artificial intelligence is increasingly deployed, algorithmic unfairness has raised growing concerns and intensified demands for transparent fairness auditing. In practice, the tolerable degree of algorithmic unfairness depends on the specific legal, ethical, or application context. Given a prespecified tolerance threshold, an important statistical question is how to determine whether a group disparity exceeds the allowable tolerance across different auditing objectives. To address this problem, we develop a unified tolerance-based fairness auditing framework for two complementary auditing objectives: violation certification, which prioritizes control of false violation declarations, and sensitivity screening, which prioritizes reducing missed violations. For the first objective, we develop a constrained empirical likelihood test for formal settings that uses least-favorable-point calibration and can be combined with false flagging rate control for simultaneous subgroup auditing. For the second objective, we develop split empirical likelihood and adjusted split empirical likelihood tests using an adaptive boundary-proxy principle for early-warning settings. Numerical experiments show the distinct error-control--sensitivity trade-offs of these procedures. A COMPAS analysis illustrates the framework in predictive fairness auditing.
Keywords
Subject
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Tang, J., Xie, C., & Zhu, L. (2026). Tolerance-Based Fairness Auditing: Violation Certification and Sensitivity Screening. https://omanscience.com/en/articles/tolerance-based-fairness-auditing-violation-certification-and-sensitivity-screening
MLA 9
Tang, Jie, et al. "Tolerance-Based Fairness Auditing: Violation Certification and Sensitivity Screening." https://omanscience.com/en/articles/tolerance-based-fairness-auditing-violation-certification-and-sensitivity-screening.
Chicago (author–date)
Tang, Jie, Chuanlong Xie, and Lixing Zhu. 2026. "Tolerance-Based Fairness Auditing: Violation Certification and Sensitivity Screening." https://omanscience.com/en/articles/tolerance-based-fairness-auditing-violation-certification-and-sensitivity-screening.
Harvard
Tang, J., Xie, C. and Zhu, L. (2026) 'Tolerance-Based Fairness Auditing: Violation Certification and Sensitivity Screening', Available at: https://omanscience.com/en/articles/tolerance-based-fairness-auditing-violation-certification-and-sensitivity-screening.
Vancouver
Tang J, Xie C, Zhu L. Tolerance-Based Fairness Auditing: Violation Certification and Sensitivity Screening. https://omanscience.com/en/articles/tolerance-based-fairness-auditing-violation-certification-and-sensitivity-screening
IEEE
J. Tang, C. Xie, and L. Zhu, "Tolerance-Based Fairness Auditing: Violation Certification and Sensitivity Screening," https://omanscience.com/en/articles/tolerance-based-fairness-auditing-violation-certification-and-sensitivity-screening.