الملخص
Large language model compliance systems are deployed on the assumption that a verdict depends on the regulatory rule it is given. We test this directly across five models and 20 regulatory and platform-policy domains: delete, swap, or negate the governing rule while holding the case fixed, and check whether the verdict changes (OCS) or the model's internal representation of compliance shifts at all (ICS-delta). Neither moves much: models' verdicts are often invariant to substantial perturbations of the supplied rule, and the guard model, evaluated here under a custom-rule adaptation of its native taxonomy, is the least rule-sensitive and least accurate of the five, barely above chance (51%, versus 90-92% for general-purpose models). This reflects easy cases more than blanket neglect: on cases where deleting the rule changes a previously correct model prediction, models do track it closely. Neither better prompting nor direct intervention on the model's internal representations closes this gap. Accuracy alone does not establish that a compliance verdict is grounded in the supplied rule.
الكلمات المفتاحية
الموضوع
بيانات النشر
- المجلة
- غير متاح
- وصول مفتوح
- وصول مفتوح أخضر
اقتبس هذه المقالة
APA 7
Sadhu, S., Sengupta, A., Sankarapu, V. K., & Seth, P. (2026). Verdict Without the Rule: Diagnosing and Auditing Regulatory Rule Sensitivity in LLM Compliance Systems. https://omanscience.com/ar/articles/verdict-without-the-rule-diagnosing-and-auditing-regulatory-rule-sensitivity-in-llm-compliance-systems
MLA 9
Sadhu, Saisab, et al. "Verdict Without the Rule: Diagnosing and Auditing Regulatory Rule Sensitivity in LLM Compliance Systems." https://omanscience.com/ar/articles/verdict-without-the-rule-diagnosing-and-auditing-regulatory-rule-sensitivity-in-llm-compliance-systems.
شيكاغو (المؤلف–التاريخ)
Sadhu, Saisab, Aadit Sengupta, Vinay kumar Sankarapu, and Pratinav Seth. 2026. "Verdict Without the Rule: Diagnosing and Auditing Regulatory Rule Sensitivity in LLM Compliance Systems." https://omanscience.com/ar/articles/verdict-without-the-rule-diagnosing-and-auditing-regulatory-rule-sensitivity-in-llm-compliance-systems.
هارفارد
Sadhu, S., Sengupta, A., Sankarapu, V. K. and Seth, P. (2026) 'Verdict Without the Rule: Diagnosing and Auditing Regulatory Rule Sensitivity in LLM Compliance Systems', Available at: https://omanscience.com/ar/articles/verdict-without-the-rule-diagnosing-and-auditing-regulatory-rule-sensitivity-in-llm-compliance-systems.
فانكوفر
Sadhu S, Sengupta A, Sankarapu VK, Seth P. Verdict Without the Rule: Diagnosing and Auditing Regulatory Rule Sensitivity in LLM Compliance Systems. https://omanscience.com/ar/articles/verdict-without-the-rule-diagnosing-and-auditing-regulatory-rule-sensitivity-in-llm-compliance-systems
IEEE
S. Sadhu, A. Sengupta, V. K. Sankarapu, and P. Seth, "Verdict Without the Rule: Diagnosing and Auditing Regulatory Rule Sensitivity in LLM Compliance Systems," https://omanscience.com/ar/articles/verdict-without-the-rule-diagnosing-and-auditing-regulatory-rule-sensitivity-in-llm-compliance-systems.