الملخص
Distributed inference has become an indispensable part of deploying medical models under practical latency, memory, and throughput constraints. Although modern frameworks improve serving efficiency through tensor parallelism, mixed precision, kernel fusion, and multi-device communication, they are generally assumed to preserve the behavior observed during centralized HuggingFace evaluation. This assumption creates an evaluation-deployment mismatch: a model may pass offline evaluation but produce a different output after the execution stack changes. To address this mismatch, we propose a testing framework and an improved, distributed-execution-sensitive medical-model benchmark that evaluates the same checkpoint and input under a centralized HuggingFace reference and matched distributed deployments. Extensive experiments across language, vision, and multimodal medical models show that execution changes can produce measurable output disagreements. Across supported visual settings, the test success rate ranges from 0.21 to 0.43 for single-modality models and from 0.32 to 0.98 for multimodal models. The benchmark is aimed at extending medical-model evaluation from capability and security to evaluation-deployment consistency.
الكلمات المفتاحية
الموضوع
بيانات النشر
- المجلة
- غير متاح
- وصول مفتوح
- وصول مفتوح أخضر
اقتبس هذه المقالة
APA 7
Wang, Y., Zhang, X., Ding, Y., Li, T., Zhang, X., Yang, Y., & Pan, L. (2026). Reliability Testing of Medical Model Performance under Distributed Deployment. https://omanscience.com/ar/articles/reliability-testing-of-medical-model-performance-under-distributed-deployment
MLA 9
Wang, Yifei, et al. "Reliability Testing of Medical Model Performance under Distributed Deployment." https://omanscience.com/ar/articles/reliability-testing-of-medical-model-performance-under-distributed-deployment.
شيكاغو (المؤلف–التاريخ)
Wang, Yifei, Xiaohan Zhang, Youtao Ding, Tianlin Li, Xiaoyu Zhang, Yida Yang, and Li Pan. 2026. "Reliability Testing of Medical Model Performance under Distributed Deployment." https://omanscience.com/ar/articles/reliability-testing-of-medical-model-performance-under-distributed-deployment.
هارفارد
Wang, Y., Zhang, X., Ding, Y., Li, T., Zhang, X., Yang, Y. and Pan, L. (2026) 'Reliability Testing of Medical Model Performance under Distributed Deployment', Available at: https://omanscience.com/ar/articles/reliability-testing-of-medical-model-performance-under-distributed-deployment.
فانكوفر
Wang Y, Zhang X, Ding Y, Li T, Zhang X, Yang Y, et al. Reliability Testing of Medical Model Performance under Distributed Deployment. https://omanscience.com/ar/articles/reliability-testing-of-medical-model-performance-under-distributed-deployment
IEEE
Y. Wang, X. Zhang, Y. Ding, T. Li, X. Zhang, Y. Yang, and L. Pan, "Reliability Testing of Medical Model Performance under Distributed Deployment," https://omanscience.com/ar/articles/reliability-testing-of-medical-model-performance-under-distributed-deployment.