يحسّن التقطير الذاتي على السياسة (OPSD) نماذج اللغة الكبيرة بجعل معلم ذاتي يملك معلومات امتيازية يقدم إشرافًا كثيفًا على مستوى الرموز على مسارات النموذج نفسه. لكن الطرق القائمة تبني المعلم الذاتي عادةً من حالة السياسة الحالية أو الأولية أو المتوسطة ببطء، فتبقى جودة الإشراف مقيدة بقدرة المعلم على استغلال المعلومات الامت …
Large language model training commonly relies on multidimensional parallelism, including data, tensor, pipeline, and context parallelism, to support long-context and large-scale workloads. However, real pretraining corpora consist of highly heterogeneous variable-length samples, which create a complex coupling between …
Large language models (LLMs) demonstrate exceptional accuracy in password-guessing tasks, but their massive memory cost, high computational demands, and high duplicate rates severely limit deployment in resource-constrained scenarios. This paper introduces the 1-bit/1.58-bit quantized BitNet architecture to the passwor …
Endoscopy-based lesion segmentation is essential for the early detection of neoplastic lesions. Framed as a dense-prediction task on high-resolution mucosal panoramas, its automated and precise contouring alleviates clinicians’ real-time cognitive burden, while yielding quantitative biomarkers to stratify patient risk …