الملخص
System One models output constrained decisions and probability distributions rather than free-form text generation. While prevailing paradigms rely on structured schema objects to encode state, intent, and candidate choices, we revisit a fully natural language-based System One interface. In this framework, both the user request and each candidate option are expressed in natural language, supported by multimodal (image and video) auxiliary inputs. We introduce MetaEncoder, which fine-tunes a pre-trained Muse-Glimmer 30B decoder into an instruction-following decision-making encoder. To scale effectively across both small closed-set (< 256) and massive open-set (millions) candidate spaces, MetaEncoder employs a bi-encoder architecture trained via unidirectional contrastive learning for request-candidate alignment. We conduct extensive evaluations across 11 benchmark suites and 190 tasks spanning multimodal decision-making, understanding (closed-set) and retrieval (open-set), highlighting where MetaEncoder beats SOTA multimodal encoders, as well as its current limits on reasoning-intensive tasks.
الكلمات المفتاحية
بيانات النشر
- المجلة
- غير متاح
- وصول مفتوح
- وصول مفتوح أخضر
اقتبس هذه المقالة
APA 7
Cheng, J., Sun, G., Singh, A., Zhang, B., Dai, H., Mansour, H., Zhang, J., Mishra, S. K., Sun, W., Cui, X., Liu, Y., Guo, Q., Fan, M. X., & Xiao, J. (2026). MetaEncoder: Exploring the Limit of Bi-Encoders for Multimodal System One Decision Making with Natural Language Interface. https://omanscience.com/ar/articles/metaencoder-exploring-the-limit-of-bi-encoders-for-multimodal-system-one-decision-making-with-natural-language-interface
MLA 9
Cheng, Jianpeng, et al. "MetaEncoder: Exploring the Limit of Bi-Encoders for Multimodal System One Decision Making with Natural Language Interface." https://omanscience.com/ar/articles/metaencoder-exploring-the-limit-of-bi-encoders-for-multimodal-system-one-decision-making-with-natural-language-interface.
شيكاغو (المؤلف–التاريخ)
Cheng, Jianpeng, Guangyu Sun, Aashu Singh, Benyu Zhang, Haixing Dai, Hossein Mansour, Jiangfan Zhang, Shlok Kumar Mishra, Wei Sun, Xuanming Cui, Yanli Liu, Qi Guo, Max Xiangjun Fan, and Jun Xiao. 2026. "MetaEncoder: Exploring the Limit of Bi-Encoders for Multimodal System One Decision Making with Natural Language Interface." https://omanscience.com/ar/articles/metaencoder-exploring-the-limit-of-bi-encoders-for-multimodal-system-one-decision-making-with-natural-language-interface.
هارفارد
Cheng, J., Sun, G., Singh, A., Zhang, B., Dai, H., Mansour, H., Zhang, J., Mishra, S. K., Sun, W., Cui, X., Liu, Y., Guo, Q., Fan, M. X. and Xiao, J. (2026) 'MetaEncoder: Exploring the Limit of Bi-Encoders for Multimodal System One Decision Making with Natural Language Interface', Available at: https://omanscience.com/ar/articles/metaencoder-exploring-the-limit-of-bi-encoders-for-multimodal-system-one-decision-making-with-natural-language-interface.
فانكوفر
Cheng J, Sun G, Singh A, Zhang B, Dai H, Mansour H, et al. MetaEncoder: Exploring the Limit of Bi-Encoders for Multimodal System One Decision Making with Natural Language Interface. https://omanscience.com/ar/articles/metaencoder-exploring-the-limit-of-bi-encoders-for-multimodal-system-one-decision-making-with-natural-language-interface
IEEE
J. Cheng, G. Sun, A. Singh, B. Zhang, H. Dai, H. Mansour, J. Zhang, S. K. Mishra, W. Sun, X. Cui, Y. Liu, Q. Guo, M. X. Fan, and J. Xiao, "MetaEncoder: Exploring the Limit of Bi-Encoders for Multimodal System One Decision Making with Natural Language Interface," https://omanscience.com/ar/articles/metaencoder-exploring-the-limit-of-bi-encoders-for-multimodal-system-one-decision-making-with-natural-language-interface.