Abstract
Stance detection requires identifying an author's attitude toward a given target, sometimes based on conversational context. Jev, a specialized decision model designed for structured decision-making, offers an alternative to general-purpose large language models (LLMs). In this work, we evaluate Jev on two stance detection datasets, VAST (English texts) and ZS-CSD (Chinese conversations), comparing it with four general-purpose LLMs and two fine-tuned models. Results show that Jev achieves competitive performance on VAST, matching GPT-5.6 and outperforming the other general-purpose LLMs. However, it falls behind stronger LLMs on ZS-CSD, particularly in distinguishing favor from against. Further analysis suggests that this limitation may be related to understanding reply relationships and stance direction rather than conversation length alone. These findings highlight both the potential and limitations of Jev for stance detection.
Keywords
Subject
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Li, X., Ning, J., Zhang, Y., Yang, L., & Lin, H. (2026). Can Decision Models Understand Stance? Evaluating Jev Against General-Purpose LLMs. https://omanscience.com/en/articles/can-decision-models-understand-stance-evaluating-jev-against-general-purpose-llms
MLA 9
Li, Xing, et al. "Can Decision Models Understand Stance? Evaluating Jev Against General-Purpose LLMs." https://omanscience.com/en/articles/can-decision-models-understand-stance-evaluating-jev-against-general-purpose-llms.
Chicago (author–date)
Li, Xing, Jinzhong Ning, Yijia Zhang, Liang Yang, and Hongfei Lin. 2026. "Can Decision Models Understand Stance? Evaluating Jev Against General-Purpose LLMs." https://omanscience.com/en/articles/can-decision-models-understand-stance-evaluating-jev-against-general-purpose-llms.
Harvard
Li, X., Ning, J., Zhang, Y., Yang, L. and Lin, H. (2026) 'Can Decision Models Understand Stance? Evaluating Jev Against General-Purpose LLMs', Available at: https://omanscience.com/en/articles/can-decision-models-understand-stance-evaluating-jev-against-general-purpose-llms.
Vancouver
Li X, Ning J, Zhang Y, Yang L, Lin H. Can Decision Models Understand Stance? Evaluating Jev Against General-Purpose LLMs. https://omanscience.com/en/articles/can-decision-models-understand-stance-evaluating-jev-against-general-purpose-llms
IEEE
X. Li, J. Ning, Y. Zhang, L. Yang, and H. Lin, "Can Decision Models Understand Stance? Evaluating Jev Against General-Purpose LLMs," https://omanscience.com/en/articles/can-decision-models-understand-stance-evaluating-jev-against-general-purpose-llms.