الملخص
Transformer-based large language models (LLMs) such as RoBERTa represent text using contextual word embeddings (CWEs), which alter the embeddings associated with each token based on surrounding context. We construct token-wise incremental trajectories by repeatedly recomputing a token's CWE as successive words are added to a sentence, yielding a representation of how contextualized embeddings evolve as the utterance unfolds. We evaluate this approach using garden-path sentences as a test case with characteristic features. Token-wise trajectories reproduce known features of garden-path processing, including disruption around the critical region, and reliably distinguish garden-path sentences from matched disambiguated controls. We introduce several metrics for quantifying representational displacement across contextual increments and show that trajectory information can be highly predictive of sentence type. We find that ambiguity-related information is recoverable not only from the sentence-level CLS representation but also from ordinary vocabulary tokens, suggesting that utterance-level information is distributed across multiple representational scales. In exploratory analyses, we find qualitatively similar trajectory structures in other ambiguity- and misdirection-related linguistic phenomena. Together, these results establish token-wise incremental trajectories as a promising framework for studying utterance-specific meaning construction using LLMs.
الكلمات المفتاحية
الموضوع
بيانات النشر
- المجلة
- غير متاح
- وصول مفتوح
- وصول مفتوح أخضر
اقتبس هذه المقالة
APA 7
Storer, G. W., & Zimmerman, J. W. (2026). Contextual trajectory and incremental contextual displacement: Towards using LLMs to understand dynamic, utterance-specific meaning construction. https://omanscience.com/ar/articles/contextual-trajectory-and-incremental-contextual-displacement-towards-using-llms-to-understand-dynamic-utterance-specific-meaning-construction
MLA 9
Storer, Grayson Wycliffe, and Julia Witte Zimmerman. "Contextual trajectory and incremental contextual displacement: Towards using LLMs to understand dynamic, utterance-specific meaning construction." https://omanscience.com/ar/articles/contextual-trajectory-and-incremental-contextual-displacement-towards-using-llms-to-understand-dynamic-utterance-specific-meaning-construction.
شيكاغو (المؤلف–التاريخ)
Storer, Grayson Wycliffe, and Julia Witte Zimmerman. 2026. "Contextual trajectory and incremental contextual displacement: Towards using LLMs to understand dynamic, utterance-specific meaning construction." https://omanscience.com/ar/articles/contextual-trajectory-and-incremental-contextual-displacement-towards-using-llms-to-understand-dynamic-utterance-specific-meaning-construction.
هارفارد
Storer, G. W. and Zimmerman, J. W. (2026) 'Contextual trajectory and incremental contextual displacement: Towards using LLMs to understand dynamic, utterance-specific meaning construction', Available at: https://omanscience.com/ar/articles/contextual-trajectory-and-incremental-contextual-displacement-towards-using-llms-to-understand-dynamic-utterance-specific-meaning-construction.
فانكوفر
Storer GW, Zimmerman JW. Contextual trajectory and incremental contextual displacement: Towards using LLMs to understand dynamic, utterance-specific meaning construction. https://omanscience.com/ar/articles/contextual-trajectory-and-incremental-contextual-displacement-towards-using-llms-to-understand-dynamic-utterance-specific-meaning-construction
IEEE
G. W. Storer, and J. W. Zimmerman, "Contextual trajectory and incremental contextual displacement: Towards using LLMs to understand dynamic, utterance-specific meaning construction," https://omanscience.com/ar/articles/contextual-trajectory-and-incremental-contextual-displacement-towards-using-llms-to-understand-dynamic-utterance-specific-meaning-construction.