الملخص
Large Language Models (LLMs) suffer from temporal misalignment, often due to the contradictory nature of their training corpora. While current mitigation strategies rely on computationally expensive fine-tuning or context-heavy retrieval augmented generation (RAG), the internal mechanisms governing time-sensitive recall remain under-explored. Unlike prior studies that identify temporal components such as attention heads and MLP layers, we provide the first feature-level map of temporal recall by isolating individual MLP features via transcoder circuit tracing. We identify three node categories (common temporal, common to the year, and chrono-semantic) which interact to generate a temporal filter during factual recall. By analysing Gemma 2 2B, LLaMA 3.2 1B, and Qwen3-4B, we show that these features do not follow a simple linear pipeline but represent time through a parallel and mixed syntactic-semantic interplay across layers. We additionally discover a class of higher-layer temporal components invisible to existing EAP-IG methods, establishing transcoders as a more complete lens for temporal interpretability in time-sensitive factual recall. These findings present MLP components for potential targeted interventions in time-sensitive factual recall
الكلمات المفتاحية
الموضوع
بيانات النشر
- المجلة
- غير متاح
- وصول مفتوح
- وصول مفتوح أخضر
اقتبس هذه المقالة
APA 7
Govindan, S., Song, Y., & Pagnucco, M. (2026). Identifying Temporal Features within Transcoders for Time Sensitive Factual Recall. https://omanscience.com/ar/articles/identifying-temporal-features-within-transcoders-for-time-sensitive-factual-recall
MLA 9
Govindan, Sanjay, et al. "Identifying Temporal Features within Transcoders for Time Sensitive Factual Recall." https://omanscience.com/ar/articles/identifying-temporal-features-within-transcoders-for-time-sensitive-factual-recall.
شيكاغو (المؤلف–التاريخ)
Govindan, Sanjay, Yang Song, and Maurice Pagnucco. 2026. "Identifying Temporal Features within Transcoders for Time Sensitive Factual Recall." https://omanscience.com/ar/articles/identifying-temporal-features-within-transcoders-for-time-sensitive-factual-recall.
هارفارد
Govindan, S., Song, Y. and Pagnucco, M. (2026) 'Identifying Temporal Features within Transcoders for Time Sensitive Factual Recall', Available at: https://omanscience.com/ar/articles/identifying-temporal-features-within-transcoders-for-time-sensitive-factual-recall.
فانكوفر
Govindan S, Song Y, Pagnucco M. Identifying Temporal Features within Transcoders for Time Sensitive Factual Recall. https://omanscience.com/ar/articles/identifying-temporal-features-within-transcoders-for-time-sensitive-factual-recall
IEEE
S. Govindan, Y. Song, and M. Pagnucco, "Identifying Temporal Features within Transcoders for Time Sensitive Factual Recall," https://omanscience.com/ar/articles/identifying-temporal-features-within-transcoders-for-time-sensitive-factual-recall.