Abstract
We study how Vision Transformers ground abstract concepts (e.g., angry) when training data provide limited direct referential evidence. We hypothesize a metonymic grounding mechanism in which abstract predictions are driven by concrete, interpretable anchor concepts (e.g., fire) that bridge visual signals to abstract semantics. By applying Transcoders on CLIP and DINO vision encoders, we recover intermediate features that can be associated with semantic labels for more concrete concepts, and trace their contributions in circuits underlying abstract concept recognition. Experiments on a carefully curated icon dataset reveal structured metonymic circuits, in which perceptual primitives dominate early layers and object-like anchors precede abstract targets. Images containing rendered text instead recruit a distinct perceptual-to-textual route. Causal interventions further validate that metonymic intermediates are functionally involved in grounding abstract concepts.
Keywords
Subject
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Ding, J., Ma, Z., Mao, J., Chai, J., & Shi, F. (2026). Metonymic Circuits for Abstract Concept Grounding in Vision Transformers. https://omanscience.com/en/articles/metonymic-circuits-for-abstract-concept-grounding-in-vision-transformers
MLA 9
Ding, Jing, et al. "Metonymic Circuits for Abstract Concept Grounding in Vision Transformers." https://omanscience.com/en/articles/metonymic-circuits-for-abstract-concept-grounding-in-vision-transformers.
Chicago (author–date)
Ding, Jing, Ziqiao Ma, Jiayuan Mao, Joyce Chai, and Freda Shi. 2026. "Metonymic Circuits for Abstract Concept Grounding in Vision Transformers." https://omanscience.com/en/articles/metonymic-circuits-for-abstract-concept-grounding-in-vision-transformers.
Harvard
Ding, J., Ma, Z., Mao, J., Chai, J. and Shi, F. (2026) 'Metonymic Circuits for Abstract Concept Grounding in Vision Transformers', Available at: https://omanscience.com/en/articles/metonymic-circuits-for-abstract-concept-grounding-in-vision-transformers.
Vancouver
Ding J, Ma Z, Mao J, Chai J, Shi F. Metonymic Circuits for Abstract Concept Grounding in Vision Transformers. https://omanscience.com/en/articles/metonymic-circuits-for-abstract-concept-grounding-in-vision-transformers
IEEE
J. Ding, Z. Ma, J. Mao, J. Chai, and F. Shi, "Metonymic Circuits for Abstract Concept Grounding in Vision Transformers," https://omanscience.com/en/articles/metonymic-circuits-for-abstract-concept-grounding-in-vision-transformers.