Abstract
While Abstract Meaning Representation (AMR) has historically improved performance on a range of NLP tasks, the benefit---or lack thereof---of AMR augmentation for modern LLMs is thus far unclear. In this paper, we attempt to reproduce recent work that reported substantial downstream gains from AMR augmentation, finding that these are likely due to specific choices in the experimental settings used: using a consistent and unified protocol for hyperparameter selection, we observe that text-only baselines consistently match or exceed the performance of AMR-augmented models. To investigate this null result, we introduce a perplexity-based probe measuring the degree to which AMR provides an LLM with supplemental relational knowledge not already available to the model. We find that AMR augmentation does not help LLMs improve their understanding of relational content in the sentence, indicating that augmenting these models with AMR offers no clear benefit on downstream tasks.
Keywords
Subject
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Nguyen, H. Q. N., Staiano, J., & Sullivan, M. (2026). On the (In)effectiveness of AMR Augmentation for Large Language Models. https://omanscience.com/en/articles/on-the-in-effectiveness-of-amr-augmentation-for-large-language-models
MLA 9
Nguyen, Hoa Quynh Nhung, et al. "On the (In)effectiveness of AMR Augmentation for Large Language Models." https://omanscience.com/en/articles/on-the-in-effectiveness-of-amr-augmentation-for-large-language-models.
Chicago (author–date)
Nguyen, Hoa Quynh Nhung, Jacopo Staiano, and Michael Sullivan. 2026. "On the (In)effectiveness of AMR Augmentation for Large Language Models." https://omanscience.com/en/articles/on-the-in-effectiveness-of-amr-augmentation-for-large-language-models.
Harvard
Nguyen, H. Q. N., Staiano, J. and Sullivan, M. (2026) 'On the (In)effectiveness of AMR Augmentation for Large Language Models', Available at: https://omanscience.com/en/articles/on-the-in-effectiveness-of-amr-augmentation-for-large-language-models.
Vancouver
Nguyen HQN, Staiano J, Sullivan M. On the (In)effectiveness of AMR Augmentation for Large Language Models. https://omanscience.com/en/articles/on-the-in-effectiveness-of-amr-augmentation-for-large-language-models
IEEE
H. Q. N. Nguyen, J. Staiano, and M. Sullivan, "On the (In)effectiveness of AMR Augmentation for Large Language Models," https://omanscience.com/en/articles/on-the-in-effectiveness-of-amr-augmentation-for-large-language-models.