نسخة أولية وصول مفتوح
The Geometry of Contextual Relations: Language Models Address Facts by Order of Mention
Human reasoning depends on how objects are related within propositions. \textit{How do relations organize the language representations of contextual contents?} We give an LLM a list of facts in its context (e.g., \emph{Alice eats an apple. Bob eats a pear.}) and measure how its hidden state changes when the question sw …