Preprint Open access
MemoReason: Evaluating the Effect of Parametric Memory on Contextual Reasoning in LLMs
Large Language Models (LLMs) perform well on reasoning benchmarks, but it remains unclear whether this reflects genuine contextual reasoning or reliance on facts memorized in their parameters. We investigate this by distinguishing two possibilities: a broad \textit{memorization bias}, where familiar content improves re …