Authors

Pavel Tikhonov

Publications 2

Preprint Open access

LANTERN: Illuminating Hidden Mathematical Knowledge in Language Models

Pavel Tikhonov, Elena Tutubalina, Ivan Oseledets et al. · 2026

Language models can now prove theorems, but people still decide which problems to pursue. We ask whether a model's internal representations can help identify promising mathematical connections. We develop LANTERN, a fast, cost-efficient pipeline that uses a classifier over pretrained-model activations to rank candidate …

Preprint Open access

Your Transformer Can Hold Two Thoughts at Once: Evidence of Linear Superposition in LLMs

Pavel Tikhonov, Anton Korznikov, Matvey Mikhalchuk et al. · 2026

While Large Language Models (LLMs) rely on highly non-linear components, in this work we demonstrate that they exhibit fundamental linearity: when inputs from distinct text streams are linearly combined, the model outputs a superposition of the individual next-token distributions. We term this the \textit{Superposition …

Co-authors