Authors

Nikita Kornilov

Publications 2

Preprint Open access

LionMuon: Alternating Spectral and Sign Descent for Efficient Training

Arman Bolatov, Artem Riabinin, Nikita Kornilov et al. · 2026

Pretraining a language model takes enormous compute, and the right optimizer can save a good part of it. Muon's spectral step gives a stronger direction than a sign step, but it is expensive. Every step runs Newton-Schulz iterations on the full matrix and, in distributed training, an extra all-reduce. Sign steps, as in …

Preprint Open access

Data Unlearning via Inverse Distillation

Aleksei Leonov, Nikita Kornilov, Zhenhe Zhang et al. · 2026

Multi-step matching models, including flow and diffusion models, produce high-quality outputs but incur substantial inference costs and may reproduce unwanted components of their training datasets. We introduce Inverse Distillation Unlearning (IDU), a unified framework that simultaneously distills a teacher multi-step …

Co-authors