Authors

Dmitry Baranchuk

Publications 2

Preprint Open access

Representation-Space MMD for Diffusion Language Models

Ilya Drobyshevskiy, Ilia Sudakov, Maksim Semenov et al. · 2026

We introduce a post-training method for diffusion language models (DLMs) that minimizes Maximum Mean Discrepancy (MMD) between generated and reference distributions in the feature space of a frozen pretrained DLM. To estimate MMD, we retain contextual features at individual token positions, obtaining multiple observati …

Preprint Open access

Alpha Diffusion Language Models: Factorization Alone Is Not the Problem

Nikita Gushchin, Dmitry Baranchuk, Alexander Korotin · 2026

Discrete diffusion language models can generate multiple tokens in parallel, but reducing the number of denoising steps can lead to inconsistent predictions. Standard cross-entropy training fits conditional token marginals, whereas parallel generation requires consistent joint predictions. We introduce Alpha Diffusion …

Co-authors