Authors

Hailun Xu

Publications 2

Preprint Open access

ViTok: Improving Dense Semantics in AM-RADIO-Style Multi-Teacher Distillation with PHI-S and Masked Image Modelling

Hailun Xu, Kanchan Sarkar · 2026

We study how to consolidate the current VITOK progress into a single multi-teacher distillation recipe that jointly preserves global recognition and dense semantics. Our starting point is an AM-RADIO-style student distilled from SigLIP2 and DINOv3-L, where SigLIP2 supplies strong global semantics and DINOv3-L supplies …

Preprint Open access

Loop Dropout: Regularizing Shared Updates in Looped Language Models

Zirui Zhu, Hailun Xu, Xuanlei Zhao et al. · 2026

Looped language models separate computational depth from parameter count by repeatedly applying the same transformer block. Adapting these models requires a shared update that remains effective as hidden states evolve throughout the recurrent computation. Our empirical analysis reveals a pronounced late-loop bias in st …

Co-authors