Authors

Lufei Li

Publications 2

Preprint Open access

Train Ahead, Distill Back: Bootstrapping On-Policy Self-Distillation for Large Language Models

Zheng Zhang, Xinyue Tan, Lufei Li et al. · 2026

On-policy self-distillation (OPSD) improves large language models by letting a self-teacher with privileged information provide dense token-level supervision on the model's own trajectories. Yet existing methods typically construct the self-teacher from the current, initial, or slowly averaged policy state, leaving the …

Preprint Open access

From Judgment Quality to Downstream Utility: Rethinking LLM-as-a-Judge for Open-Ended Tasks

Zheng Zhang, Lufei Li, Xinyue Tan et al. · 2026

LLM-as-a-Judge is increasingly used to evaluate policy responses on open-ended tasks that lack ground-truth answers. Existing work often directly converts the resulting judgments into reward signals for policy training, paying limited attention to intrinsic judgment quality and largely restricting the use of Judges to …

Co-authors