الباحثون

Lukas Thede

المنشورات 2

نسخة أولية وصول مفتوح

Replay on Demand: An Emergent Curriculum for Balancing Adaptation and Forgetting in Continued Pretraining

Lukas Thede, Shengzhuang Chen, Stefan Winzeck وآخرون · 2026

Continued pretraining enables language models to adapt to new domains and knowledge, but often at the cost of forgetting previously acquired capabilities. Replay can mitigate this trade-off, but fixed replay mixtures allocate training independently of the model's actual retention needs. We introduce Replay on Demand (R …

نسخة أولية وصول مفتوح

MedKIT: Evaluating Knowledge Integration and Generalization in Large Language Models

Lukas Thede, Yash Kumar Atri, David Chen وآخرون · 2026

Constantly evolving real-world knowledge necessitates models to be updated continuously. Especially in medicine, as clinical evidence changes over time, outdated knowledge can pose safety risks. Existing evaluations of knowledge integration focus on factual recall, offering limited insight into whether newly integrated …

المؤلفون المشاركون