الباحثون

Shi Feng

المنشورات 4

نسخة أولية وصول مفتوح

Pre-training interventions, ex post facto: Grafting model beliefs across checkpoints

Peter Nutter, Dani Roytburg, Clément Dumas وآخرون · 2026

Pre-training interventions are critical to alignment research, since beliefs formed during pre-training shape how a model generalizes from later training. One recently popular technique for such interventions is synthetic document fine-tuning (SDF), which aims to alter what the model believes. Ideally, synthetic docume …

نسخة أولية وصول مفتوح

Orthogonal Yet Coupled: Decoupling Geometric Components for Model Merging

Zijing Wang, Yongkang Liu, Mingyang Wang وآخرون · 2026

Merging pretrained models has emerged as an effective approach for consolidating diverse capabilities into a single unified model. However, prevailing merging methods typically treat each task vector as an indivisible merging unit, overlooking the heterogeneous geometric changes encoded within it. This treatment can in …

نسخة أولية وصول مفتوح

Decide, Don't Generate: Competitive Dimensional ABSA with Jev's Typed Decisions

Yiqun Zhang, Peidong Wang, Zihan Wang وآخرون · 2026

Aspect-based sentiment analysis (ABSA) has largely turned to text generation. We show that competitive dimensional ABSA does not need it. Using Jev, a frozen model that answers typed questions with rubric scores, label probabilities, and yes/no judgments, we decompose all three tasks of SemEval-2026 Task III Track A in …

نسخة أولية وصول مفتوح

DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression

DeepSeek-AI, Anyi Xu, B. Li وآخرون · 2026

The widespread adoption of long-horizon agents has made model workloads increasingly input-heavy. Although prior work has substantially reduced the cost of long-context computation, prefill remains computationally expensive, and large KV caches continue to strain HBM and SSD capacity and data-transfer bandwidth. Togeth …

المؤلفون المشاركون