الملخص
Parallel speculative drafting generates multiple candidates in one backbone pass, but independent token selection can produce inconsistent continuations that shorten the accepted prefix. Existing methods mostly leave conditional decoding to a lightweight module after the backbone, which limits the flow of predecessor information to successors. Our analysis of DFlash shows that early positions already form recoverable predictions in shallow layers, and that accurate adjacent predecessors help successors more when they enter earlier. We therefore propose DSpine, a drafter with causal conditioning injection throughout the backbone: at every layer, gated adjacent injection writes each predecessor's predicted feature into its successor, so the causal conditioning chain unfolds over network depth while all positions update in parallel. A unified transfer space built from the target model's output embeddings unifies layer-wise injection with predecessor-conditioned decoding, and layer-wise output-embedding supervision promotes the formation of predicted features in shallow layers. Fused kernels and a transition cache execute both efficiently in parallel within SGLang. Across seven math, code, and chat benchmarks, DSpine achieves the longest acceptance length at both temperatures on Qwen3-4B and Qwen3-8B. At temperature zero on Qwen3-8B, it raises the seven-benchmark mean from DFlash's 3.77 to 4.82 (+27.8%); in SGLang serving tests, it delivers 23.3% higher throughput than DFlash on average.
الكلمات المفتاحية
الموضوع
بيانات النشر
- المجلة
- غير متاح
- وصول مفتوح
- وصول مفتوح أخضر
اقتبس هذه المقالة
APA 7
Zhang, H., Chen, K., Sun, H., Gu, W., Qiao, R., Sun, X., & Jiang, B. (2026). Draft in Parallel, Condition Through Depth: Adjacent Causal Injection for Speculative Decoding. https://omanscience.com/ar/articles/draft-in-parallel-condition-through-depth-adjacent-causal-injection-for-speculative-decoding
MLA 9
Zhang, Haohui, et al. "Draft in Parallel, Condition Through Depth: Adjacent Causal Injection for Speculative Decoding." https://omanscience.com/ar/articles/draft-in-parallel-condition-through-depth-adjacent-causal-injection-for-speculative-decoding.
شيكاغو (المؤلف–التاريخ)
Zhang, Haohui, Keyu Chen, Haocheng Sun, Weibo Gu, Ruizhi Qiao, Xing Sun, and Bo Jiang. 2026. "Draft in Parallel, Condition Through Depth: Adjacent Causal Injection for Speculative Decoding." https://omanscience.com/ar/articles/draft-in-parallel-condition-through-depth-adjacent-causal-injection-for-speculative-decoding.
هارفارد
Zhang, H., Chen, K., Sun, H., Gu, W., Qiao, R., Sun, X. and Jiang, B. (2026) 'Draft in Parallel, Condition Through Depth: Adjacent Causal Injection for Speculative Decoding', Available at: https://omanscience.com/ar/articles/draft-in-parallel-condition-through-depth-adjacent-causal-injection-for-speculative-decoding.
فانكوفر
Zhang H, Chen K, Sun H, Gu W, Qiao R, Sun X, et al. Draft in Parallel, Condition Through Depth: Adjacent Causal Injection for Speculative Decoding. https://omanscience.com/ar/articles/draft-in-parallel-condition-through-depth-adjacent-causal-injection-for-speculative-decoding
IEEE
H. Zhang, K. Chen, H. Sun, W. Gu, R. Qiao, X. Sun, and B. Jiang, "Draft in Parallel, Condition Through Depth: Adjacent Causal Injection for Speculative Decoding," https://omanscience.com/ar/articles/draft-in-parallel-condition-through-depth-adjacent-causal-injection-for-speculative-decoding.