DSpark: Confidence-Scheduled Speculative Decoding with Semi-Autoregressive Generation
5d agoen
From the article
Authors: Xin Cheng, Xingkai Yu, Chenze Shao, Jiashi Li, Yunfan Xiong, Yi Qian, Jiaqi Zhu, Shirong Ma, Xiaokang Zhang, Jiasheng Ye, Qinyu Chen, Chengqi Deng, Jiping Yu, Damai Dai, Zhengyan Zhang, Yixuan Wei, Yixuan Tan, Wenkai Yang, Runxin Xu, Yu Wu, Zhean Xu, Xuanyu Wang, Muyang Chen, Rui Tian, Xiao Bi, Zhewen Hao, Shaoyuan Chen, Huanqi Cao, Wentao Zhang, Anyi Xu, Huishuai Zhang, Dongyan Zhao, Wenfeng Liang
Continue reading on arxiviq.substack.comYou might also wanna read
DSpark: A Speculative Decoding Framework Using Semi-Autoregressive Generation and Confidence-Scheduled Verification for LLM Inference Acceleration
DSpark is a speculative decoding framework for Large Language Models (LLMs) that improves inference efficiency by combining semi-autoregress
DeepSpec/DSpark_paper.pdf at main · deepseek-ai/DeepSpec
Speculative Speculative Decoding: Parallelizing LLM Inference for Faster Performance
Researchers introduce speculative speculative decoding (SSD), a novel technique to accelerate large language model inference by parallelizin
speculators/examples/train/dspark_qwen3_0_6b_sharegpt_online.sh at main · vllm-project/speculators
mlx-dspark: Native Apple Silicon speculative decoding for DSpark and DFlash via MLX
mlx-dspark is a tool that runs DeepSeek's DSpark and z-lab's DFlash speculative-decoding drafters natively on Apple Silicon via MLX. These a
Three training-time interventions improve diffusion-based speculative decoding by 21-76%
This paper presents an empirical analysis of three training-time interventions to improve speculative decoding with diffusion language model

Comments
Sign in to join the conversation.
No comments yet. Be the first.