DominoTree: Conditional Tree-Structured Drafting with Domino for Speculative Decoding
arXiv:2607.08642v1 Announce Type: new Abstract: Speculative decoding accelerates LLM inference by drafting several tokens and verifying them in parallel. Block-diffusion drafters such as DFlash…
Read the full articleYou might also wanna read
Weaver: Autoregressive drafting with factorized priors for efficient speculative decoding
Speculative decoding greatly increases the interactivity of autoregressive language models by trading off computation for extra tokens gener
arxiv.org·11h agoWeaver: Autoregressive drafting with factorized priors for efficient speculative decoding
Speculative decoding greatly increases the interactivity of autoregressive language models by trading off computation for extra tokens gener
arxiv.org·11h ago
Speculative Speculative Decoding: Parallelizing LLM Inference for Faster Performance
Autoregressive decoding is bottlenecked by its sequential nature. Speculative decoding has become a standard way to accelerate inference by
arxiv.org·4mo ago
DSpark: A Speculative Decoding Framework Using Semi-Autoregressive Generation and Confidence-Scheduled Verification for LLM Inference Acceleration
Speculative decoding accelerates Large Language Model (LLM) inference by decoupling draft generation from target verification. While recent
arxiv.org·2d ago
DFlash Speculative Decoding Boosts NVIDIA Blackwell Inference Performance Up to 15x
As AI systems move from single-turn interactions to coordinated multiagent workflows, low-latency inference becomes increasingly important.
developer.nvidia.com·9h ago
Three training-time interventions improve diffusion-based speculative decoding by 21-76%
Large language models (LLMs) achieve remarkable performance across a wide range of tasks, but their autoregressive decoding process incurs s
arxiv.org·15d ago
LK Losses: A New Training Objective to Optimize Acceptance Rate in Speculative Decoding for LLMs
Speculative decoding accelerates autoregressive large language model (LLM) inference by using a lightweight draft model to propose candidate
arxiv.org·1mo ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.