DSpark: How DeepSeek Made Its Own Serving Stack 60-85% Faster Without Touching Model Quality
By
Ken Huang
4d agoen
Source
kenhuangus.substack.comDSpark: How DeepSeek Made Its Own Serving Stack 60-85% Faster Without Touching Model Qualitykenhuangus.substack.comA large language model writes one token at a time.
You might also wanna read
Running a 284B AI Model on Your Desk: Our Real-World DSpark Deployment Log
Flowtivity·4d ago
DeepSeek open sources DSpark framework to accelerate LLM inference by up to 85%
Chinese AI company DeepSeek has open-sourced DSpark, a new MIT-licensed framework designed to accelerate LLM inference by up to 85%. DSpark
Technical Implementation of DeepSeek LLM Deployment with Expert Parallelism on 96 H100 GPUs
The article details the technical implementation of deploying DeepSeek, an open-source large language model, across 96 H100 GPUs using advan
DSpark: A Speculative Decoding Framework Using Semi-Autoregressive Generation and Confidence-Scheduled Verification for LLM Inference Acceleration
DSpark is a speculative decoding framework for Large Language Models (LLMs) that improves inference efficiency by combining semi-autoregress
DeepSpec/DSpark_paper.pdf at main · deepseek-ai/DeepSpec
LMSYS Announces Day-0 Open-Source Support for DeepSeek-V4 with SGLang and Miles Stack
LMSYS Blog announces Day-0 support for DeepSeek-V4, a new AI model, with SGLang and Miles forming the first open-source stack for both infer
lmsys.org·2mo ago

Comments
Sign in to join the conversation.
No comments yet. Be the first.