First reported by kenhuangus.substack.com
DSpark: How DeepSeek Made Its Own Serving Stack 60-85% Faster Without Touching Model Quality
Running a 284B AI Model on Your Desk: Our Real-World DSpark Deployment Log
5d agoen
Source
FlowtivityRunning a 284B AI Model on Your Desk: Our Real-World DSpark Deployment Logflowtivity.aiWe deployed DeepSeek V4 Flash with DSpark speculative decoding on 2x NVIDIA DGX Spark boxes. 49 tok/s, 1M token context, 6-way concurrency, zero API bill. Real numbers, real bugs, real fixes.
You might also wanna read

DSpark: How DeepSeek Made Its Own Serving Stack 60-85% Faster Without Touching Model Quality
kenhuangus.substack.com·4d ago
DeepSeek-V4-Flash-DSpark — 308.2 tok/s on RTX PRO 6000 Blackwell · 96 GB ×4
DeepSeek open sources DSpark framework to accelerate LLM inference by up to 85%
Chinese AI company DeepSeek has open-sourced DSpark, a new MIT-licensed framework designed to accelerate LLM inference by up to 85%. DSpark
DeepSpec/DSpark_paper.pdf at main · deepseek-ai/DeepSpec
DSpark: A Speculative Decoding Framework Using Semi-Autoregressive Generation and Confidence-Scheduled Verification for LLM Inference Acceleration
DSpark is a speculative decoding framework for Large Language Models (LLMs) that improves inference efficiency by combining semi-autoregress
Technical Implementation of DeepSeek LLM Deployment with Expert Parallelism on 96 H100 GPUs
The article details the technical implementation of deploying DeepSeek, an open-source large language model, across 96 H100 GPUs using advan

Comments
Sign in to join the conversation.
No comments yet. Be the first.