We Ran DeepSeek V4 Flash at 1M Context on Two NVIDIA DGX Sparks. Here is What Happened.
27d agoen
Source
FlowtivityWe Ran DeepSeek V4 Flash at 1M Context on Two NVIDIA DGX Sparks. Here is What Happened.flowtivity.aiReal-world benchmarks running DeepSeek V4 Flash (284B MoE) across two NVIDIA DGX Sparks with tensor parallelism over 200Gbps RoCE. 41 tok/s at 1 million token context, 3x faster than single-node. Includes how to run your AI agent for free.
You might also wanna read
DeepSeek-V4-Flash-DSpark — 308.2 tok/s on RTX PRO 6000 Blackwell · 96 GB ×4
DeepSeek-V4 Series Preview: Million-Token Context MoE Models with 1.6T Parameters
DeepSeek introduces the V4 series of Mixture-of-Experts (MoE) language models, including DeepSeek-V4-Pro (1.6T parameters, 49B activated) an
huggingface.co·2mo ago
DeepSeek-V4-Flash Local Setup Guide: Running Open Models on Personal Devices
This documentation article from Unsloth provides a technical guide on how to run DeepSeek-V4-Flash locally on personal devices. It covers th
DeepSeek Releases V4 Preview with Open-Source Models Featuring 1M Context Length
DeepSeek has officially released and open-sourced the preview version of DeepSeek-V4, featuring two models: DeepSeek-V4-Pro (1.6T total / 49
Running DeepSeek-OCR on NVIDIA Spark Hardware Using Claude Code Automation
The author describes successfully getting DeepSeek-OCR, a new 6.6GB optical character recognition model released by DeepSeek, running on NVI
simonwillison.net·8mo ago
Technical Implementation of DeepSeek LLM Deployment with Expert Parallelism on 96 H100 GPUs
The article details the technical implementation of deploying DeepSeek, an open-source large language model, across 96 H100 GPUs using advan

Comments
Sign in to join the conversation.
No comments yet. Be the first.