DeepSeek-V4 Series Preview: Million-Token Context MoE Models with 1.6T Parameters
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Read the full articleYou might also wanna read
DeepSeek Unveils Highly Anticipated V4 Model With 1M Context Window, Challenging AI Industry Leaders
DeepSeek V4 introduces dual models with 1M context, MoE efficiency, and competitive pricing for scalable AI deployment.
Serving DeepSeek-V4: why million-token context is an inference systems problem
DeepSeek-V4 makes million-token context a serving-systems problem. Together AI explores the inference work behind V4 on NVIDIA HGX B200, inc
We Ran DeepSeek V4 Flash at 1M Context on Two NVIDIA DGX Sparks. Here is What Happened.
Real-world benchmarks running DeepSeek V4 Flash (284B MoE) across two NVIDIA DGX Sparks with tensor parallelism over 200Gbps RoCE. 41 tok/s
DeepSeek-V4 Pro now available on Together AI
DeepSeek-V4 Pro is now available on Together AI with 512K context, controllable reasoning modes, and cached-input pricing for long-context r
LongCat-Flash: Meituan's 560B-Parameter MoE Language Model with Dynamic Computation and Open-Source Release
We introduce LongCat-Flash, a 560-billion-parameter Mixture-of-Experts (MoE) language model designed for both computational efficiency and a
arxiv.org·18d ago
DeepSeek-V4: Hybrid Sparse-Attention Architecture Enables Efficient Million-Token Context Inference
Paper Review DeepSeek-V4 Review: Why Million-Token Context Needs Efficient Attention, Not Just Larger Windows DeepSeek V4 pairs a hybrid spa
artgor.medium.com·1mo ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.