MiMo-V2.5-Pro-UltraSpeed: Xiaomi Hits 1,000 Tokens Per Second on a Trillion-Parameter MoE — On Commodity GPUs
25d agoen
From the article
Xiaomi and TileRT released MiMo-V2.5-Pro-UltraSpeed on June 8, 2026 — a 1-trillion-parameter Mixture-of-Experts model that exceeds 1,000 tokens per second on a single 8-GPU commodity node. No custom silicon. The technical approach: FP4 quantization on MoE experts, DFlash speculative decoding, and TileRT's persistent kernel engine. Here is the technical review.
Continue reading on chatforest.comYou might also wanna read

Claude Fable (3 more days), Part 6: Ten Fable 5-Native Agent Skills
kenhuangus.substack.com·22m ago
SpaceX: Raketen plus Starlink und KI als Ertragsmodell
IT BOLTWISE·35m ago
MNTN-CEO zweifelt an Metas Cloud-Plänen wegen AWS- und Google-Dominanz
IT BOLTWISE·36m ago
KI-Handel unter Druck: Technologieaktien fallen nach Gewinnmitnahmen
IT BOLTWISE·37m ago
SK Hynix: US-Angebot siebenfach überzeichnet – Signal für Speicherstärke
IT BOLTWISE·38m ago
KI-Kosten treiben Chip-Dynamik auseinander: Hyperscaler unter Druck
IT BOLTWISE·38m ago

Comments
Sign in to join the conversation.
No comments yet. Be the first.