Falcon 3 Review — TII's STEM-Focused Open-Weight Family (1B–10B + Mamba)
1mo agoen
From the article
Released December 17, 2024 by the Technology Innovation Institute (Abu Dhabi), Falcon 3 is a five-model open-weight family (1B, 3B, 7B, 10B, plus a Mamba-7B SSM variant) with true Apache 2.0 licensing. The 7B flagship trained on 14 trillion tokens; the 10B was upscaled via layer duplication. MMLU 73.1 and GSM8K 83.0 for the 10B. We review the architecture, Mamba variant, training methodology, benchmarks, and where Falcon 3 lands in the crowded December 2024 open-weight market.
Continue reading on chatforest.comYou might also wanna read
DASH-Ernährung senkt Demenzrisiko: Studien zu UPF, Entzündung und Kognition
IT BOLTWISE·29m ago
Unilever bleibt Anlegern ein defensiver Konsumwert
IT BOLTWISE·30m ago
Medios AG: Spezial-Pharmagroßhandel und individuelle Arzneien im Wachstum
IT BOLTWISE·31m ago
Prime Intellect erreicht Einhorn-Status: Agentic KI, Datenebene und Governance unter Druck
IT BOLTWISE·32m ago
MDA Space bietet Erwerb von CLS und baut Vertikalintegration für Geointelligence aus
IT BOLTWISE·33m ago
Schwabe übernimmt Hydraid: Funktionale Hydration für den D2C- und Drogeriemarkt
IT BOLTWISE·34m ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.