All Topics
All Topics
Technology
Technology
AI
AI
Business
Business
Entertainment
Entertainment
News
News
Programming
Programming
Science
Science
Design
Design
Environment
Environment
Finance
Finance
Crypto
Crypto
Politics
Politics
Sports
Sports
Education
Education
Gaming
Gaming
Art
Art
Music
Music
Health
Health
Security
Security
Books
Books
Food
Food
Travel
Travel
Personal
Personal
Bluesky
Twitter

Falcon 3 Review — TII's STEM-Focused Open-Weight Family (1B–10B + Mamba)

1mo agoen
Read on chatforest.com

From the article

Released December 17, 2024 by the Technology Innovation Institute (Abu Dhabi), Falcon 3 is a five-model open-weight family (1B, 3B, 7B, 10B, plus a Mamba-7B SSM variant) with true Apache 2.0 licensing. The 7B flagship trained on 14 trillion tokens; the 10B was upscaled via layer duplication. MMLU 73.1 and GSM8K 83.0 for the 10B. We review the architecture, Mamba variant, training methodology, benchmarks, and where Falcon 3 lands in the crowded December 2024 open-weight market.
Continue reading on chatforest.com

You might also wanna read

Comments

Sign in to join the conversation.

No comments yet. Be the first.