Google Gemma 1 — The First Open-Weights Model Built From Gemini Research

Google's Gemma 1 (February 2024) was the first open-weights LLM explicitly derived from Gemini research, shipping in 2B and 7B sizes. The 7B outperformed Mistral 7B on MMLU (64.3% vs 62.5%) and GSM8K (46.4% vs 35.4%) with 6 trillion training tokens, 8K context, and a 256K-token vocabulary inherited from Gemini. Gemma Terms license. Rating: 4/5.