What Is 1-Bit Quantization for AI Models? How Cactus Bonsai Runs 27B Parameters on a Phone
Cactus Bonsai compresses a 27B parameter model to 3.9GB using 1-bit quantization and quantization-aware training. Learn how it works and what it enables.
Read the full articleYou might also wanna read
Local LLMs Get Serious: Bonsai 27B Weighs Less Than 4 GB
The PrismML team has introduced the Bonsai 27B model series, which, thanks to 1-bit quantization, has been reduced in size from 54 GB to les
PrismML launches 4GB Bonsai 27B AI model that can run on a phone
PrismML has launched Bonsai 27B, a compressed AI model based on Qwen3.6 27B. The 1-bit version uses about 3.9GB of memory and is built to ru
Bonsai-27B: A 27B-Parameter Binary Transformer Model for Efficient Local AI Inference
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Prism ML Launches Bonsai 27B, a 1-Bit LLM Designed to Run on Smartphones
Prism ML has introduced Bonsai 27B, a 27-billion-parameter large language model built using 1-bit quantization technology. The model is clai
Bonsai 27B Runs on iPhone: The On-Device AI Tradeoffs
PrismML shrinks a 27B model to 3.9GB for iPhone. Benchmarks look solid, but developer reports flag tool-calling regressions worth checking b
Understanding Quantization: A Guide to Model Compression Techniques
A complete guide to what quantization is, how it works, and how it's used to compress large language models
ngrok.com·3mo ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.