PrismML unveils Bonsai 27B for iPhone as Apple reportedly tests its compression technology

Apple is in early discussions with PrismML, a startup backed by Khosla Ventures that claims to dramatically compress large AI models so they can run directly on an iPhone, according to multiple reports. The technology could slash memory usage by up to 15 times, potentially enabling more powerful on-device AI features while preserving user privacy.

PrismML has also released Bonsai 27B, which it bills as the first 27-billion-parameter model capable of running locally on a phone. Based on Qwen3.6 27B, the model uses 1-bit and ternary weight compression to fit on-device, supporting multimodal tasks like multi-step reasoning, structured tool calls, vision, and agentic computer-use loops, Hacker News reported.

"Apple is evaluating PrismML's technology, which the startup says can shrink powerful AI models enough to run directly on an iPhone while using up to 15x less memory."

cnbc.comApple in talks with startup that shrinks AI models to run on an iPhone

The Cupertino giant's interest aligns with its longstanding privacy-first approach. Running AI models locally rather than in the cloud could improve both security and responsiveness, particularly for features like Siri. Crypto Briefing noted that Apple's exploration could "revolutionize on-device AI, enhancing privacy, reducing costs, and improving user experience."

Crypto BriefingApple evaluates PrismML for AI model compression on iPhones

"PrismML's local 27B iPhone model catalyst signals that the true strategic prize of edge AI is the OS-level inference router."

While the talks are still early, according to macdailynews.com, the release of Bonsai 27B gives Apple a concrete demonstration of what compressed models can achieve. PrismML's CEO told CNBC that Apple is looking at the company's technology, and 9to5Toys highlighted that the model runs on iPhone, iPad, and Mac, suggesting broad potential across Apple's ecosystem.

2 sources

9to5ToysPrismML releases Bonsai 27B, claiming first major AI model of its size fit for iPhonemacdailynews.comPrivacy-focused Apple in talks with startup to run more powerful AI ...