All Topics
All Topics
Technology
Technology
Design
Design
Programming
Programming
Science
Science
News
News
Gaming
Gaming
Entertainment
Entertainment
Business
Business
Finance
Finance
Sports
Sports
Health
Health
Food
Food
Travel
Travel
Art
Art
Music
Music
Books
Books
Education
Education
Politics
Politics
Personal
Personal
No algorithm. No AI slop. No ads. Just RSS. Pro-human. Indie writers. Real journalism. Open web. Chronological. Hand toasted.

Apple Introduces Multilingual Foundation Language Models for Apple Intelligence Features

By

2bit

10mo ago· 2 min readenNews

Summary

Apple introduces two multilingual, multimodal foundation language models for Apple Intelligence features, including an on-device model optimized for Apple silicon and a scalable server model with innovative architecture.

Key quotes

· 3 pulled
a ∼3B-parameter on-device model optimized for Apple silicon through architectural innovations such as KV-cache sharing and 2-bit quantization-aware training
a scalable server model built on a novel Parallel-Track Mixture-of-Experts (PT-MoE) transformer that combines track parallelism, mixture-of-experts sparse computation, and interleaved global–local attention
deliver high quality with competitive cost on Apple’s Private Cloud Compute
Snippet from the RSS feed
We introduce two multilingual, multimodal foundation language models that power Apple Intelligence features across Apple devices and…

You might also wanna read