Intel and Phison partner to enable large AI models on low-RAM laptops via SSD technology
By
Mark Hachman
Sesame, salt, and substance. A flagship bake.
Summary
Intel and Phison are collaborating to address a key limitation of local AI computing: the inability to run large AI models on consumer PCs due to memory constraints. Their solution, Phison's aiDAPTIV technology, enables a 26 billion parameter AI model to run on a laptop with only 16GB of RAM instead of the typical 32GB requirement. This allows more laptops to handle local AI workloads and frees up system resources for other tasks. The approach involves running the aiDAPTIV solution on a PC SSD, drawing parallels to earlier controversial storage technologies.
Key quotes
· 3 pulledUsing Phison's aiDAPTIV solution, a 26 billion parameter AI model can be run on a laptop with 16GB of RAM, versus the 32GB of RAM it would normally require.
That has two advantages: bringing local AI to more laptops and allowing more powerful laptops to load even larger models or else run separate tasks alongside AI.
On a PC, AI can monopolize system resources
You might also wanna read
Running local AI models on an M4 MacBook with 24GB memory: A practical guide
The article details the author's experiments with running local AI language models on an M4 MacBook with 24GB memory. It covers the setup pr
Johanna Larsson·26d ago
Acquiring and Exploring a Rare Nvidia Grace-Hopper Superchip System for Local AI Development
The article details the author's discovery and acquisition of a rare Nvidia Grace-Hopper superchip system for €10,000 on Reddit, which is ty
dnhkng.github.io·5mo ago
Designing a Systolic Array AI Accelerator in Two Weeks for Global Foundries 180nm Tapeout
The article details the author's ambitious project to design a systolic array AI accelerator with in-silicon debug infrastructure from scrat
essenceia.github.io·4mo ago
Anker Develops Custom AI Chip 'Thus' for Local AI in Audio and IoT Devices
Anker has developed its own custom AI chip called Thus, which is described as the world's first neural-net compute-in-memory AI audio chip.
theverge.com·1mo ago
Research Directions for Overcoming Memory and Interconnect Challenges in Large Language Model Inference Hardware
This article discusses the technical challenges of Large Language Model (LLM) inference, highlighting how the autoregressive Decode phase ma
arxiv.org·4mo ago
Raspberry Pi Launches AI HAT+ 2 Add-on Board with 8GB RAM for Local Generative AI
Raspberry Pi has launched the AI HAT+ 2, an upgraded add-on board for the Raspberry Pi 5 that enables local generative AI model execution. T
The Verge·4mo ago