I Tried to Run “GLM” Locally Nobody Warned Me it’s Actually Six Different Hardware Requirements…
GLM-4.7-Flash struggled on my 16GB Mac. Then I found out the flagship GLM model needs more memory than my entire house has RAM for… Continue reading on Towards AI »
Read the full articleYou might also wanna read
LLMs on Intel Macs with AMD GPUs in MacOS is here
There's a large installed base of these machines and inevitably, a clever individual has released an app to serve that base. It's called Tos
Enthusiasts Figured Out How to Run a 744-Billion-Parameter AI Without a Graphics Card — But There’s a Catch
Over on GitHub, someone has posted Colibri – a tool that lets you run GLM-5.2 on a home PC with roughly 25 GB of RAM and no dedicated GPU. W
Running local AI models on an M4 MacBook with 24GB memory: A practical guide
Experiments with getting usable outputs out of local models on a standard Macbook
Johanna Larsson·2mo ago
Colibri: Running GLM 5.2 on a 32GB Laptop with Disk Streaming and Expert Offloading
A solo developer built a 1,300-line C inference engine that runs the 744B GLM 5.2 model on consumer hardware by streaming routed experts fro
Flash-MoE: Running 397B Parameter AI Model on MacBook Pro with 48GB RAM
Running a big model on a small laptop. Contribute to danveloper/flash-moe development by creating an account on GitHub.
github.com·3mo agoColibri: Run GLM-5.2 (744B MoE) on a 25GB Laptop
Colibri runs GLM-5.2 on a 25GB laptop via pure-C disk streaming. Architecture, benchmarks, DGX Spark support.
Comments
Sign in to join the conversation.
No comments yet. Be the first.