All Topics
All Topics
Technology
Technology
AI
AI
Business
Business
Entertainment
Entertainment
News
News
Programming
Programming
Science
Science
Design
Design
Environment
Environment
Finance
Finance
Crypto
Crypto
Politics
Politics
Sports
Sports
Education
Education
Gaming
Gaming
Art
Art
Music
Music
Health
Health
Security
Security
Books
Books
Food
Food
Travel
Travel
Personal
Personal
Bluesky
Twitter

Colibri: Running GLM 5.2 on a 32GB Laptop with Disk Streaming and Expert Offloading

A solo developer built a 1,300-line C inference engine that runs the 744B GLM 5.2 model on consumer hardware by streaming routed experts from disk. Here's how it works.

Read the full article

You might also wanna read

Colibri: Run 744B-parameter GLM-5.2 MoE model on consumer hardware with 25GB RAM using pure C

Run GLM-5.2 (744B MoE) on a 25GB-RAM consumer machine — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦 - Just

github.com·1d ago

Colibri: Run 744B-parameter GLM-5.2 MoE model on consumer hardware with 25GB RAM using pure C

Run GLM-5.2 (744B MoE) on a 25GB-RAM consumer machine — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦 - Just

github.com·1d ago

GLM-5.2: Running Z.ai's 744B-Parameter Open Model Locally with Unsloth Dynamic GGUFs

Run the new GLM-5.2 model by Z.ai on local hardware!

unsloth.ai·17d ago

GLM-5.2: Running Z.ai's 744B-Parameter Open Model Locally with Unsloth Dynamic GGUFs

Run the new GLM-5.2 model by Z.ai on local hardware!

unsloth.ai·17d ago

GLM-5.2: The Open-Source AI Model Beating GPT-5.5 and Chasing Claude Opus 4.8

Z.ai's GLM-5.2 is a 744B parameter open-weight model that beats GPT-5.5 on multiple coding benchmarks at 1/6th the cost. MIT-licensed, 1M co

Flowtivity·16d ago

GLM 5.2 - API Pricing & Benchmarks

GLM 5.2 is a large-scale reasoning model from Z.ai. $0.95 per million input tokens, $3 per million output tokens. 1,048,576 token context wi

openrouter.ai·12d ago

Zhipu AI Launches GLM-5: Fifth-Generation Large Language Model with 745B Parameters

745B parameters. 44B active. Built for agentic intelligence, advanced reasoning, and frontier-level performance. Now accessible via Z.ai's p

glm5.net·4mo ago

Introduction of GLM-4.5 and GLM-4.5-Air: Advanced Models for Reasoning and Coding

Today, we introduce two new GLM family members: GLM-4.5 and GLM-4.5-Air — our latest flagship models. GLM-4.5 is built with 355 billion tota

z.ai·11mo ago

Comments

Sign in to join the conversation.

No comments yet. Be the first.