MicroGPT-C: C99 GPT-2 Engine for Edge AI Uses Pipeline Architecture to Coordinate Specialized Micro-Models

Summary

The article presents microgpt-c, a zero-dependency C99 implementation of GPT-2 designed for edge AI applications. The project started as a C port of Andrej Karpathy's microGPT.py and evolved into exploring whether tiny models can achieve intelligence through coordination rather than scaling. The system uses an Organelle Pipeline Architecture (OPA) where specialized micro-models (30K–160K parameters) work together in a pipeline, achieving 91% win rates on 11 logic games. The approach demonstrates that composition of small, focused models can outperform single larger models on specific tasks, with sub-1M parameter models training on-device in seconds.