[Submitted on 14 Apr 2026]

Parcae: A Stable Looped Language Model Architecture with Predictable Scaling Laws

Traditional fixed-depth architectures scale quality by increasing training FLOPs, typically through increased parameterization, at the expense of a higher memory footprint, or data. A potential alternative is looped architectures, which instead increase F