rescrv

Exploring FORTH and Associative Languages as Better Fits for Transformer Architectures

The article explores the idea that FORTH and associative/applicative programming languages might be better suited for transformer architectures than traditional recursive approaches. The author argues against the common practice of using LLMs to break down problems recursively like humans do, instead proposing that concatenative languages that focus on stack