Fine-tuning with gpt-oss and Hugging Face Transformers

Universal Reasoning Model (URM): Enhancing Transformer Performance for Complex AI Reasoning Tasks

This research paper analyzes Universal Transformers (UTs) used for complex reasoning tasks like ARC-AGI and Sudoku, finding that performance

Examining the Limitations of Transformer Models and the Gap to Human-Level AI

The article presents a skeptical perspective on claims about imminent Artificial General Intelligence (AGI), arguing that current transforme

How the community trained Gemma to "Think" with Tunix and TPUs

New Method Enables Constant-Cost Self-Attention Computation for Transformers

Researchers present a novel mathematical approach to compute self-attention in Transformer AI models with constant cost per token, rather th

Study Reveals How RL and SFT Differently Teach Transformers Chain-of-Thought Reasoning on Sparse Boolean Functions

This research paper analyzes how transformers learn Chain-of-Thought (CoT) reasoning capabilities through Reinforcement Learning (RL) with p

AI Evolution in 2025: From Stochastic Parrots to Chain of Thought Reasoning

The article reflects on the evolution of AI understanding by the end of 2025, noting that the 'stochastic parrots' criticism of LLMs has lar