Beyond Autoregression: LLaDA2.1 and the Case for Self-Editing Language Models

Examining the hype and reality around Large Language Models

The article discusses the current debate around Large Language Models (LLMs) and their potential impact. It explores multiple perspectives o

iLLaDA: An 8B Masked Diffusion Language Model Trained with Bidirectional Attention

The paper introduces iLLaDA, an 8-billion parameter masked diffusion language model trained from scratch with fully bidirectional attention,

Evolution of Large Language Model Architectures: A Critical Comparison

The article discusses the evolution of large language model (LLM) architectures from GPT-2 to newer models like DeepSeek-V3 and Llama 4, que

Understanding Continuous Batching in Large Language Models: From Attention Mechanisms to Throughput Optimization

This technical blog post explains continuous batching in large language models (LLMs) by starting from first principles of attention mechani

The Erosion of Unique Human Voices in the Age of AI-Generated Content

The article argues that the widespread use of Large Language Models (LLMs) for content creation is eroding our unique human voices. The auth

Scientific production in the era of large language models [pdf]