DevDay — distillation breakout

The Rise of AI Distillation Amid High Training Costs

The article discusses the dominance of distillation techniques in AI due to the high costs and rapid obsolescence of large-scale model train

Distilling DeepSeek V4 Pro’s Thinking Style Into Qwen3.6-35B-A3B

Feedback Distillation: A New Training Method for Improving LLM Reasoning in Theorem Proving

This paper introduces Feedback Distillation, a novel training method for reasoning models that improves upon standard GRPO (Group Relative P

Proxy-KD: A Novel Method for Knowledge Distillation from Black-Box Large Language Models

This paper introduces Proxy-KD, a novel knowledge distillation method for transferring capabilities from black-box large language models (li

Uncovering Behavioral Trait Transmission in AI Models

The research uncovers a surprising aspect of distillation in AI models where behavioral traits can be transmitted through generated data.

The Efficiency Trap: How to Build a Lasting Cost Advantage with AI (via Passle)