Transformer Co-Creator Criticizes AI Research Narrow Focus, Moves Beyond His Own Technology

Summary

Llion Jones, co-author of the seminal 2017 "Attention Is All You Need" paper that introduced transformer technology, has publicly criticized the current state of AI research as dangerously narrow. Speaking at the TED AI conference, Jones expressed frustration with the overwhelming focus on transformers, which now power virtually all major AI systems including ChatGPT and Claude. Despite unprecedented investment and talent in AI, he argues the field has become too concentrated on a single architecture and is moving on from his own creation to explore alternative approaches.