Why Average LLM Use Is Likely Destroying Value in Software Development
By
Jake
Baker's choice. Dense with flavour, light on filler.
Summary
The author argues that, contrary to prevailing hype, the average use of Large Language Models (LLMs) is likely destroying value rather than creating it. Drawing on data from Faros.ai, a software development telemetry firm that measures operational impacts across tools like Jira and GitHub, the article presents evidence that LLM integration in software workflows may be counterproductive. The piece shifts from a previously neutral stance to a critical position on LLM value creation, suggesting that the technology's current application patterns are net negative for productivity and outcomes.
Key quotes
· 3 pulledOn average, how we're using LLMs is likely destroying value.
I'm arguing elsewhere that LLMs will never be geniuses.
This is not part 2 of The Ontology Argument.
You might also wanna read
LLM Stats: Platform for Comparing AI Language Models by Benchmarks, Cost, and Capabilities
LLM Stats is a platform that allows users to compare various AI language models (LLMs) across multiple dimensions including performance benc
Product Hunt·7mo ago
Why Treating LLMs as Black-Box Problem Solvers Fails: Lessons from Processing 100 Compliance PDFs
The article discusses the author's experience transforming 100 messy compliance PDFs into structured JSON rules. It critiques the common app
towardsdatascience.com·4d ago
Study finds LLMs persist in treating false claims as true despite explicit warnings
A study on fine-tuning large language models (LLMs) reveals that even after explicit warnings that certain claims are false, the models cont
arstechnica.com·20h ago
LLMTest: Automated LLM Model Selection and Fallback Tool for Developers
LLMTest is a tool created by maker Tom to help developers and "vibe coders" automatically select the best LLM models for AI-powered features
Product Hunt·9d ago
RunLLM: AI Tool for Resolving Support Issues with UC Berkeley Research
RunLLM, an AI tool built on UC Berkeley research, resolves complex support issues by analyzing logs, code, and documentation. It claims to s
Product Hunt·10mo agoAnthropic and OpenAI appear to have found product-market fit as enterprise LLM usage surges
The article discusses how Anthropic and OpenAI have likely achieved product-market fit, evidenced by Anthropic's rumored first profitable qu