Revisiting local LLMs for coding: A 4-week hands-on assessment
A personal retrospective on running local LLMs for coding tasks over a 4-week period. The author shares their journey from past disappointment to renewed exploration, driven by claims of significant improvements in local model viability. The piece covers general factors influencing local model usability for coding, drawing on hands-on experience and notes from colleagues at Thoughtworks on AI-assisted software delivery.
Key quotes
Until recently I hadn't tried running models locally for quite a while, the disappointment had just always been too high when I did it.
About a month ago though, I dove back in - there were just too many claims out there to ignore, about how far they have come.
In this memo, I will start with a more general introduction and go through the factors that influence the viability
You might also wanna read
Reflections on LLMs and Their Impact on Software Development Practices
The author shares personal reflections on the current state of Large Language Models (LLMs) and AI in software development, questioning whet
Building a Custom Minimal Coding Agent: Lessons from Three Years of LLM-Assisted Development
The article details the author's three-year journey using various LLM-powered coding assistants, from early ChatGPT usage to modern coding a
How Interface Design Impacts LLM Coding Performance More Than Model Selection
The article argues that the current focus on comparing which large language model (LLM) is best at coding is misguided because the real bott
blog.can.ac·4mo ago
Critical Analysis of LLM Limitations in Software Development
The article critiques the limitations and problems with Large Language Models (LLMs) and generative AI, using a personal experience with a n
deobald.ca·4mo ago
Exploring RLHF on every prompt for local coding models
A Hacker News user explores the idea of using Reinforcement Learning from Human Feedback (RLHF) on every prompt with a medium-sized local mo
news.ycombinator.com·23d ago
Local AI models have finally become viable for programming tasks
The article discusses the author's experience with local AI models, noting that they have significantly improved over time. The author, usin
vickiboykis.com·22d ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.