llmfit: Terminal Tool for Finding LLMs Compatible with Your Hardware
By
bilsbie
Baker's choice. Dense with flavour, light on filler.
Summary
llmfit is a terminal tool that helps users find which large language models (LLMs) will run effectively on their specific hardware. The tool automatically detects system specifications (RAM, CPU, GPU), evaluates hundreds of models across multiple dimensions including quality, speed, fit, and context length, and provides recommendations for optimal model selection. It supports various local runtime providers like Ollama, llama.cpp, MLX, Docker Model Runner, and LM Studio, and offers both interactive TUI and classic CLI interfaces.
Key quotes
· 4 pulledA terminal tool that right-sizes LLM models to your system's RAM, CPU, and GPU.
Detects your hardware, scores each model across quality, speed, fit, and context dimensions, and tells you which ones will actually run well on your machine.
Ships with an interactive TUI (default) and a classic CLI mode.
Supports multi-GPU setups, MoE architectures, dynamic quantization selection, speed estimation, and local runtime providers (Ollama, llama.cpp, MLX, Docker Model Runner, LM Studio).
You might also wanna read
LLMTest: Automated LLM Model Selection and Fallback Tool for Developers
LLMTest is a tool created by maker Tom to help developers and "vibe coders" automatically select the best LLM models for AI-powered features
Product Hunt·10d ago
LLM Stats: Platform for Comparing AI Language Models by Benchmarks, Cost, and Capabilities
LLM Stats is a platform that allows users to compare various AI language models (LLMs) across multiple dimensions including performance benc
Product Hunt·7mo ago
Guide to Calculating GPU Memory for Self-Hosted LLM Inference
The article provides a guide on calculating GPU memory requirements and managing concurrent requests for self-hosted large language model (L
Product Hunt·9mo ago
Monostate: All-in-One AI Training Platform for Fine-Tuning LLMs
Monostate is an all-in-one AI training platform that enables users to fine-tune large language models (LLMs) with their own data using vario
Product Hunt·2mo ago
RunLLM: AI Tool for Resolving Support Issues with UC Berkeley Research
RunLLM, an AI tool built on UC Berkeley research, resolves complex support issues by analyzing logs, code, and documentation. It claims to s
Product Hunt·10mo ago
QuickCompare: Compare 50+ LLMs on Your Own Data by Quality, Cost, and Speed
QuickCompare by Trismik is a tool that allows users to upload their own data and compare 50+ LLMs side-by-side based on quality, cost, and s
Product Hunt·1mo ago