Ollama MLX Nearly Doubles LLM Speed on Your Mac: 58 to 112 tok/s, and Your Old Models Get None of…
Ollama’s decode speed on Apple Silicon went from 58 tokens per second to 112 in one release. Same machine, same size of model, same ollama… Continue reading on Level Up Coding »
Level Up Coding - Medium1d ago