Comparison of Local LLMs and Offline Wikipedia Sizes for Practicality
By
EvanHahn
10mo ago· 2 min readenNews
70/100
Toasty
Bagelometer↗
Warm and crisp on the edges. A bagel with a bit of bite.
Score70TypenewsSentimentneutral
Summary
The article discusses the comparison between the sizes of local Large Language Models (LLMs) and offline Wikipedia downloads, exploring the practicality of running LLMs on consumer-grade hardware.
Key quotes
· 3 pulled'It’s like having a weird, condensed, faulty version of Wikipedia, so I can help reboot society with the help of my little USB stick,' [Simon Willison] says.
I compared some models from the Ollama library to various downloads on Kiwix.
I chose models that could be run on some consumer-grade hardware, and Wikipedia bundles that didn’t
How do the sizes of local LLMs compare to the size of offline Wikipedia downloads?
