Scaling Laws Limit Reliability of Large Language Models, Study Finds

We show that the scaling laws which determine the performance of large language models (LLMs) severely limit their ability to improve the uncertainty of their predictions. As a result, raising their…