Sup AI: Ensemble System Using 339 LLMs to Reduce Hallucinations Scores 52.15% on Humanity's Last Exam
Every LLM hallucinates. They just don't hallucinate the same things. Sup AI runs multiple LLMs (out of 339) in parallel, then synthesizes answers by measuring confidence on every segment. High entropy = likely hallucination, downweighted. Low entropy = li