Microsoft-backed D-Matrix enters production with Corsair AI inference chip claiming 10x speed over Nvidia GPUs

Summary

D-Matrix, a startup based near Nvidia's Silicon Valley headquarters and backed by Microsoft, is entering full production of its Corsair AI inference chip. The company claims Corsair can run inference workloads 10 times faster and use five times less energy than a standalone Nvidia GPU, though only for smaller workloads. The chip takes a novel approach to memory similar to competitors Cerebras and Groq, aiming to bypass the memory shortage that has constrained AI hardware development.