Why CPU-Based Autoscaling Fails for GPU Inference — and How KEDA Fixes It
This article explains why CPU utilization is a poor autoscaling signal for GPU inference workloads, using a real-world incident where an HPA configured with targetCPUUtilizationPercentage failed to scale during a traffic spike, causing latency to spike. It argues that CPU is a de
