Speculative decoding can significantly accelerate LLM serving, yet most deployments today disentangle speculator training from serving, treating speculator training as a standalone offline modeling problem. We show that this decoupled formulation introduc
Shared by @togethercompute ↗
Shared by @GoogleCloudTech ↗
