ThreadWeaver: A Framework for Adaptive Parallel Reasoning in LLMs That Reduces Latency While Maintaining Accuracy

Scaling inference-time computation has enabled Large Language Models (LLMs) to achieve strong reasoning performance, but inherently sequential decoding leads to substantial latency. We introduce…