**JetSpec: Breaking the Scaling Ceiling of Speculative Decoding with Parallel Tree Drafting**

> Speculative decoding (SD) accelerates autoregressive Large Language Models (LLMs) by drafting multiple tokens and verifying them in parallel, but it faces a scaling limitation: increasing the draft budget improves speed only when acceptance remains high and drafting overhead stays low. This ceiling has been difficult to break because prior head-based SD methods face a causality-efficiency dilemma. Autoregressive draf...

**来源信息**
- **来源**:HuggingFace Daily Papers(社区热门论文)
- **分类**:ai-models
- **发布时间**:2026-06-26 08:00(北京时间)
- **原文**:[打开原文](https://huggingface.co/papers/2606.18394)