**When EOS Tokens Disagree: Understanding Length Inflation in On-Policy Distilla

**When EOS Tokens Disagree: Understanding Length Inflation in On-Policy Distillation**

> We study length inflation in on-policy distillation (OPD), where student responses can become excessively long and even exhaust the generation budget. We identify termination-token mismatch between base students and post-trained teachers as an important source of this behavior. Across Qwen3, Llama, and Gemma, the two models can place their stopping probability on different EOS tokens, even when their declared stoppin...

**来源信息**
- **来源**：HuggingFace Daily Papers（社区热门论文）
- **分类**：行业
- **发布时间**：2026-09-18 08:00（北京时间）
- **原文**：[打开原文](https://huggingface.co/papers/2609.20511)