**Knowing When to Teach: Learning from Teachable Prefixes in Multilingual Reason

**Knowing When to Teach: Learning from Teachable Prefixes in Multilingual Reasoning Distillation**

> On-Policy Self-Distillation (OPSD) improves reasoning by training a student on its own reasoning, using the same model conditioned on reference solutions as a teacher. Applying OPSD to multilingual reasoning requires the teacher to provide useful feedback across languages, even when the student makes mistakes in intermediate steps. We observe a phenomenon we call Teacher Drift: as these mistakes accumulate, the teach...

**来源信息**
- **来源**：HuggingFace Daily Papers（社区热门论文）
- **分类**：行业
- **发布时间**：2026-11-09 08:00（北京时间）
- **原文**：[打开原文](https://huggingface.co/papers/2611.08179)