**X-AuT: Progressive Audio-Encoder Compression for Speech LLMs with Cross-Scale

**X-AuT: Progressive Audio-Encoder Compression for Speech LLMs with Cross-Scale Distillation**

> Reducing audio-encoder depth lowers the inference cost of speech large language models, but removing complete blocks perturbs the embeddings consumed by the decoder and can cause deletion and premature end-of-sequence errors. We introduce X-AuT, a progressive framework that selects layer combinations through short behavioral probes and restores the pruned model through representation alignment, cross-scale distillati...

**来源信息**
- **来源**：HuggingFace Daily Papers（社区热门论文）
- **分类**：行业
- **发布时间**：2026-09-11 08:00（北京时间）
- **原文**：[打开原文](https://huggingface.co/papers/2609.11412)