**AC-ODM: Actor--Critic Online Data Mixing for Sample-Efficient LLM Pretraining*

**AC-ODM: Actor--Critic Online Data Mixing for Sample-Efficient LLM Pretraining**

> Optimizing pretraining data composition is pivotal for LLM generalization. While dynamic mixing outperforms static strategies by capturing evolving training dynamics, current methods fail to reconcile computational efficiency with sample efficiency and structural flexibility for diverse pipelines.We introduce Actor--Critic Online Data Mixing (AC-ODM), which approaches data mixing from a reinforcement learning perspec...

**来源信息**
- **来源**：HuggingFace Daily Papers（社区热门论文）
- **分类**：行业
- **发布时间**：2026-06-23 08:00（北京时间）
- **原文**：[打开原文](https://huggingface.co/papers/2505.23878)