**Holistic Data Scheduler for LLM Pre-training via Multi-Objective Reinforcement

**Holistic Data Scheduler for LLM Pre-training via Multi-Objective Reinforcement Learning**

> The composition of training data, governed by the diversity of sources and their mixing strategy, is a cornerstone of Large Language Model (LLM) pre-training. Online Data Mixing (ODM), the technique of adaptively adjusting data mixtures during training, has emerged as a promising direction to improve efficiency. However, existing methods are constrained by their reliance on a singular optimization perspective, which...

**来源信息**
- **来源**：HuggingFace Daily Papers（社区热门论文）
- **分类**：论文
- **发布时间**：2026-06-24 08:00（北京时间）
- **原文**：[打开原文](https://huggingface.co/papers/2606.24133)