**FastMix: Fast Data Mixture Optimization via Gradient Descent** > While large

**FastMix: Fast Data Mixture Optimization via Gradient Descent**

> While large and diverse datasets have driven recent advances in large models, identifying the optimal data mixture for pre-training and post-training remains a significant open problem. We address this challenge with FASTMIX, a novel framework that automates data mixture discovery while training only a single proxy model. Instead of relying on predefined heuristics or resource-intensive simulations, FASTMIX jointly o...

**来源信息**
- **来源**：HuggingFace Daily Papers（社区热门论文）
- **分类**：ai-models
- **发布时间**：2026-06-23 08:00（北京时间）
- **原文**：[打开原文](https://huggingface.co/papers/2606.14971)