**Scaling Native Multimodal Pre-Training From Scratch** > Although large langua

**Scaling Native Multimodal Pre-Training From Scratch**

> Although large language models (LLMs) exhibit remarkable reasoning capabilities, their reliance on text-only pre-training restricts the perception of the multimodal physical world. Native multimodal pre-training avoids this limitation by training models from scratch on multimodal inputs, thereby achieving deep cross-modal integration and mitigating optimization asymmetries inherent to traditional late-fusion architec...

**来源信息**
- **来源**：HuggingFace Daily Papers（社区热门论文）
- **分类**：论文
- **发布时间**：2026-07-27 08:00（北京时间）
- **原文**：[打开原文](https://huggingface.co/papers/2607.22043)