2 papers
cs.SE2026
The Llama 4 Herd: Architecture, Training, Evaluation, and Deployment Notes
Redacted by arXiv
This document consolidates publicly reported technical details about Metas Llama 4 model family. It summarizes (i) released variants (Scout and Maverick) and the broader herd conte…
cs.LG2025
GaLore 2: Large-Scale LLM Pre-Training by Gradient Low-Rank Projection
DiJia Su, Andrew Gu, Jane Xu +2
Large language models (LLMs) have revolutionized natural language understanding and generation but face significant memory bottlenecks during training. GaLore, Gradient Low-Rank Pr…