2 papers
cs.CL2026
Pretraining Large Language Models with NVFP4
NVIDIA, Felix Abecassis, Anjulie Agrusa +87
Large Language Models (LLMs) today are powerful problem solvers across many domains, and they continue to get stronger as they scale in model size, training set size, and training…
cs.LG2025
Recipes for Pre-training LLMs with MXFP8
Asit Mishra, Dusan Stosic, Simon Layton +1
Using fewer bits to represent model parameters and related tensors during pre-training has become a required technique for improving GPU efficiency without sacrificing accuracy. Mi…