activity
20242026
most citedJetfire: Efficient and Accurate Transformer Pretraining with INT8 Data Flow and Per-Block Quantization

1 citations · 1 across the 7 of their papers we have counts for

collaborators
Showing 2025Show all

2 papers · 1 filter

cs.LG2025

TetraJet-v2: Accurate NVFP4 Training for Large Language Models with Oscillation Suppression and Outlier Control

Yuxiang Chen, Yifan Liu, Xiaoming Xu +5

Large Language Models (LLMs) training is prohibitively expensive, driving interest in low-precision fully-quantized training (FQT). While novel 4-bit formats like NVFP4 offer subst…

cs.LG2025

Oscillation-Reduced MXFP4 Training for Vision Transformers

Yuxiang Chen, Haocheng Xi, Jun Zhu +1

Pre-training Transformers in FP4 precision is becoming a promising approach to gain substantial speedup, but it comes with a considerable loss of accuracy. Microscaling (MX) data f…