Showing 2026Show all
2 papers · 1 filter
cs.LG2026
Broken Symmetry in BF16 Attention: Why FlashAttention Gradients Blow Up Late in Training
Junlin Chen, Daize Dong, Huanwei Di +9
BF16 is now standard in large-scale pretraining, including in fused attention kernels such as FlashAttention, and these kernels are widely trusted. When we used FlashAttention-3 to…
cs.RO2026
IndustrialVLA-Bench: A Traceable Multi-Axis Evaluation of Open Robot Policy Models
Yiqi Wang, Zhifeng Rao, Jiaqi Zhang +7
Open robot policies increasingly follow two paradigms: vision-language-action models (VLAs) directly map observations and instructions to actions, whereas world-action models (WAMs…