1 citations · 4 across the 8 of their papers we have counts for
4 papers · 1 filter
ATTNChecker: Highly-Optimized Fault Tolerant Attention for Large Language Model Training
Yuhang Liang, Xinyi Li, Jie Ren +3
Large Language Models (LLMs) have demonstrated remarkable performance in various natural language processing tasks. However, the training of these models is computationally intensi…
FlowFPX: Nimble Tools for Debugging Floating-Point Exceptions
Taylor Allred, Xinyi Li, Ashton Wiersdorf +2
Reliable numerical computations are central to scientific computing, but the floating-point arithmetic that enables large-scale models is error-prone. Numeric exceptions are a comm…
FTTN: Feature-Targeted Testing for Numerical Properties of NVIDIA & AMD Matrix Accelerators
Xinyi Li, Ang Li, Bo Fang +3
NVIDIA Tensor Cores and AMD Matrix Cores (together called Matrix Accelerators) are of growing interest in high-performance computing and machine learning owing to their high perfor…
A GPU accelerated mixed-precision Smoothed Particle Hydrodynamics framework with cell-based relative coordinates
Zirui Mao, Xinyi Li, Shenyang Hu +2
Smoothed Particle Hydrodynamics (SPH) is essential for modeling complex large-deformation problems across various applications, requiring significant computational power. A major p…