1 paper · 2 filters
Suvadeep Hajra
Autoregressive transformer language models frequently exhibit training instability when trained on long sequences, particularly under low-precision arithmetic. Although this instab…