1 paper · 1 filter
Suvadeep Hajra
Autoregressive transformer language models frequently exhibit training instability when trained on long sequences, particularly under low-precision arithmetic. Although this instab…