Unicron: Economizing Self-Healing LLM Training at Scale

Tao He, Xue Li, Zhibin Wang +4

Training large-scale language models is increasingly critical in various domains, but it is hindered by frequent failures, leading to significant time and economic costs. Current f…