FailBench: Evaluating Fault Tolerance Across Distributed Training Architectures

Khaled Aljbab, Amine Barrak

Distributed deep learning relies on data, pipeline, tensor, and hybrid parallelism, yet fault-tolerance mechanisms are typically evaluated only on the architecture for which they w…