Can Hessian-Based Insights Support Fault Diagnosis in Attention-based Models?

Sigma Jahan, Mohammad Masudur Rahman

As attention-based deep learning models scale in size and complexity, diagnosing their faults becomes increasingly challenging. In this work, we conduct an empirical study to evalu…