4 papers
Hierarchical Fault Detection and Diagnosis for Transformer Architectures
Sigma Jahan, Saurabh Singh Rajput, Tushar Sharma +1
Transformers now underpin critical AI systems across industry and research. Yet their faults can silently alter model behavior without runtime errors, and existing techniques offer…
Characterizing Faults in Agentic AI: A Taxonomy of Types, Symptoms, and Root Causes
Mehil B Shah, Mohammad Mehdi Morovati, Mohammad Masudur Rahman +1
Agentic AI systems combine LLM-based reasoning, orchestration, tool invocation, and interaction with external environments. These systems introduce faults that are difficult to cha…
Why Attention Fails: A Taxonomy of Faults in Attention-Based Neural Networks
Sigma Jahan, Saurabh Singh Rajput, Tushar Sharma +1
Attention mechanisms are at the core of modern neural architectures, powering systems ranging from ChatGPT to autonomous vehicles and driving a major economic impact. However, high…
Can Hessian-Based Insights Support Fault Diagnosis in Attention-based Models?
Sigma Jahan, Mohammad Masudur Rahman
As attention-based deep learning models scale in size and complexity, diagnosing their faults becomes increasingly challenging. In this work, we conduct an empirical study to evalu…