Importance Scoring of Transformer Attention Heads in Learning Tabular Data

Ahmad Jad Allah, Kazi F. Akhter, Md. Kamrozzaman Bhuiyan +1

Computationally demanding and opaque deep learning models can be better understood and optimized by analyzing how they transform data. While deep transformers have been widely stud…