Decoding Layer Saliency in Language Transformers

Elizabeth M. Hou, Gregory Castanon

In this paper, we introduce a strategy for identifying textual saliency in large-scale language models applied to classification tasks. In visual networks where saliency is more we…