ReAGent: A Model-agnostic Feature Attribution Method for Generative Language Models

Zhixue Zhao, Boxuan Shan

Feature attribution methods (FAs), such as gradients and attention, are widely employed approaches to derive the importance of all input features to the model predictions. Existing…