Barriers to Counterfactual Credit Attribution for Autoregressive Models

Aloni Cohen, Chenhao Zhang

Generative AI disrupts the practice of giving credit to work that came before. Ideally, a generative model would give credit to any work on which its output depends in a significan…