7 citations · 14 across the 15 of their papers we have counts for
4 papers · 1 filter
Tracing distinguishability through transformer processing with stochastic LayerNorm
Kieran Murphy
Representational similarity is foundational to analyses of deep networks, yet distances between point-valued representations are not intrinsically tied to downstream function: near…
Attribution via Distributional Paths for Information Revelation
Kieran A. Murphy, Shameen Shrestha
Feature attribution methods explain predictions by assigning importance scores to input features. Path-based methods such as Integrated Gradients are especially appealing because t…
InfoChess: A Game of Adversarial Inference and a Laboratory for Quantifiable Information Control
Kieran A. Murphy
We propose InfoChess, a symmetric adversarial game that elevates competitive information acquisition to the primary objective. There is no piece capture, removing material incentiv…
From independent patches to coordinated attention: Controlling information flow in vision transformers
Kieran A. Murphy
We make the information transmitted by attention an explicit, measurable quantity in vision transformers. By inserting variational information bottlenecks on all attention-mediated…