7 papers
Attribution via Distributional Paths for Information Revelation
Kieran A. Murphy, Shameen Shrestha
Feature attribution methods explain predictions by assigning importance scores to input features. Path-based methods such as Integrated Gradients are especially appealing because t…
InfoChess: A Game of Adversarial Inference and a Laboratory for Quantifiable Information Control
Kieran A. Murphy
We propose InfoChess, a symmetric adversarial game that elevates competitive information acquisition to the primary objective. There is no piece capture, removing material incentiv…
From independent patches to coordinated attention: Controlling information flow in vision transformers
Kieran A. Murphy
We make the information transmitted by attention an explicit, measurable quantity in vision transformers. By inserting variational information bottlenecks on all attention-mediated…
Surveying the space of descriptions of a composite system with machine learning
Kieran A. Murphy, Yujing Zhang, Dani S. Bassett
Multivariate information theory provides a general and principled framework for understanding how the components of a complex system are connected. Existing analyses are coarse in…
Comparing the information content of probabilistic representation spaces
Kieran A. Murphy, Sam Dillavou, Dani S. Bassett
Probabilistic representation spaces convey information about a dataset and are shaped by factors such as the training data, network architecture, and loss function. Comparing the i…
Mechanical prions: Self-assembling microstructures
Mathieu Ouellet, Dani S. Bassett, Lee C. Bassett +2
Prions are misfolded proteins that transmit their structural arrangement to neighboring proteins. In biological systems, prion dynamics can produce a variety of complex functional…