Getting aligned on representational alignment

Abstract

Biological and artificial information processing systems form representations of the world that they can use to categorize, reason, plan, navigate, and make decisions. How can we measure the similarity between the representations formed by these diverse systems? Do similarities in representations then translate into similar behavior? If so, then how can a system's representations be modified to better match those of another system? These questions pertaining to the study of representational alignment are at the heart of some of the most promising research areas in contemporary cognitive science, neuroscience, and machine learning. In this Perspective, we survey the exciting recent developments in representational alignment research in the fields of cognitive science, neuroscience, and machine learning. Despite their overlapping interests, there is limited knowledge transfer between these fields, so work in one field ends up duplicated in another, and useful innovations are not shared effectively. To improve communication, we propose a unifying framework that can serve as a common language for research on representational alignment, and map several streams of existing work across fields within our framework. We also lay out open problems in representational alignment where progress can benefit all three of these fields. We hope that this paper will catalyze cross-disciplinary collaboration and accelerate progress for all communities studying and developing information processing systems.

51 pages; Working paper (changes to be made in upcoming revisions)

Cited by in corpus (6)

• An XAI framework for robust and transparent data-driven wind turbine power curve models
• Similarity of Neural Network Models: A Survey of Functional and Representational Measures
• Towards Symbolic XAI -- Explanation Through Human Understandable Logical Relationships Between Features
• Abstraction Alignment: Comparing Model-Learned and Human-Encoded Conceptual Relationships
• Summary statistics of learning link changing neural representations to behavior
• Seeing Eye to AI? Applying Deep-Feature-Based Similarity Metrics to Information Visualization