78 citations · 152 across the 27 of their papers we have counts for
31 papers
Graphical Design of Interpretable Architectures
Pietro Barbiero
Designing, implementing, and comparing interpretable architectures requires a formal language to represent them. The most common representations fall short in one of two ways. Symb…
The Standard Interpretable Model: A general theory of interpretable machine learning to deductively design interpretable methods using Lagrangian mechanics
Pietro Barbiero, Giovanni De Felice, Mateo Espinosa Zarlenga +5
As Artificial Intelligence models grow in complexity, interpretability has become an indispensable tool for understanding, debugging, and controlling their computations. However, i…
Prototype-Grounded Concept Models for Verifiable Concept Alignment
Stefano Colamonaco, David Debot, Pietro Barbiero +1
Concept Bottleneck Models (CBMs) aim to improve interpretability in Deep Learning by structuring predictions through human-understandable concepts, but they provide no way to verif…
Mixture of Concept Bottleneck Experts
Francesco De Santis, Gabriele Ciravegna, Giovanni De Felice +7
Concept Bottleneck Models (CBMs) promote interpretability by grounding predictions in human-understandable concepts. However, existing CBMs typically constrain their task predictor…
Interpretability in Deep Time Series Models Demands Semantic Alignment
Giovanni De Felice, Riccardo D'Elia, Alberto Termine +3
Deep time series models continue to improve predictive performance, yet their deployment remains limited by their black-box nature. In response, existing interpretability approache…
Actionable Interpretability Must Be Defined in Terms of Symmetries
Pietro Barbiero, Mateo Espinosa Zarlenga, Francesco Giannini +4
This paper argues that interpretability research in Artificial Intelligence (AI) is fundamentally ill-posed as existing definitions of interpretability fail to describe how interpr…
Scalable Evaluation and Neural Models for Compositional Generalization
Giacomo Camposampiero, Pietro Barbiero, Michael Hersche +2
Compositional generalization-a key open challenge in modern machine learning-requires models to predict unknown combinations of known concepts. However, assessing compositional gen…
Foundations of Interpretable Models
Pietro Barbiero, Mateo Espinosa Zarlenga, Alberto Termine +2
We argue that existing definitions of interpretability are not actionable in that they fail to inform users about general, sound, and robust interpretable model design. This makes…
Interpretable Hierarchical Concept Reasoning through Attention-Guided Graph Learning
David Debot, Pietro Barbiero, Gabriele Dominici +1
Concept-Based Models (CBMs) are a class of deep learning models that provide interpretability by explaining predictions through high-level concepts. These models first predict conc…
Towards Better Generalization and Interpretability in Unsupervised Concept-Based Models
Francesco De Santis, Philippe Bich, Gabriele Ciravegna +3
To increase the trustworthiness of deep neural networks, it is critical to improve the understanding of how they make decisions. This paper introduces a novel unsupervised concept-…
If Concept Bottlenecks are the Question, are Foundation Models the Answer?
Nicola Debole, Pietro Barbiero, Francesco Giannini +3
Concept Bottleneck Models (CBMs) are neural networks designed to conjoin high performance with ante-hoc interpretability. CBMs work by first mapping inputs (e.g., images) to high-l…
Avoiding Leakage Poisoning: Concept Interventions Under Distribution Shifts
Mateo Espinosa Zarlenga, Gabriele Dominici, Pietro Barbiero +2
In this paper, we investigate how concept-based models (CMs) respond to out-of-distribution (OOD) inputs. CMs are interpretable neural architectures that first predict a set of hig…
Logic Explanation of AI Classifiers by Categorical Explaining Functors
Stefano Fioravanti, Francesco Giannini, Paolo Frazzetto +2
The most common methods in explainable artificial intelligence are post-hoc techniques which identify the most relevant features used by pretrained opaque models. Some of the most…
Deferring Concept Bottleneck Models: Learning to Defer Interventions to Inaccurate Experts
Andrea Pugnana, Riccardo Massidda, Francesco Giannini +6
Concept Bottleneck Models (CBMs) are machine learning models that improve interpretability by grounding their predictions on human-understandable concepts, allowing for targeted in…
Neural Interpretable Reasoning
Pietro Barbiero, Giuseppe Marra, Gabriele Ciravegna +5
We formalize a novel modeling framework for achieving interpretability in deep learning, anchored in the principle of inference equivariance. While the direct verification of inter…
Causally Reliable Concept Bottleneck Models
Giovanni De Felice, Arianna Casanova Flores, Francesco De Santis +4
Concept-based models are an emerging paradigm in deep learning that constrains the inference process to operate through human-interpretable variables, facilitating explainability a…
Digital Histopathology with Graph Neural Networks: Concepts and Explanations for Clinicians
Alessandro Farace di Villaforesta, Lucie Charlotte Magister, Pietro Barbiero +1
To address the challenge of the ``black-box" nature of deep learning in medical settings, we combine GCExplainer - an automated concept discovery solution - along with Logic Explai…
Everybody Needs a Little HELP: Explaining Graphs via Hierarchical Concepts
Jonas Jürß, Lucie Charlotte Magister, Pietro Barbiero +2
Graph neural networks (GNNs) have led to major breakthroughs in a variety of domains such as drug discovery, social network analysis, and travel time estimation. However, they lack…
From Charts to Atlas: Merging Latent Spaces into One
Donato Crisostomi, Irene Cannistraci, Luca Moschella +4
Models trained on semantically related datasets and tasks exhibit comparable inter-sample relations within their latent spaces. We investigate in this study the aggregation of such…
Relational Concept Bottleneck Models
Pietro Barbiero, Francesco Giannini, Gabriele Ciravegna +2
The design of interpretable deep learning models working in relational domains poses an open challenge: interpretable deep learning methods, such as Concept Bottleneck Models (CBMs…
Interpretable Graph Networks Formulate Universal Algebra Conjectures
Francesco Giannini, Stefano Fioravanti, Oguzhan Keskin +4
The rise of Artificial Intelligence (AI) recently empowered researchers to investigate hard mathematical problems which eluded traditional approaches for decades. Yet, the use of A…
SHARCS: Shared Concept Space for Explainable Multimodal Learning
Gabriele Dominici, Pietro Barbiero, Lucie Charlotte Magister +2
Multimodal learning is an essential paradigm for addressing complex real-world problems, where individual data modalities are typically insufficient to accurately solve a given mod…
Interpretable Neural-Symbolic Concept Reasoning
Pietro Barbiero, Gabriele Ciravegna, Francesco Giannini +7
Deep learning methods are highly accurate, yet their opaque decision process prevents them from earning full human trust. Concept-based models aim to address this issue by learning…
GCI: A (G)raph (C)oncept (I)nterpretation Framework
Dmitry Kazhdan, Botty Dimanov, Lucie Charlotte Magister +3
Explainable AI (XAI) underwent a recent surge in research on concept extraction, focusing on extracting human-interpretable concepts from Deep Neural Networks. An important challen…