118 citations · 219 across the 22 of their papers we have counts for
24 papers
Batch-Invariant Spectral Intelligence for Robust and Explainable Insect Authentication
Majharulislam Babor, Giacomo Rossi, Annalisa Altavilla +2
Edible insects offer an efficient source of alternative protein, requiring less land, water and emitting less greenhouse gas than conventional livestock. However, their successful…
LeafTrackNet: A Deep Learning Framework for Robust Leaf Tracking in Top-Down Plant Phenotyping
Shanghua Liu, Majharulislam Babor, Christoph Verduyn +4
High-resolution phenotyping at the level of individual leaves offers fine-grained insights into plant development and stress responses. However, the full potential of accurate leaf…
Capturing Polysemanticity with PRISM: A Multi-Concept Feature Description Framework
Laura Kopf, Nils Feldhus, Kirill Bykov +4
Automated interpretability research aims to identify concepts encoded in neural network features to enhance human understanding of model behavior. Within the context of large langu…
Model Guidance via Explanations Turns Image Classifiers into Segmentation Models
Xiaoyan Yu, Jannik Franzen, Wojciech Samek +2
Heatmaps generated on inputs of image classification networks via explainable AI methods like Grad-CAM and LRP have been observed to resemble segmentations of input images in many…
CoSy: Evaluating Textual Explanations of Neurons
Laura Kopf, Philine Lou Bommer, Anna Hedström +3
A crucial aspect of understanding the complex nature of Deep Neural Networks (DNNs) is the ability to explain learned concepts within their latent representations. While methods ex…
Sanity Checks Revisited: An Exploration to Repair the Model Parameter Randomisation Test
Anna Hedström, Leander Weber, Sebastian Lapuschkin +1
The Model Parameter Randomisation Test (MPRT) is widely acknowledged in the eXplainable Artificial Intelligence (XAI) community for its well-motivated evaluative principle: that th…
Manipulating Feature Visualizations with Gradient Slingshots
Dilyara Bareeva, Marina M. -C. Höhne, Alexander Warnecke +5
Feature Visualization (FV) is a widely used technique for interpreting concepts learned by Deep Neural Networks (DNNs), which synthesizes input patterns that maximally activate a g…
Explainable AI in Grassland Monitoring: Enhancing Model Performance and Domain Adaptability
Shanghua Liu, Anna Hedström, Deepak Hanike Basavegowda +2
Grasslands are known for their high biodiversity and ability to provide multiple ecosystem services. Challenges in automating the identification of indicator plants are key obstacl…
Prototypical Self-Explainable Models Without Re-training
Srishti Gautam, Ahcene Boubekki, Marina M. C. Höhne +1
Explainable AI (XAI) has unfolded in two distinct research directions with, on the one hand, post-hoc methods that explain the predictions of a pre-trained black-box model and, on…
Labeling Neural Representations with Inverse Recognition
Kirill Bykov, Laura Kopf, Shinichi Nakajima +2
Deep Neural Networks (DNNs) demonstrate remarkable capabilities in learning complex hierarchical data representations, but the nature of these representations remains largely unkno…
Kidnapping Deep Learning-based Multirotors using Optimized Flying Adversarial Patches
Pia Hanfeld, Khaled Wahba, Marina M. -C. Höhne +2
Autonomous flying robots, such as multirotors, often rely on deep learning models that make predictions based on a camera image, e.g. for pose estimation. These models can predict…
Flying Adversarial Patches: Manipulating the Behavior of Deep Learning-based Autonomous Multirotors
Pia Hanfeld, Marina M. -C. Höhne, Michael Bussmann +1
Autonomous flying robots, e.g. multirotors, often rely on a neural network that makes predictions based on a camera image. These deep learning (DL) models can compute surprising re…
Mark My Words: Dangers of Watermarked Images in ImageNet
Kirill Bykov, Klaus-Robert Müller, Marina M. -C. Höhne
The utilization of pre-trained networks, especially those trained on ImageNet, has become a common practice in Computer Vision. However, prior research has indicated that a signifi…
Finding the right XAI method -- A Guide for the Evaluation and Ranking of Explainable AI Methods in Climate Science
Philine Bommer, Marlene Kretschmer, Anna Hedström +2
Explainable artificial intelligence (XAI) methods shed light on the predictions of machine learning algorithms. Several different approaches exist and have already been applied in…
The Meta-Evaluation Problem in Explainable AI: Identifying Reliable Estimators with MetaQuantus
Anna Hedström, Philine Bommer, Kristoffer K. Wickstrøm +3
One of the unsolved challenges in the field of Explainable AI (XAI) is determining how to most reliably estimate the quality of an explanation method in the absence of ground truth…
ProtoVAE: A Trustworthy Self-Explainable Prototypical Variational Model
Srishti Gautam, Ahcene Boubekki, Stine Hansen +4
The need for interpretable models has fostered the development of self-explainable classifiers. Prior approaches are either based on multi-stage optimization schemes, impacting the…
DORA: Exploring Outlier Representations in Deep Neural Networks
Kirill Bykov, Mayukh Deb, Dennis Grinwald +2
Deep Neural Networks (DNNs) excel at learning complex abstractions within their internal representations. However, the concepts they learn remain opaque, a problem that becomes par…
Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural Network Explanations and Beyond
Anna Hedström, Leander Weber, Dilyara Bareeva +5
The evaluation of explanation methods is a research topic that has not yet been explored deeply, however, since explainability is supposed to strengthen trust in artificial intelli…
Demonstrating The Risk of Imbalanced Datasets in Chest X-ray Image-based Diagnostics by Prototypical Relevance Propagation
Srishti Gautam, Marina M. -C. Höhne, Stine Hansen +2
The recent trend of integrating multi-source Chest X-Ray datasets to improve automated diagnostics raises concerns that models learn to exploit source-specific correlations to impr…
Visualizing the Diversity of Representations Learned by Bayesian Neural Networks
Dennis Grinwald, Kirill Bykov, Shinichi Nakajima +1
Explainable Artificial Intelligence (XAI) aims to make learning machines less opaque, and offers researchers and practitioners various tools to reveal the decision-making strategie…
Self-Supervised Learning for 3D Medical Image Analysis using 3D SimCLR and Monte Carlo Dropout
Yamen Ali, Aiham Taleb, Marina M. -C. Höhne +1
Self-supervised learning methods can be used to learn meaningful representations from unlabeled data that can be transferred to supervised downstream tasks to reduce the need for l…
Explaining Bayesian Neural Networks
Kirill Bykov, Marina M. -C. Höhne, Adelaida Creosteanu +4
To advance the transparency of learning machines such as Deep Neural Networks (DNNs), the field of Explainable AI (XAI) was established to provide interpretations of DNNs' predicti…
NoiseGrad: Enhancing Explanations by Introducing Stochasticity to Model Weights
Kirill Bykov, Anna Hedström, Shinichi Nakajima +1
Many efforts have been made for revealing the decision-making process of black-box learning machines such as deep neural networks, resulting in useful local and global explanation…
How Much Can I Trust You? -- Quantifying Uncertainties in Explaining Neural Networks
Kirill Bykov, Marina M. -C. Höhne, Klaus-Robert Müller +2
Explainable AI (XAI) aims to provide interpretations for predictions made by learning machines, such as deep neural networks, in order to make the machines more transparent for the…