6 papers
Weakly Supervised Concept Learning for Object-centric Visual Reasoning
Sparsh Tiwari, Bettina Finzel, Gesina Schwalbe
Neurosymbolic systems promise to combine deep neural network's (DNN) processing of raw sensor inputs with few-shot performance of symbolic artificial intelligence. Two-stage approa…
Explaining, Verifying, and Aligning Semantic Hierarchies in Vision-Language Model Embeddings
Gesina Schwalbe, Mert Keser, Moritz Bayerkuhnlein +9
Vision-language model (VLM) encoders such as CLIP enable strong retrieval and zero-shot classification in a shared image-text embedding space, yet the semantic organization of this…
Attack logics, not outputs: Towards efficient robustification of deep neural networks by falsifying concept-based properties
Raik Dankworth, Gesina Schwalbe
Deep neural networks (NNs) for computer vision are vulnerable to adversarial attacks, i.e., miniscule malicious changes to inputs may induce unintuitive outputs. One key approach t…
On Background Bias of Post-Hoc Concept Embeddings in Computer Vision DNNs
Gesina Schwalbe, Georgii Mikriukov, Edgar Heinert +5
The thriving research field of concept-based explainable artificial intelligence (C-XAI) investigates how human-interpretable semantic concepts embed in the latent spaces of deep n…
Benchmarking Vision Foundation Models for Input Monitoring in Autonomous Driving
Mert Keser, Halil Ibrahim Orhan, Niki Amini-Naieni +3
Deep neural networks (DNNs) remain challenged by distribution shifts in complex open-world domains like automated driving (AD): Robustness against yet unknown novel objects (semant…
Local Concept Embeddings for Analysis of Concept Distributions in Vision DNN Feature Spaces
Georgii Mikriukov, Gesina Schwalbe, Korinna Bade
Insights into the learned latent representations are imperative for verifying deep neural networks (DNNs) in critical computer vision (CV) tasks. Therefore, state-of-the-art superv…