16 citations · 34 across the 13 of their papers we have counts for
13 papers
Simple LLM Baselines are Competitive for Model Diffing
Elias Kempf, Simon Schrodi, Bartosz Cywiński +3
Standard LLM evaluations only test capabilities or dispositions that evaluators designed them for, missing unexpected differences such as behavioral shifts between model revisions…
What Drives Compositional Generalization in Visual Generative Models? The Importance of Continuous Training Objectives
Karim Farid, Rajat Sahay, Yumna Ali Alnaggar +4
Compositional generalization, the ability to generate novel combinations of known concepts, is a key ingredient for visual generative models. Yet, not all mechanisms that enable or…
Towards Understanding Subliminal Learning: When and How Hidden Biases Transfer
Simon Schrodi, Elias Kempf, Fazl Barez +1
Language models can transfer hidden biases during distillation. For example, a teacher that "likes owls" can make its student "like owls" too, even when the training data consists…
When and How Does CLIP Enable Domain and Compositional Generalization?
Elias Kempf, Simon Schrodi, Max Argus +1
The remarkable generalization performance of contrastive vision-language models like CLIP is often attributed to the diversity of their training distributions. However, key questio…
Concept Bottleneck Models Without Predefined Concepts
Simon Schrodi, Julian Schur, Max Argus +1
There has been considerable recent interest in interpretable concept-based models such as Concept Bottleneck Models (CBMs), which first predict human-interpretable concepts and the…
Two Effects, One Trigger: On the Modality Gap, Object Bias, and Information Imbalance in Contrastive Vision-Language Models
Simon Schrodi, David T. Hoffmann, Max Argus +2
Contrastive vision-language models (VLMs), like CLIP, have gained popularity for their versatile applicability to various downstream tasks. Despite their successes in some tasks, l…
Is Mamba Capable of In-Context Learning?
Riccardo Grazzi, Julien Siems, Simon Schrodi +2
State of the art foundation models such as GPT-4 perform surprisingly well at in-context learning (ICL), a variant of meta-learning concerning the learned ability to solve tasks du…
Latent Diffusion Counterfactual Explanations
Karim Farid, Simon Schrodi, Max Argus +1
Counterfactual explanations have emerged as a promising method for elucidating the behavior of opaque black-box models. Recently, several works leveraged pixel-space diffusion mode…
Climate-sensitive Urban Planning through Optimization of Tree Placements
Simon Schrodi, Ferdinand Briegel, Max Argus +2
Climate change is increasing the intensity and frequency of many extreme weather events, including heatwaves, which results in increased thermal discomfort and mortality rates. Whi…
Eureka-Moments in Transformers: Multi-Step Tasks Reveal Softmax Induced Optimization Problems
David T. Hoffmann, Simon Schrodi, Jelena Bratulić +3
In this work, we study rapid improvements of the training loss in transformers when being confronted with multi-step decision tasks. We found that transformers struggle to learn th…
Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammars
Simon Schrodi, Danny Stoll, Binxin Ru +3
The discovery of neural architectures from simple building blocks is a long-standing goal of Neural Architecture Search (NAS). Hierarchical search spaces are a promising step towar…
Bag of Baselines for Multi-objective Joint Neural Architecture Search and Hyperparameter Optimization
Julia Guerrero-Viu, Sven Hauns, Sergio Izquierdo +7
Neural architecture search (NAS) and hyperparameter optimization (HPO) make deep learning accessible to non-experts by automatically finding the architecture of the deep neural net…
Towards Understanding Adversarial Robustness of Optical Flow Networks
Simon Schrodi, Tonmoy Saikia, Thomas Brox
Recent work demonstrated the lack of robustness of optical flow networks to physical patch-based adversarial attacks. The possibility to physically attack a basic component of auto…