1 citations · 3 across the 16 of their papers we have counts for
15 papers · 1 filter
Cartridges++: KV Cache Compression without Off-Context Derailment
Sonia Laguna, Joao Monteiro, Marco Cuturi +2
Serving long documents to a Large Language Model (LLM) repeatedly is expensive: computations grow with context length, and the memory footprint of the key-value (KV) cache balloons…
ConRAG: Lightweight inference of multi-hop relations
Kilian Bänziger, Sonia Laguna, Markus Kreft +4
Understanding how two entities are connected often requires tracing multi-hop relations across documents to identify intermediate entities and supporting evidence that explain a co…
Cyclostationary Phase Conditioning for Medical Time Series Diffusion
Samuel Ruiperez-Campillo, Michele Copetti, Jorge da Silva Goncalves +3
Many physiological time series, such as cardiac and brain recordings, exhibit cyclostationarity: their statistics vary periodically with an underlying cycle phase. Corruption from…
DynaMiCS: Fine-tuning LLMs with Performance Constraints using Dynamic Mixtures
Eleonora Gualdoni, Sonia Laguna, Louis Bethune +3
Multi-domain fine-tuning of large language models requires improving performance on target domains while preserving previous capabilities, such as general knowledge, instruction fo…
Foundation Model for Cardiac Time Series via Masked Latent Attention
Moritz Vandenhirtz, Samuel Ruipérez-Campillo, Simon Böhi +6
Electrocardiograms (ECGs) are among the most widely available clinical signals and play a central role in cardiovascular diagnosis. While recent foundation models (FMs) have shown…
Models Designed to Forget: Machine Unlearning via Key Deletion
Sonia Laguna, Jorge da Silva Goncalves, Moritz Vandenhirtz +3
Machine unlearning for vision models is rapidly becoming a practical requirement, driven by privacy regulations, data errors, and the need to remove harmful or corrupted training i…
Reference-Guided Machine Unlearning
Jonas Mirlach, Sonia Laguna, Julia E. Vogt
Machine unlearning aims to remove the influence of specific training data from a model while preserving its general utility. In vision, many approximate unlearning methods pursue t…
Post-hoc Stochastic Concept Bottleneck Models
Wiktor Jan Hoffmann, Sonia Laguna, Moritz Vandenhirtz +2
Concept Bottleneck Models (CBMs) are interpretable models that predict the target variable through high-level human-understandable concepts, allowing users to intervene on mispredi…
Interpretable Reward Modeling with Active Concept Bottlenecks
Sonia Laguna, Katarzyna Kobalczyk, Julia E. Vogt +1
We introduce Concept Bottleneck Reward Models (CB-RM), a reward modeling framework that enables interpretable preference learning through selective concept annotation. Unlike stand…
Beyond Glucose-Only Assessment: Advancing Nocturnal Hypoglycemia Prediction in Children with Type 1 Diabetes
Marco Voegeli, Sonia Laguna, Heike Leutheuser +3
The dead-in-bed syndrome describes the sudden and unexplained death of young individuals with Type 1 Diabetes (T1D) without prior long-term complications. One leading hypothesis at…
Measuring Leakage in Concept-Based Methods: An Information Theoretic Approach
Mikael Makonnen, Moritz Vandenhirtz, Sonia Laguna +1
Concept Bottleneck Models (CBMs) aim to enhance interpretability by structuring predictions around human-understandable concepts. However, unintended information leakage, where pre…
Exploiting Interpretable Capabilities with Concept-Enhanced Diffusion and Prototype Networks
Alba Carballo-Castro, Sonia Laguna, Moritz Vandenhirtz +1
Concept-based machine learning methods have increasingly gained importance due to the growing interest in making neural networks interpretable. However, concept annotations are gen…
Towards Scalable Newborn Screening: Automated General Movement Assessment in Uncontrolled Settings
Daphné Chopard, Sonia Laguna, Kieran Chin-Cheong +4
General movements (GMs) are spontaneous, coordinated body movements in infants that offer valuable insights into the developing nervous system. Assessed through the Prechtl GM Asse…
Stochastic Concept Bottleneck Models
Moritz Vandenhirtz, Sonia Laguna, Ričards Marcinkevičs +1
Concept Bottleneck Models (CBMs) have emerged as a promising interpretable method whose final prediction is based on intermediate, human-understandable concepts rather than the raw…
Beyond Concept Bottleneck Models: How to Make Black Boxes Intervenable?
Sonia Laguna, Ričards Marcinkevičs, Moritz Vandenhirtz +1
Recently, interpretable machine learning has re-explored concept bottleneck models (CBM). An advantage of this model class is the user's ability to intervene on predicted concept v…