1 citations · 2 across the 11 of their papers we have counts for
12 papers
Cross-Architecture Foundation-Model Distillation for Edge Flood Segmentation
Fabian Schmalstieg, Karsten Mueller, Wojciech Samek
Geospatial foundation models can provide strong flood-segmentation performance, but their size limits deployment on memory-constrained edge hardware. We distill a 300-million-param…
A Privacy Study of Sparse Collaborative Inference
Maximilian Andreas Hoefler, Karsten Mueller, Wojciech Samek
Collaborative inference (CI) splits a model between an edge device and a server, whereby the client computes an intermediate activation, transmits it, and the server completes the…
Collaborative Synthetic Data Generation for Knowledge Transfer in Federated Learning
Maximilian Andreas Hoefler, Karsten Mueller, Wojciech Samek
One-shot federated learning (OSFL) addresses the communication overhead of federated learning by limiting training to a single round, but doing so without sacrificing model quality…
FedXDS: Leveraging Model Attribution Methods to counteract Data Heterogeneity in Federated Learning
Maximilian Andreas Hoefler, Karsten Mueller, Wojciech Samek
Explainable AI (XAI) methods have demonstrated significant success in recent years at identifying relevant features in input data that drive deep learning model decisions, enhancin…
INDEQS: Informed Neural controlled Differential EQuationS
Michael Detzel, Gabriel Nobis, Kristiyan Blagov +4
Neural Controlled Differential Equations (NCDE) provide a powerful continuous-time framework for forecasting time series, but standard graph-based extensions typically learn spatia…
Activation- and Influence-Aware Ranks (AIR): Function-Preserving SVD Compression for LLMs
Nico Harder, Daniel Becking, Karsten Mueller +1
We present Activation- and Influence-Aware Ranks (AIR), an SVD-based LLM compression framework that guides each weight matrix's low-rank approximation with a backward-signal influe…
Knowledge-Free Correlated Agreement for Incentivizing Federated Learning
Leon Witt, Togrul Abbasli, Kentaroh Toyoda +2
We introduce Knowledge-Free Correlated Agreement (KFCA) to reward client contributions in federated learning (FL) without relying on ground truth, a public test set, or distributio…
Democratizing Federated Learning with Blockchain and Multi-Task Peer Prediction
Leon Witt, Kentaroh Toyoda, Wojciech Samek +1
The synergy between Federated Learning and blockchain has been considered promising; however, the computationally intensive nature of contribution measurement conflicts with the st…
Efficient Federated Learning Tiny Language Models for Mobile Network Feature Prediction
Daniel Becking, Ingo Friese, Karsten Müller +4
In telecommunications, Autonomous Networks (ANs) automatically adjust configurations based on specific requirements (e.g., bandwidth) and available resources. These networks rely o…
ReReLRP -- Remembering and Recognizing Tasks with LRP
Karolina Bogacka, Maximilian Höfler, Maria Ganzha +2
Deep neural networks have revolutionized numerous research fields and applications. Despite their widespread success, a fundamental limitation known as catastrophic forgetting rema…
Optimizing Federated Learning by Entropy-Based Client Selection
Andreas Lutz, Gabriele Steidl, Karsten Müller +1
Although deep learning has revolutionized domains such as natural language processing and computer vision, its dependence on centralized datasets raises serious privacy concerns. F…
XAI-guided Insulator Anomaly Detection for Imbalanced Datasets
Maximilian Andreas Hoefler, Karsten Mueller, Wojciech Samek
Power grids serve as a vital component in numerous industries, seamlessly delivering electrical energy to industrial processes and technologies, making their safe and reliable oper…