5 papers · 1 filter
Float8@2bits: Entropy Coding Enables Data-Free Model Compression
Patrick Putzky, Martin Genzel, Mattes Mollenhauer +3
Post-training compression is currently divided into two contrasting regimes. On the one hand, fast, data-free, and model-agnostic methods (e.g., NF4 or HQQ) offer maximum accessibi…
Choose Your Model Size: Any Compression of Large Language Models Without Re-Computation
Martin Genzel, Patrick Putzky, Pengfei Zhao +5
The adoption of Foundation Models in resource-constrained environments remains challenging due to their large size and inference costs. A promising way to overcome these limitation…
Self-Distilled Representation Learning for Time Series
Felix Pieper, Konstantin Ditschuneit, Martin Genzel +2
Self-supervised learning for time-series data holds potential similar to that recently unleashed in Natural Language Processing and Computer Vision. While most existing works in th…
Curve Your Enthusiasm: Concurvity Regularization in Differentiable Generalized Additive Models
Julien Siems, Konstantin Ditschuneit, Winfried Ripken +4
Generalized Additive Models (GAMs) have recently experienced a resurgence in popularity due to their interpretability, which arises from expressing the target value as a sum of non…
AAPM DL-Sparse-View CT Challenge Submission Report: Designing an Iterative Network for Fanbeam-CT with Unknown Geometry
Martin Genzel, Jan Macdonald, Maximilian März
This report is dedicated to a short motivation and description of our contribution to the AAPM DL-Sparse-View CT Challenge (team name: "robust-and-stable"). The task is to recover…