42 papers
Reliability Scaling Laws for Quantized Large Language Models
Sirine Ayadi, Sándor Daróczi, Stephan Günnemann +1
Quantization is a powerful strategy to build capable and resource-efficient large language models (LLMs) by reducing the bitwidth of the parameters. While quantized LLMs achieve st…
Predictive Feature Caching for Training-free Acceleration of Molecular Geometry Generation
Johanna Sommer, John Rachwan, Nils Fleischmann +2
Flow matching models generate high-fidelity molecular geometries but incur significant computational costs during inference, requiring hundreds of network evaluations. This inferen…
Model Collapse Is Not a Bug but a Feature in Machine Unlearning for LLMs
Yan Scholten, Sophie Xhonneux, Leo Schwinn +1
Current unlearning methods for LLMs optimize on the private information they seek to remove by incorporating it into their fine-tuning data. We argue this not only risks reinforcin…
Black-box, Adaptive, Efficient, Transferable, Harmful, Applicable... Attacks Are All You Need to Break LLMs
Vincent Limbach, Jonas Dornbusch, David Lüdke +2
Accurately evaluating adversarial robustness is a longstanding challenge. A flawed attack design can inflate robustness estimates, making deployment risk assessment and defense com…
Byte Pair Encoding for Efficient Time Series Forecasting
Leon Götz, Marcel Kollovieh, Stephan Günnemann +1
Existing time series tokenization methods predominantly encode a constant number of samples into individual tokens. This inflexible approach can generate excessive tokens for even…
Flow-Based Density Ratio Estimation for Intractable Distributions with Applications in Genomics
Egor Antipov, Alessandro Palma, Lorenzo Consoli +3
Estimating density ratios between pairs of intractable data distributions is a core problem in probabilistic modeling, enabling principled comparisons of sample likelihoods under d…