2 citations · 2 across the 4 of their papers we have counts for
5 papers · 1 filter
SHq: Learnable Grids for LLM Weight Quantization
Michael Helcig, Earl Killian, Dan Alistarh
Block-scaled lookup-table (LUT) formats, which represent weights as indices into a small value set (the grid), have become standard for low-bit LLM quantization, ranging from NF4 a…
Self-Repulsive Sampling for Diffusion Language Models
Michael Helcig, Martin Jaggi
Sampling several responses and voting over their answers can improve a language model's accuracy, but repeated answers limit the benefit of additional samples. Raising temperature…
Model Compression with Exact Budget Constraints via Riemannian Manifolds
Michael Helcig, Dan Alistarh
Assigning one of K options to each of N groups under a total cost budget is a recurring problem in efficient AI, arising in mixed-precision quantization, non-uniform pruning, and e…
Statistically-Lossless Quantization of Large Language Models
Michael Helcig, Eldar Kurtic, Dan Alistarh
Model quantization has become essential for efficient large language model deployment, yet existing approaches present clear trade-offs: methods such as GPTQ and AWQ achieve practi…
FedCCL: Federated Clustered Continual Learning Framework for Privacy-focused Energy Forecasting
Michael A. Helcig, Stefan Nastic
Privacy-preserving distributed model training is crucial for modern machine learning applications, yet existing Federated Learning approaches struggle with heterogeneous data distr…