8 citations · 9 across the 6 of their papers we have counts for
4 papers · 1 filter
Don't be so Stief! Learning KV Cache low-rank approximation over the Stiefel manifold
Luca Benfenati, Matteo Risso, Andrea Vannozzi +5
Key-value (KV) caching enables fast autoregressive decoding but at long contexts becomes a dominant bottleneck in High Bandwidth Memory (HBM) capacity and bandwidth. A common mitig…
SINQ: Sinkhorn-Normalized Quantization for Calibration-Free Low-Precision LLM Weights
Lorenz K. Müller, Philippe Bich, Jiawei Zhuang +3
Post-training quantization has emerged as the most widely used strategy for deploying large language models at low precision. Still, current methods show perplexity degradation at…
BISeizuRe: BERT-Inspired Seizure Data Representation to Improve Epilepsy Monitoring
Luca Benfenati, Thorir Mar Ingolfsson, Andrea Cossettini +3
This study presents a novel approach for EEG-based seizure detection leveraging a BERT-based model. The model, BENDR, undergoes a two-phase training process. Initially, it is pre-t…
Foundation Models for Structural Health Monitoring
Luca Benfenati, Daniele Jahier Pagliari, Luca Zanatta +6
Structural Health Monitoring (SHM) is a critical task for ensuring the safety and reliability of civil infrastructures, typically realized on bridges and viaducts by means of vibra…