30 citations · 30 across the 3 of their papers we have counts for
3 papers
Learning how to Forget: Fine-tuning for Long-Context Sparse Attention
Matthias Seeger, Zeyu Zhang, Vihang Patil +2
A lot of prior work addressed key-value (KV) cache selection and compression by sparse attention to enable long-context inference for transformer language models without excessive…
Hyperparameter Optimization in Machine Learning
Luca Franceschi, Michele Donini, Valerio Perrone +5
Hyperparameters are configuration variables controlling the behavior of machine learning algorithms. They are ubiquitous in machine learning and artificial intelligence and the cho…
Explaining Probabilistic Models with Distributional Values
Luca Franceschi, Michele Donini, Cédric Archambeau +1
A large branch of explainable machine learning is grounded in cooperative game theory. However, research indicates that game-theoretic explanations may mislead or be hard to interp…