23 citations · 23 across the 7 of their papers we have counts for
5 papers · 1 filter
Steering Vectors are an Adversarial Attack Surface
Abzal Aidakhmetov, Donato Crisostomi, Tommaso Mencattini +3
Activation steering has become a popular way to control Large Language Model (LLM) behavior without fine-tuning. Since the technique is plug-and-play, users share datasets and prec…
Model Merging: Foundations and Algorithms
Donato Crisostomi
Modern deep learning usually treats models as separate artifacts: trained independently, specialized for particular purposes, and replaced when improved versions appear. This thesi…
Model Merging Improves Zero-Shot Generalization in Bioacoustic Foundation Models
Davide Marincione, Donato Crisostomi, Roberto Dessi +2
Foundation models capable of generalizing across species and tasks represent a promising new frontier in bioacoustics, with NatureLM being one of the most prominent examples. While…
MASS: MoErging through Adaptive Subspace Selection
Donato Crisostomi, Alessandro Zirilli, Antonio Andrea Gargiulo +5
Model merging has recently emerged as a lightweight alternative to ensembling, combining multiple fine-tuned models into a single set of parameters with no additional training over…
Humanity's Last Exam
Long Phan, Alice Gatti, Ziwen Han +1168
Benchmarks are important tools for tracking the rapid advancements in large language model (LLM) capabilities. However, benchmarks are not keeping pace in difficulty: LLMs now achi…