28 citations · 49 across the 17 of their papers we have counts for
4 papers · 1 filter
Emergent Structure in the Marginal Attention Space of Language Models
Valentino Maiorca, Walter Nelson, Francesco Locatello
While representation similarity across independently trained language models is well-documented, how internal mechanics such as attention behave across models remains far less char…
LocUS: Head Selection and Subspace Projection for Targeted Activation Steering
Irene Tallini, Lorenzo Basile, Valentino Maiorca +2
Activation steering is a powerful training-free paradigm for controlling large language models at inference time. However, standard approaches estimate a per-layer steering directi…
Accelerating Transformer Inference for Translation via Parallel Decoding
Andrea Santilli, Silvio Severino, Emilian Postolache +4
Autoregressive decoding limits the efficiency of transformers for Machine Translation (MT). The community proposed specific network architectures and learning-based methods to solv…
Attention-likelihood relationship in transformers
Valeria Ruscio, Valentino Maiorca, Fabrizio Silvestri
We analyze how large language models (LLMs) represent out-of-context words, investigating their reliance on the given context to capture their semantics. Our likelihood-guided text…