activity
20182024
most citedAttention in Natural Language Processing

645 citations · 876 across the 11 of their papers we have counts for

collaborators
Showing cs.CLShow all

6 papers · 1 filter

cs.CL2024★ 10 cited

Fast Vocabulary Transfer for Language Model Compression

Leonidas Gee, Andrea Zugarini, Leonardo Rigutini +1

Real-world business applications require a trade-off between language model performance and size. We propose a new method for model compression that relies on vocabulary transfer.…

cs.CL2021★ 1 cited

Combining Transformers with Natural Language Explanations

Federico Ruggeri, Marco Lippi, Paolo Torroni

Many NLP applications require models to be interpretable. However, many successful neural architectures, including transformers, still lack effective interpretation methods. A poss…

cs.CL2021★ 2 cited

Tree-Constrained Graph Neural Networks For Argument Mining

Federico Ruggeri, Marco Lippi, Paolo Torroni

We propose a novel architecture for Graph Neural Networks that is inspired by the idea behind Tree Kernels of measuring similarity between trees by taking into account their common…

cs.CL2021★ 17 cited

An Argumentative Dialogue System for COVID-19 Vaccine Information

Bettina Fazzinga, Andrea Galassi, Paolo Torroni

Dialogue systems are widely used in AI to support timely and interactive communication with users. We propose a general-purpose dialogue system architecture that leverages computat…

cs.CL2021★ 16 cited

Multi-Task Attentive Residual Networks for Argument Mining

Andrea Galassi, Marco Lippi, Paolo Torroni

We explore the use of residual networks and neural attention for multiple argument mining tasks. We propose a residual architecture that exploits attention, multi-task learning, an…

cs.CL2019★ 645 cited

Attention in Natural Language Processing

Andrea Galassi, Marco Lippi, Paolo Torroni

Attention is an increasingly popular mechanism used in a wide range of neural architectures. The mechanism itself has been realized in a variety of formats. However, because of the…