7 citations · 11 across the 6 of their papers we have counts for
4 papers · 1 filter
Directed Beam Search: Plug-and-Play Lexically Constrained Language Generation
Damian Pascual, Beni Egressy, Florian Bolli +1
Large pre-trained language models are capable of generating realistic text. However, controlling these models so that the generated text satisfies lexical constraints, i.e., contai…
Brain2Word: Decoding Brain Activity for Language Generation
Nicolas Affolter, Beni Egressy, Damian Pascual +1
Brain decoding, understood as the process of mapping brain activities to the stimuli that generated them, has been an active research area in the last years. In the case of languag…
Medley2K: A Dataset of Medley Transitions
Lukas Faber, Sandro Luck, Damian Pascual +3
The automatic generation of medleys, i.e., musical pieces formed by different songs concatenated via smooth transitions, is not well studied in the current literature. To facilitat…
Telling BERT's full story: from Local Attention to Global Aggregation
Damian Pascual, Gino Brunner, Roger Wattenhofer
We take a deep look into the behavior of self-attention heads in the transformer architecture. In light of recent work discouraging the use of attention distributions for explainin…