5 citations · 6 across the 2 of their papers we have counts for
4 papers
Implicit Unlikelihood Training: Improving Neural Text Generation with Reinforcement Learning
Evgeny Lagutin, Daniil Gavrilov, Pavel Kalaidin
Likelihood training and maximization-based decoding result in dull and repetitive generated texts even when using powerful language models (Holtzman et al., 2019). Adding a loss fu…
Reducing Unintended Identity Bias in Russian Hate Speech Detection
Nadezhda Zueva, Madina Kabirova, Pavel Kalaidin
Toxicity has become a grave problem for many online communities and has been growing across many languages, including Russian. Hate speech creates an environment of intimidation, d…
Weight Squeezing: Reparameterization for Knowledge Transfer and Model Compression
Artem Chumachenko, Daniil Gavrilov, Nikita Balagansky +1
In this work, we present a novel approach for simultaneous knowledge transfer and model compression called Weight Squeezing. With this method, we perform knowledge transfer from a…
Self-Attentive Model for Headline Generation
Daniil Gavrilov, Pavel Kalaidin, Valentin Malykh
Headline generation is a special type of text summarization task. While the amount of available training data for this task is almost unlimited, it still remains challenging, as le…