3 papers
cs.CL2021
On Isotropy Calibration of Transformers
Yue Ding, Karolis Martinkus, Damian Pascual +2
Different studies of the embedding space of transformer models suggest that the distribution of contextual representations is highly anisotropic - the embeddings are distributed in…
cs.CL2018
Imitation Learning for Neural Morphological String Transduction
Peter Makarov, Simon Clematide
We employ imitation learning to train a neural transition-based string transducer for morphological tasks such as inflection generation and lemmatization. Previous approaches to tr…
cs.CL2017
Align and Copy: UZH at SIGMORPHON 2017 Shared Task for Morphological Reinflection
Peter Makarov, Tatiana Ruzsics, Simon Clematide
This paper presents the submissions by the University of Zurich to the SIGMORPHON 2017 shared task on morphological reinflection. The task is to predict the inflected form given a…