TiME: Tiny Monolingual Encoders for Efficient NLP Pipelines

David Schulmeister, Valentin Hartmann, Lars Klein +1

Today, a lot of research on language models is focused on large, general-purpose models. However, many NLP pipelines only require models with a well-defined, small set of capabilit…