Finnish Language Modeling with Deep Transformer Models

Abhilash Jain, Aku Ruohe, Stig-Arne Grönroos +1

Transformers have recently taken the center stage in language modeling after LSTM's were considered the dominant model architecture for a long time. In this project, we investigate…