5 citations · 5 across the 2 of their papers we have counts for
2 papers
cs.CL2022
Small Batch Sizes Improve Training of Low-Resource Neural MT
Àlex R. Atrio, Andrei Popescu-Belis
We study the role of an essential hyper-parameter that governs the training of Transformers for neural machine translation in a low-resource setting: the batch size. Using theoreti…
cs.CL2019★ 5 cited
On the Effect of Word Order on Cross-lingual Sentiment Analysis
Àlex R. Atrio, Toni Badia, Jeremy Barnes
Current state-of-the-art models for sentiment analysis make use of word order either explicitly by pre-training on a language modeling objective or implicitly by using recurrent ne…