2 papers
cs.CL2022
Do Vision-and-Language Transformers Learn Grounded Predicate-Noun Dependencies?
Mitja Nikolaus, Emmanuelle Salin, Stephane Ayache +2
Recent advances in vision-and-language modeling have seen the development of Transformer architectures that achieve remarkable performance on multimodal reasoning tasks. Yet, the e…
cs.CL2020
Masked ELMo: An evolution of ELMo towards fully contextual RNN language models
Gregory Senay, Emmanuelle Salin
This paper presents Masked ELMo, a new RNN-based model for language model pre-training, evolved from the ELMo language model. Contrary to ELMo which only uses independent left-to-r…