8 citations · 17 across the 9 of their papers we have counts for
8 papers · 1 filter
Chunk-based Nearest Neighbor Machine Translation
Pedro Henrique Martins, Zita Marinho, André F. T. Martins
Semi-parametric models, which augment generation with retrieval, have led to impressive results in language modeling and machine translation, due to their ability to retrieve fine-…
Efficient Machine Translation Domain Adaptation
Pedro Henrique Martins, Zita Marinho, André F. T. Martins
Machine translation models struggle when translating out-of-domain text, which makes domain adaptation a topic of critical importance. However, most domain adaptation methods focus…
-former: Infinite Memory Transformer
Pedro Henrique Martins, Zita Marinho, André F. T. Martins
Transformers are unable to model long-term memories effectively, since the amount of computation they need to perform grows with the context length. While variations of efficient t…
Priberam at MESINESP Multi-label Classification of Medical Texts Task
Ruben Cardoso, Zita Marinho, Afonso Mendes +1
Medical articles provide current state of the art treatments and diagnostics to many medical practitioners and professionals. Existing public databases such as MEDLINE contain over…
Sparse Text Generation
Pedro Henrique Martins, Zita Marinho, André F. T. Martins
Current state-of-the-art text generators build on powerful language models such as GPT-2, achieving impressive performance. However, to avoid degenerate text, they require sampling…
Sparse and Structured Visual Attention
Pedro Henrique Martins, Vlad Niculae, Zita Marinho +1
Visual attention mechanisms are widely used in multimodal tasks, as visual question answering (VQA). One drawback of softmax-based attention mechanisms is that they assign some pro…