11 citations · 20 across the 8 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CL2021
Structural analysis of an all-purpose question answering model
Vincent Micheli, Quentin Heinrich, François Fleuret +1
Attention is a key component of the now ubiquitous pre-trained language models. By learning to focus on relevant pieces of information, these Transformer-based architectures have p…
cs.CL2021
Language Models are Few-Shot Butlers
Vincent Micheli, François Fleuret
Pretrained language models demonstrate strong performance in most NLP tasks when fine-tuned on small task-specific datasets. Hence, these autoregressive models constitute ideal age…