60 citations · 62 across the 4 of their papers we have counts for
5 papers
Local Structure Matters Most in Most Languages
Louis Clouâtre, Prasanna Parthasarathi, Amal Zouaq +1
Many recent perturbation studies have found unintuitive results on what does and does not matter when performing Natural Language Understanding (NLU) tasks in English. Coding prope…
Detecting Languages Unintelligible to Multilingual Models through Local Structure Probes
Louis Clouâtre, Prasanna Parthasarathi, Amal Zouaq +1
Providing better language tools for low-resource and endangered languages is imperative for equitable growth. Recent progress with massively multilingual pretrained models has prov…
Local Structure Matters Most: Perturbation Study in NLU
Louis Clouatre, Prasanna Parthasarathi, Amal Zouaq +1
Recent research analyzing the sensitivity of natural language understanding models to word-order perturbations has shown that neural models are surprisingly insensitive to the orde…
MLMLM: Link Prediction with Mean Likelihood Masked Language Model
Louis Clouatre, Philippe Trempe, Amal Zouaq +1
Knowledge Bases (KBs) are easy to query, verifiable, and interpretable. They however scale with man-hours and high-quality data. Masked Language Models (MLMs), such as BERT, scale…
FIGR: Few-shot Image Generation with Reptile
Louis Clouâtre, Marc Demers
Generative Adversarial Networks (GAN) boast impressive capacity to generate realistic images. However, like much of the field of deep learning, they require an inordinate amount of…