44 citations
- Centre National de la Recherche ScientifiqueFR6 papers
- École Normale Supérieure - PSLFR5 papers
- Université Sorbonne NouvelleFR5 papers
- Sorbonne Paris CitéFR4 papers
- Modèles Dynamiques CorpusFR3 papers
- École Normale SupérieureBI2 papers
- Lattice Semiconductor (United States)US2 papers
- Université Paris CitéFR2 papers
- Université Paris NanterreFR2 papers
- Université Paris Sciences et LettresFR2 papers
- University of PisaIT2 papers
- Brigham Young UniversityUS1 paper
Showing 2022Show all
2 papers · 1 filter
cs.CL2022★ 1 cited
Word Order Matters when you Increase Masking
Karim Lasri, Alessandro Lenci, Thierry Poibeau
Word order, an essential property of natural languages, is injected in Transformer-based neural language models using position encoding. However, recent experiments have shown that…
cs.CL2022★ 29 cited
Probing for the Usage of Grammatical Number
Karim Lasri, Tiago Pimentel, Alessandro Lenci +2
A central quest of probing is to uncover how pre-trained models encode a linguistic property within their representations. An encoding, however, might be spurious-i.e., the model m…