5 papers
When Do Concepts Become Functionally Sufficient During Language-Model Training?
Raphael Bernas, Paul G. Chevalier, Fanny Jourdan +1
Understanding a model and its learning mechanisms in depth requires identifying when its internal structures become useful, rather than simply looking at the final state. We study…
Revisiting Anisotropy in Language Transformers: The Geometry of Learning Dynamics
Raphael Bernas, Fanny Jourdan, Antonin Poché +1
Since their introduction, Transformer architectures have dominated Natural Language Processing (NLP). However, recent research has highlighted an inherent anisotropy phenomenon in…
FairTranslate: An English-French Dataset for Gender Bias Evaluation in Machine Translation by Overcoming Gender Binarity
Fanny Jourdan, Yannick Chevalier, Cécile Favre
Large Language Models (LLMs) are increasingly leveraged for translation tasks but often fall short when translating inclusive language -- such as texts containing the singular 'the…
ConSim: Measuring Concept-Based Explanations' Effectiveness with Automated Simulatability
Antonin Poché, Alon Jacovi, Agustin Martin Picard +2
Concept-based explanations work by mapping complex model computations to human-understandable concepts. Evaluating such explanations is very difficult, as it includes not only the…
Advancing Fairness in Natural Language Processing: From Traditional Methods to Explainability
Fanny Jourdan
The burgeoning field of Natural Language Processing (NLP) stands at a critical juncture where the integration of fairness within its frameworks has become an imperative. This PhD t…