5 papers
The Evaluation Game: Beyond Static LLM Benchmarking
Paul Wang, Jade Garcia-Bourrée, Anne-Marie Kermarrec +1
As jailbreaks, adversarially crafted inputs that bypass safety constraints, continue to be discovered in Large Language Models, practitioners increasingly rely on fine-tuning as a…
Leveraging Imperfect Sources to Detect Fairwashing in Black-Box Auditing
Jade Garcia Bourrée, Erwan Le Merrer, Gilles Tredan +1
Algorithmic auditing has become central to platform accountability under frameworks such as the AI Act and the Digital Services Act. In practice, this obligation is discharged thro…
Fast In-Spectrum Graph Watermarks
Jade Garcia Bourrée, Anne-Marie Kermarrec, Erwan Le Merrer +1
We address the problem of watermarking graph objects, which consists in hiding information within them, to prove their origin. The two existing methods to watermark graphs use subg…
Robust ML Auditing using Prior Knowledge
Jade Garcia Bourrée, Augustin Godinot, Martijn De Vos +5
Among the many technical challenges to enforcing AI regulations, one crucial yet underexplored problem is the risk of audit manipulation. This manipulation occurs when a platform d…
P2NIA: Privacy-Preserving Non-Iterative Auditing
Jade Garcia Bourrée, Hadrien Lautraite, Sébastien Gambs +3
The emergence of AI legislation has increased the need to assess the ethical compliance of high-risk AI systems. Traditional auditing methods rely on platforms' application program…