5 papers
Metamorphic Testing with the Rashomon Set: Explanation Faithfulness in Machine Learning
Helge Spieker, Jørn Eirik Betten, Arnaud Gotlieb
Multiple machine learning models can achieve near-equivalent predictive performance on the same task, yet provide divergent feature-based explanations. This is called the Rashomon…
Translating the Rashomon Effect to Sequential Decision-Making Tasks
Dennis Gross, Jørn Eirik Betten, Helge Spieker
The Rashomon effect describes the phenomenon where multiple models trained on the same data produce identical predictions while differing in which features they rely on internally.…
Prompting for Performance: Exploring LLMs for Configuring Software
Helge Spieker, Théo Matricon, Nassim Belmecheri +7
Software systems usually provide numerous configuration options that can affect performance metrics such as execution time, memory usage, binary size, or bitrate. On the one hand,…
Rashomon in the Streets: Explanation Ambiguity in Scene Understanding
Helge Spieker, Jørn Eirik Betten, Arnaud Gotlieb +2
Explainable AI (XAI) is essential for validating and trusting models in safety-critical applications like autonomous driving. However, the reliability of XAI is challenged by the R…
Reusable Test Suites for Reinforcement Learning
Jørn Eirik Betten, Quentin Mazouni, Dennis Gross +2
Reinforcement learning (RL) agents show great promise in solving sequential decision-making tasks. However, validating the reliability and performance of the agent policies' behavi…