Showing cs.CLShow all
2 papers · 1 filter
cs.CL2024
Diagnosing Robotics Systems Issues with Large Language Models
Jordis Emilia Herrmann, Aswath Mandakath Gopinath, Mikael Norrlof +1
Quickly resolving issues reported in industrial applications is crucial to minimize economic impact. However, the required data analysis makes diagnosing the underlying root causes…
cs.CL2024
ConStat: Performance-Based Contamination Detection in Large Language Models
Jasper Dekoninck, Mark Niklas Müller, Martin Vechev
Public benchmarks play an essential role in the evaluation of large language models. However, data contamination can lead to inflated performance, rendering them unreliable for mod…