5 papers
Revisiting "Revisiting Neuron Coverage for DNN Testing: A Layer-Wise and Distribution-Aware Criterion": A Critical Review and Implications on DNN Coverage Testing
Jinhan Kim, Nargiz Humbatova, Gunel Jahangirova +2
We present a critical review of Neural Coverage (NLC), a state-of-the-art DNN coverage criterion by Yuan et al. at ICSE 2023. While NLC proposes to satisfy eight design requirement…
Fault Localisation and Repair for DL Systems: An Empirical Study with LLMs
Jinhan Kim, Nargiz Humbatova, Gunel Jahangirova +2
Numerous Fault Localisation (FL) and repair techniques have been proposed to address faults in Deep Learning (DL) models. However, their effectiveness in practical applications rem…
MuFF: Stable and Sensitive Post-training Mutation Testing for Deep Learning
Jinhan Kim, Nargiz Humbatova, Gunel Jahangirova +2
Rapid adoptions of Deep Learning (DL) in a broad range of fields led to the development of specialised testing techniques for DL systems, including DL mutation testing. However, ex…
Real Faults in Deep Learning Fault Benchmarks: How Real Are They?
Gunel Jahangirova, Nargiz Humbatova, Jinhan Kim +2
As the adoption of Deep Learning (DL) systems continues to rise, an increasing number of approaches are being proposed to test these systems, localise faults within them, and repai…
An Empirical Study of Fault Localisation Techniques for Deep Learning
Nargiz Humbatova, Jinhan Kim, Gunel Jahangirova +2
With the increased popularity of Deep Neural Networks (DNNs), increases also the need for tools to assist developers in the DNN implementation, testing and debugging process. Sever…