1 citations · 1 across the 7 of their papers we have counts for
4 papers · 1 filter
When Knowledge Changes: Metamorphic Testing of RAG Systems with Mutations
Jinhan Kim, Samuele Pasini, Paolo Tonella
Retrieval-Augmented Generation (RAG)-based LLM systems rely on external document corpora that can evolve and change over time. However, current evaluation methodologies (e.g., RAGA…
Testing Retrieval-Augmented Generation Systems with Chunk Coverage
Jinhan Kim, Samuele Pasini, Paolo Tonella
Retrieval-Augmented Generation (RAG)-based systems\footnote{For brevity, RAG-based systems are referred to as RAG systems throughout this paper.} are increasingly deployed in high-…
Detecting Trojaned DNNs via Spectral Regression Analysis
Samuele Pasini, Jinhan Kim, Paolo Tonella
Modern DNNs are repeatedly fine-tuned to incorporate new data and functionality. This evolutionary workflow introduces a security risk when updated data cannot be fully trusted, as…
DeepTest Tool Competition 2026: Benchmarking an LLM-Based Automotive Assistant
Lev Sorokin, Ivan Vasilev, Samuele Pasini
This report summarizes the results of the first edition of the Large Language Model (LLM) Testing competition, held as part of the DeepTest workshop at ICSE 2026. Four tools compet…