2 citations · 4 across the 4 of their papers we have counts for
5 papers
Has LLM Screening Performance Stalled in Software Engineering Systematic Reviews?
Aleksi Huotala, Miikka Kuutila, Mika Mäntylä
Screening in systematic reviews (SRs) is manual and time-consuming. Prior work has explored large language models (LLMs) for automating this step, but LLMs are evolving rapidly, so…
AISysRev -- LLM-based Tool for Title-abstract Screening
Aleksi Huotala, Miikka Kuutila, Olli-Pekka Turtio +2
Conducting systematic reviews is laborious. In the screening or study selection phase, the number of papers can be overwhelming. Recent research has demonstrated that large languag…
SESR-Eval: Dataset for Evaluating LLMs in the Title-Abstract Screening of Systematic Reviews
Aleksi Huotala, Miikka Kuutila, Mika Mäntylä
Background: The use of large language models (LLMs) in the title-abstract screening process of systematic reviews (SRs) has shown promising results, but suffers from limited perfor…
Research Artifacts in Secondary Studies: A Systematic Mapping in Software Engineering
Aleksi Huotala, Miikka Kuutila, Mika Mäntylä
Context: Systematic reviews (SRs) summarize state-of-the-art evidence in science, including software engineering (SE). Objective: Our objective is to evaluate how SRs report resear…
The Promise and Challenges of Using LLMs to Accelerate the Screening Process of Systematic Reviews
Aleksi Huotala, Miikka Kuutila, Paul Ralph +1
Systematic review (SR) is a popular research method in software engineering (SE). However, conducting an SR takes an average of 67 weeks. Thus, automating any step of the SR proces…