4 papers
Observing the Conduct of Systematic Reviews with Generative AI Support: An Experience Report from a Graduate Software Engineering Course
Danilo Monteiro Ribeiro, Gilberto Sussumu Hida
Context: Secondary studies are fundamental practices in Evidence- Based Software Engineering, but teaching them requires activities that expose students to authentic methodological…
Class Imbalance and Batch Effects in LLM-Based Screening for Systematic Reviews
Gilberto Sussumu Hida, Danilo Monteiro Ribeiro, Clayton Suguio Hida
This study analyses LLMs in imbalanced binary classification, using study screening in systematic reviews as the application domain. An experiment was conducted in five reviews, co…
What Does It Take to Research with AI? A Rapid Review of Competencies to Train LLM-Literate Researchers
Danilo Monteiro Ribeiro, Ronnie de Souza Santos, Rodrigo Siqueira +5
The growing adoption of Large Language Models in scientific research has created a need to understand what competencies researchers and graduate students require to use these tools…
Beyond Accuracy: LLM Variability in Evidence Screening for Software Engineering SLRs
Gilberto Sussumu Hida, Danilo Monteiro Ribeiro, Erika Yahata
Context: Study screening in systematic literature reviews is costly, inconsistency-prone, and risk-asymmetric, since false negatives can compromise validity. Despite rapid uptake o…