2 papers
cs.AI2026
The Consensus Trap: Dissecting Subjectivity and the "Ground Truth" Illusion in Data Annotation
Sheza Munir, Benjamin Mah, Krisha Kalsi +5
In machine learning, "ground truth" refers to the assumed correct labels used to train and evaluate models. However, the foundational "ground truth" paradigm rests on a positivisti…
cs.SE2024
Impact of LLM-based Review Comment Generation in Practice: A Mixed Open-/Closed-source User Study
Doriane Olewicki, Leuson Da Silva, Suhaib Mujahid +6
We conduct a large-scale empirical user study in a live setup to evaluate the acceptance of LLM-generated comments and their impact on the review process. This user study was perfo…