activity
20182026
most citedEmpirical Methodology for Crowdsourcing Ground Truth

8 citations · 29 across the 15 of their papers we have counts for

collaborators

16 papers

cs.IR2026

The Utility of LLMs in Recommender Systems Explanation Evaluation

Kathrin Wardatzky, Oana Inel, Luca Rossetto +1

Explanations play a crucial role in creating trustworthy recommender systems (RS), yet choosing a good explanation method presents challenges. Many explanation methods exist, but l…

cs.IR2025★ 4 cited

D-RDW: Diversity-Driven Random Walks for News Recommender Systems

Runze Li, Lucien Heitz, Oana Inel +1

This paper introduces Diversity-Driven RandomWalks (D-RDW), a lightweight algorithm and re-ranking technique that generates diverse news recommendations. D-RDW is a societal recomm…

cs.IR2025★ 2 cited

Informfully Recommenders -- Reproducibility Framework for Diversity-aware Intra-session Recommendations

Lucien Heitz, Runze Li, Oana Inel +1

Norm-aware recommender systems have gained increased attention, especially for diversity optimization. The recommender systems community has well-established experimentation pipeli…

cs.LG2025

From Seed to Harvest: Augmenting Human Creativity with AI for Red-teaming Text-to-Image Models

Jessica Quaye, Charvi Rastogi, Alicia Parrish +4

Text-to-image (T2I) models have become prevalent across numerous applications, making their robust evaluation against adversarial attacks a critical priority. Continuous access to…

cs.HC2024★ 1 cited

Whom do Explanations Serve? A Systematic Literature Survey of User Characteristics in Explainable Recommender Systems Evaluation

Kathrin Wardatzky, Oana Inel, Luca Rossetto +1

Adding explanations to recommender systems is said to have multiple benefits, such as increasing user trust or system transparency. Previous work from other application areas sugge…

cs.CV2024

Aligning Object Detector Bounding Boxes with Human Preference

Ombretta Strafforello, Osman S. Kayhan, Oana Inel +2

Previous work shows that humans tend to prefer large bounding boxes over small bounding boxes with the same IoU. However, we show here that commonly used object detectors predict l…

cs.CV2024

DWARF: Disease-weighted network for attention map refinement

Haozhe Luo, Aurélie Pahud de Mortanges, Oana Inel +2

The interpretability of deep learning is crucial for evaluating the reliability of medical imaging models and reducing the risks of inaccurate patient recommendations. This study a…

cs.CY2024

Adversarial Nibbler: An Open Red-Teaming Method for Identifying Diverse Harms in Text-to-Image Generation

Jessica Quaye, Alicia Parrish, Oana Inel +12

With the rise of text-to-image (T2I) generative AI models reaching wide audiences, it is critical to evaluate model robustness against non-obvious attacks to mitigate the generatio…

cs.LG2023★ 1 cited

Collect, Measure, Repeat: Reliability Factors for Responsible AI Data Collection

Oana Inel, Tim Draws, Lora Aroyo

The rapid entry of machine learning approaches in our daily activities and high-stakes domains demands transparency and scrutiny of their fairness and reliability. To help gauge ma…

cs.LG2023★ 3 cited

Adversarial Nibbler: A Data-Centric Challenge for Improving the Safety of Text-to-Image Models

Alicia Parrish, Hannah Rose Kirk, Jessica Quaye +10

The generative AI revolution in recent years has been spurred by an expansion in compute power and data quantity, which together enable extensive pre-training of powerful text-to-i…

cs.CV2022

Humans disagree with the IoU for measuring object detector localization error

Ombretta Strafforello, Vanathi Rajasekart, Osman S. Kayhan +2

The localization quality of automatic object detectors is typically evaluated by the Intersection over Union (IoU) score. In this work, we show that humans have a different view on…

cs.IR2021

Operationalizing Framing to Support Multiperspective Recommendations of Opinion Pieces

Mats Mulder, Oana Inel, Jasper Oosterman +1

Diversity in personalized news recommender systems is often defined as dissimilarity, and based on topic diversity (e.g., corona versus farmers strike). Diversity in news media, ho…

cs.HC2020

Eliciting User Preferences for Personalized Explanations for Video Summaries

Oana Inel, Nava Tintarev, Lora Aroyo

Video summaries or highlights are a compelling alternative for exploring and contextualizing unprecedented amounts of video material. However, the summarization process is commonly…

cs.CV2019★ 2 cited

A Survey of Crowdsourcing in Medical Image Analysis

Silas Ørting, Andrew Doyle, Arno van Hilten +6

Rapid advances in image processing capabilities have been seen across many domains, fostered by the application of machine learning algorithms to "big-data". However, within the re…

cs.HC2018★ 8 cited

Empirical Methodology for Crowdsourcing Ground Truth

Anca Dumitrache, Oana Inel, Benjamin Timmermans +4

The process of gathering ground truth data through human annotation is a major bottleneck in the use of information extraction methods for populating the Semantic Web. Crowdsourcin…

cs.HC2018★ 8 cited

CrowdTruth 2.0: Quality Metrics for Crowdsourcing with Disagreement

Anca Dumitrache, Oana Inel, Lora Aroyo +2

Typically crowdsourcing-based approaches to gather annotated data use inter-annotator agreement as a measure of quality. However, in many domains, there is ambiguity in the data, a…