15 papers
Peer review should constrain evaluative authority
Hanrui Wang, Timo Spinde, Isabella Habereder +2
Our position shifts the target of peer-review reform from reducing uncertainty through evaluator improvement or judgment aggregation to constraining evaluative authority under pers…
The Landscape of Misinformation Literacy Games: A Systematic Mapping Review of Game Designs and Evaluation Practices
Omed Abed, Smi Hinterreiter, Sijia Guo +3
This systematic mapping review examines 54 gamified interventions aimed at combating misinformation. We analyze the theoretical frameworks, game design, and media contexts of acade…
HRGuard: Gating Relationship Manipulation in Multi-Turn Agentic AI Conversations
Pei-Sze Tan, Tasuku Igarashi, Isao Echizen
Agentic AI assistants are increasingly used in everyday life. However, they may also be misused to support harmful manipulation in interpersonal relationships. This problem is role…
When Trust Meets Truth: Trust-Truth Separability in LLM-as-Judge
Xin Sun, Di Wu, Yuchen Guo +4
LLM-as-Judge systems can produce multi-dimensional evaluations, such as trustworthiness, reliability, and factuality, and these outputs are often interpreted as independent evidenc…
Visual Indicators to Increase the Detection of Linguistic Media Bias
Smi Hinterreiter, Anna Chelsea Bahß, Ann-Christin Gah +3
The influence of linguistic bias in online news articles is a growing concern, particularly in the context of shaping public opinion and rising political polarization. While there…
Structural Under-Representation of Women in News: Nonparametric Bayesian Mixtures Capture Time-Dependent Dynamics
Isabella Habereder, Thomas Kneib, Isao Echizen +1
The under-representation of women as sources cited in news media is one prominent representation of gender bias. Understanding where gender bias concentrates and how it evolves is…
Agentic Relationship Harm: Benchmarking and Gating Relational Manipulation in AI Agents
Pei-Sze Tan, Tasuku Igarashi, Isao Echizen
AI agents built on large language models can assist not only legitimate tasks but also relational manipulation. AI agents can be used to help a user maintain a deceptive identity,…
Role-Aware Artificial Intelligence Across Augmentation and Automation in Human-Machine Symbiosis
Ching-Chun Chang, Yuchen Guo, Hanrui Wang +2
The evolution of artificial intelligence (AI) has rendered the boundary between humanity and computational machinery increasingly ambiguous. In the presence of more interwoven rela…
Label Effects: Shared Heuristic Reliance in Trust Assessment by Humans and LLM-as-a-Judge
Xin Sun, Di Wu, Sijing Qin +3
Large language models (LLMs) are increasingly used as automated evaluators (LLM-as-a-Judge). This work challenges its reliability by showing that trust judgments by LLMs are biased…
Eyes Can't Always Tell: Fusing Eye Tracking and User Priors for User Modeling under AI Advice Conditions
Xin Sun, Shu Wei, Ting Pan +5
Modeling users' cognitive states (e.g., cognitive load and decision confidence) is essential for building adaptive AI in high-stakes decision-making. While eye tracking provides no…
SciDef: Datasets and Tools for Automated Definition Extraction from Scientific Literature with LLMs
Filip Kučera, Christoph Mandl, Isao Echizen +2
Scientific concepts are often defined inconsistently across papers, making it difficult to compare findings, reuse terminology, and build reliable downstream resources. We present…
A Systematic Review of Spatio-Temporal Statistical Models: Theory, Structure, and Applications
Isabella Habereder, Thomas Kneib, Isao Echizen +1
Data with spatio-temporal attributes are prevalent across many research fields, and statistical models for analyzing spatio-temporal relationships are widely used. Existing reviews…
Leveraging Large Language Models for Automated Definition Extraction with TaxoMatic A Case Study on Media Bias
Timo Spinde, Luyang Lin, Smi Hinterreiter +1
This paper introduces TaxoMatic, a framework that leverages large language models to automate definition extraction from academic literature. Focusing on the media bias domain, the…
NewsUnfold: Creating a News-Reading Application That Indicates Linguistic Media Bias and Collects Feedback
Smi Hinterreiter, Martin Wessel, Fabian Schliski +3
Media bias is a multifaceted problem, leading to one-sided views and impacting decision-making. A way to address digital media bias is to detect and indicate it automatically throu…
News Ninja: Gamified Annotation of Linguistic Bias in Online News
Smi Hinterreiter, Timo Spinde, Sebastian Oberdörfer +2
Recent research shows that visualizing linguistic bias mitigates its negative effects. However, reliable automatic detection methods to generate such visualizations require costly,…