11 papers · 1 filter
Peer review should constrain evaluative authority
Hanrui Wang, Timo Spinde, Isabella Habereder +2
Our position shifts the target of peer-review reform from reducing uncertainty through evaluator improvement or judgment aggregation to constraining evaluative authority under pers…
The Landscape of Misinformation Literacy Games: A Systematic Mapping Review of Game Designs and Evaluation Practices
Omed Abed, Smi Hinterreiter, Sijia Guo +3
This systematic mapping review examines 54 gamified interventions aimed at combating misinformation. We analyze the theoretical frameworks, game design, and media contexts of acade…
HRGuard: Gating Relationship Manipulation in Multi-Turn Agentic AI Conversations
Pei-Sze Tan, Tasuku Igarashi, Isao Echizen
Agentic AI assistants are increasingly used in everyday life. However, they may also be misused to support harmful manipulation in interpersonal relationships. This problem is role…
When Trust Meets Truth: Trust-Truth Separability in LLM-as-Judge
Xin Sun, Di Wu, Yuchen Guo +4
LLM-as-Judge systems can produce multi-dimensional evaluations, such as trustworthiness, reliability, and factuality, and these outputs are often interpreted as independent evidenc…
Visual Indicators to Increase the Detection of Linguistic Media Bias
Smi Hinterreiter, Anna Chelsea Bahß, Ann-Christin Gah +3
The influence of linguistic bias in online news articles is a growing concern, particularly in the context of shaping public opinion and rising political polarization. While there…
Structural Under-Representation of Women in News: Nonparametric Bayesian Mixtures Capture Time-Dependent Dynamics
Isabella Habereder, Thomas Kneib, Isao Echizen +1
The under-representation of women as sources cited in news media is one prominent representation of gender bias. Understanding where gender bias concentrates and how it evolves is…
Agentic Relationship Harm: Benchmarking and Gating Relational Manipulation in AI Agents
Pei-Sze Tan, Tasuku Igarashi, Isao Echizen
AI agents built on large language models can assist not only legitimate tasks but also relational manipulation. AI agents can be used to help a user maintain a deceptive identity,…
Role-Aware Artificial Intelligence Across Augmentation and Automation in Human-Machine Symbiosis
Ching-Chun Chang, Yuchen Guo, Hanrui Wang +2
The evolution of artificial intelligence (AI) has rendered the boundary between humanity and computational machinery increasingly ambiguous. In the presence of more interwoven rela…
Label Effects: Shared Heuristic Reliance in Trust Assessment by Humans and LLM-as-a-Judge
Xin Sun, Di Wu, Sijing Qin +3
Large language models (LLMs) are increasingly used as automated evaluators (LLM-as-a-Judge). This work challenges its reliability by showing that trust judgments by LLMs are biased…
Eyes Can't Always Tell: Fusing Eye Tracking and User Priors for User Modeling under AI Advice Conditions
Xin Sun, Shu Wei, Ting Pan +5
Modeling users' cognitive states (e.g., cognitive load and decision confidence) is essential for building adaptive AI in high-stakes decision-making. While eye tracking provides no…
SciDef: Datasets and Tools for Automated Definition Extraction from Scientific Literature with LLMs
Filip Kučera, Christoph Mandl, Isao Echizen +2
Scientific concepts are often defined inconsistently across papers, making it difficult to compare findings, reuse terminology, and build reliable downstream resources. We present…