6 papers
The Geometry of Creative Variability: How Credal Sets Expose Calibration Gaps in Language Models
Esteban Garces Arias, Julian Rodemann, Christian Heumann
Understanding uncertainty in large language models remains a fundamental challenge, particularly in creative tasks where multiple valid outputs exist. We present a geometric framew…
GUARD: Glocal Uncertainty-Aware Robust Decoding for Effective and Efficient Open-Ended Text Generation
Yuanhao Ding, Esteban Garces Arias, Meimingwei Li +6
Open-ended text generation faces a critical challenge: balancing coherence with diversity in LLM outputs. While contrastive search-based decoding strategies have emerged to address…
Statistical Multicriteria Evaluation of LLM-Generated Text
Esteban Garces Arias, Hannah Blocher, Julian Rodemann +2
Assessing the quality of LLM-generated text remains a fundamental challenge in natural language processing. Current evaluation approaches often rely on isolated metrics or simplist…
Unveiling Factors for Enhanced POS Tagging: A Study of Low-Resource Medieval Romance Languages
Matthias Schöffel, Esteban Garces Arias, Marinus Wiedner +4
Part-of-speech (POS) tagging remains a foundational component in natural language processing pipelines, particularly critical for historical text analysis at the intersection of co…
Modern Models, Medieval Texts: A POS Tagging Study of Old Occitan
Matthias Schöffel, Marinus Wiedner, Esteban Garces Arias +3
Large language models (LLMs) have demonstrated remarkable capabilities in natural language processing, yet their effectiveness in handling historical languages remains largely unex…
A Statistical Case Against Empirical Human-AI Alignment
Julian Rodemann, Esteban Garces Arias, Christoph Luther +2
Empirical human-AI alignment aims to make AI systems act in line with observed human behavior. While noble in its goals, we argue that empirical alignment can inadvertently introdu…