7 papers
Self-Calibrating Language Models via Test-Time Discriminative Distillation
Mohamed Rissal Hedna, Jan Strich, Martin Semmann +1
Large language models (LLMs) are systematically overconfident: they routinely express high certainty on questions they often answer incorrectly. Existing calibration methods either…
EncouRAGe: Evaluating RAG Local, Fast, and Reliable
Jan Strich, Adeline Scharfenberg, Chris Biemann +1
We introduce EncouRAGe, a comprehensive Python framework designed to streamline the development and evaluation of Retrieval-Augmented Generation (RAG) systems using Large Language…
HatePRISM: Policies, Platforms, and Research Integration. Advancing NLP for Hate Speech Proactive Mitigation
Naquee Rizwan, Seid Muhie Yimam, Daryna Dementieva +11
Despite regulations imposed by nations and social media platforms, e.g. (Government of India, 2021; European Parliament and Council of the European Union, 2022), inter alia, hatefu…
FASCIST-O-METER: Classifier for Neo-fascist Discourse Online
Rudy Alexandro Garrido Veliz, Martin Semmann, Chris Biemann +1
Neo-fascism is a political and societal ideology that has been having remarkable growth in the last decade in the United States of America (USA), as well as in other Western societ…
T-RAGBench: Text-and-Table Benchmark for Evaluating Retrieval-Augmented Generation
Jan Strich, Enes Kutay Isgorur, Maximilian Trescher +2
Since many real-world documents combine textual and tabular data, robust Retrieval Augmented Generation (RAG) systems are essential for effectively accessing and analyzing such con…
CollEX -- A Multimodal Agentic RAG System Enabling Interactive Exploration of Scientific Collections
Florian Schneider, Narges Baba Ahmadi, Niloufar Baba Ahmadi +3
In this paper, we introduce CollEx, an innovative multimodal agentic Retrieval-Augmented Generation (RAG) system designed to enhance interactive exploration of extensive scientific…