7 citations · 16 across the 9 of their papers we have counts for
10 papers
Same Meaning, Different Scores: Lexical and Syntactic Sensitivity in LLM Evaluation
Bogdan Kostić, Conor Fallon, Julian Risch +1
The rapid advancement of Large Language Models (LLMs) has established standardized evaluation benchmarks as the primary instrument for model comparison. Yet, their reliability is i…
Fabricator: An Open Source Toolkit for Generating Labeled Training Data with Teacher LLMs
Jonas Golde, Patrick Haller, Felix Hamborg +2
Most NLP tasks are modeled as supervised learning and thus require labeled training data to train effective models. However, manually producing such data at sufficient quality and…
Pseudo-Labels Are All You Need
Bogdan Kostić, Mathis Lucka, Julian Risch
Automatically estimating the complexity of texts for readers has a variety of applications, such as recommending texts with an appropriate complexity level to language learners or…
Semantic Answer Similarity for Evaluating Question Answering Models
Julian Risch, Timo Möller, Julian Gutsch +1
The evaluation of question answering models compares ground-truth annotations with model predictions. However, as of today, this comparison is mostly lexical-based and therefore mi…
Multi-modal Retrieval of Tables and Texts Using Tri-encoder Models
Bogdan Kostić, Julian Risch, Timo Möller
Open-domain extractive question answering works well on textual data by first retrieving candidate texts and then extracting the answer from those candidates. However, some questio…
GermanQuAD and GermanDPR: Improving Non-English Question Answering and Passage Retrieval
Timo Möller, Julian Risch, Malte Pietsch
A major challenge of research on non-English machine reading for question answering (QA) is the lack of annotated datasets. In this paper, we present GermanQuAD, a dataset of 13,72…
PatentMatch: A Dataset for Matching Patent Claims & Prior Art
Julian Risch, Nicolas Alder, Christoph Hewel +1
Patent examiners need to solve a complex information retrieval task when they assess the novelty and inventive step of claims made in a patent application. Given a claim, they sear…
Top Comment or Flop Comment? Predicting and Explaining User Engagement in Online News Discussions
Julian Risch, Ralf Krestel
Comment sections below online news articles enjoy growing popularity among readers. However, the overwhelming number of comments makes it infeasible for the average news consumer t…
My Approach = Your Apparatus? Entropy-Based Topic Modeling on Multiple Domain-Specific Text Collections
Julian Risch, Ralf Krestel
Comparative text mining extends from genre analysis and political bias detection to the revelation of cultural and geographic differences, through to the search for prior art acros…
Challenges for Toxic Comment Classification: An In-Depth Error Analysis
Betty van Aken, Julian Risch, Ralf Krestel +1
Toxic comment classification has become an active research field with many recently proposed approaches. However, while these approaches address some of the task's challenges other…