1 citations · 3 across the 10 of their papers we have counts for
10 papers
Tracing Relational Knowledge Recall in Large Language Models
Nicholas Popovič, Michael Färber
We study how large language models recall relational knowledge during text generation, with a focus on identifying latent representations suitable for relation classification via l…
Semantic Calibration Prevails Where Token Confidence Fails: Benchmarking Long-Form Scientific QA
Philip Müller, Nicholas Popovič, Michael Färber +1
Reliable uncertainty quantification (UQ) is essential for safe deployment of large language models (LLMs) in scientific question answering, where long-form outputs exceed practical…
Extractive Fact Decomposition for Interpretable Natural Language Inference in one Forward Pass
Nicholas Popovič, Michael Färber
Recent works in Natural Language Inference (NLI) and related tasks, such as automated fact-checking, employ atomic fact decomposition to enhance interpretability and robustness. Fo…
Kaleidoscope: In-language Exams for Massively Multilingual Vision Evaluation
Israfel Salazar, Manuel Fernández Burda, Shayekh Bin Islam +42
The evaluation of vision-language models (VLMs) has mainly relied on English-language benchmarks, leaving significant gaps in both multilingual and multicultural coverage. While mu…
The Effects of Hallucinations in Synthetic Training Data for Relation Extraction
Steven Rogulsky, Nicholas Popovic, Michael Färber
Relation extraction is crucial for constructing knowledge graphs, with large high-quality datasets serving as the foundation for training, fine-tuning, and evaluating models. Gener…
Embedded Named Entity Recognition using Probing Classifiers
Nicholas Popovič, Michael Färber
Streaming text generation has become a common way of increasing the responsiveness of language model powered applications, such as chat assistants. At the same time, extracting sem…
Vocab-Expander: A System for Creating Domain-Specific Vocabularies Based on Word Embeddings
Michael Färber, Nicholas Popovic
In this paper, we propose Vocab-Expander at https://vocab-expander.com, an online tool that enables end-users (e.g., technology scouts) to create and expand a vocabulary of their d…
Towards Solving Fuzzy Tasks with Human Feedback: A Retrospective of the MineRL BASALT 2022 Competition
Stephanie Milani, Anssi Kanervisto, Karolis Ramanauskas +27
To facilitate research in the direction of fine-tuning foundation models from human feedback, we held the MineRL BASALT Competition on Fine-Tuning from Human Feedback at NeurIPS 20…
Few-Shot Document-Level Relation Extraction
Nicholas Popovic, Michael Färber
We present FREDo, a few-shot document-level relation extraction (FSDLRE) benchmark. As opposed to existing benchmarks which are built on sentence-level relation extraction corpora,…
AIFB-WebScience at SemEval-2022 Task 12: Relation Extraction First -- Using Relation Extraction to Identify Entities
Nicholas Popovic, Walter Laurito, Michael Färber
In this paper, we present an end-to-end joint entity and relation extraction approach based on transformer-based language models. We apply the model to the task of linking mathemat…