12 papers
Do Factuality Methods Make LLMs More Factual? Reproducibility and Fair Comparison
Pratuat Amatya, Vinay Setty, V Venktesh +1
Large Language Models (LLMs) are aligned to human preferences, after pre-training and supervised fine-tuning steps. However, standard RL alignment steps such as RLHF do not focus o…
Calibrating Small Language Models for Claim Check-Worthiness Detection
Pratuat Amatya, V Venktesh, Vinay Setty
Assessing claim check-worthiness is an essential first step in automated fact-checking pipelines. This work is motivated by a real deployment challenge at an early-stage startup: r…
Multilingual Fact-Checking at Scale: Fine-Tuned Compact Models vs LLMs
Pratuat Amatya, Vinay Setty
We present a multilingual fact-checking system deployed at Factiverse, designed for high-throughput and low-latency operation across diverse languages. The system follows a modular…
The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checking
Julia Maria Struß, Sebastian Schellhammer, Stefan Dietze +9
The CheckThat! lab aims to advance the development of innovative technologies combating disinformation and manipulation efforts in online communication across a multitude of langua…
One LLM to Train Them All: Multi-Task Learning Framework for Fact-Checking
Malin Astrid Larsson, Harald Fosen Grunnaleite, Vinay Setty
Large language models (LLMs) are reshaping automated fact-checking (AFC) by enabling unified, end-to-end verification pipelines rather than isolated components. While large proprie…
Think Right, Not More: Test-Time Scaling for Numerical Claim Verification
Primakov Chungkham, V Venktesh, Vinay Setty +1
Fact-checking real-world claims, particularly numerical claims, is inherently complex that require multistep reasoning and numerical reasoning for verifying diverse aspects of the…
ShortCheck: Checkworthiness Detection of Multilingual Short-Form Videos
Henrik Vatndal, Vinay Setty
Short-form video platforms like TikTok present unique challenges for misinformation detection due to their multimodal, dynamic, and noisy content. We present ShortCheck, a modular,…
The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval
Firoj Alam, Julia Maria Struß, Tanmoy Chakraborty +11
The CheckThat! lab aims to advance the development of innovative technologies designed to identify and counteract online disinformation and manipulation efforts across various lang…
FlashCheck: Exploration of Efficient Evidence Retrieval for Fast Fact-Checking
Kevin Nanekhan, Venktesh V, Erik Martin +3
The advances in digital tools have led to the rampant spread of misinformation. While fact-checking aims to combat this, manual fact-checking is cumbersome and not scalable. It is…
FactIR: A Real-World Zero-shot Open-Domain Retrieval Benchmark for Fact-Checking
Venktesh V, Vinay Setty
The field of automated fact-checking increasingly depends on retrieving web-based evidence to determine the veracity of claims in real-world scenarios. A significant challenge in t…
Annotation Tool and Dataset for Fact-Checking Podcasts
Vinay Setty, Adam James Becker
Podcasts are a popular medium on the web, featuring diverse and multilingual content that often includes unverified claims. Fact-checking podcasts is a challenging task, requiring…
LiveFC: A System for Live Fact-Checking of Audio Streams
Venktesh V, Vinay Setty
The advances in the digital era have led to rapid dissemination of information. This has also aggravated the spread of misinformation and disinformation. This has potentially serio…