7 citations · 7 across the 3 of their papers we have counts for
3 papers
Last Translation Benchmark
Vilém Zouhar, Niyati Bafna, Mukund Choudhary +263
For scientific progress, we need benchmarks that test the limits of state-of-the-art models, and evaluation methods that inform us about failure cases. As models get stronger, stan…
CounterCount: Diagnosing Knowledge Bias in How Vision-Language Models Count Attributes
Reem Alzahrani, Hassan Alshanqiti, Bushra Bin Hemid +4
Do Vision-Language Models (VLMs) count what they see, or what they know about the world? We introduce CounterCount, a diagnostic dataset of paired factual and counterfactual (CF) i…
ArabLegalEval: A Multitask Benchmark for Assessing Arabic Legal Knowledge in Large Language Models
Faris Hijazi, Somayah AlHarbi, Abdulaziz AlHussein +5
The rapid advancements in Large Language Models (LLMs) have led to significant improvements in various natural language processing tasks. However, the evaluation of LLMs' legal kno…