5 citations · 12 across the 13 of their papers we have counts for
4 papers · 1 filter
Advancing Open and Reproducible Relational Learning: RelArena-, TabPFN-Rel and RPI
Adrian Hayler, Klemens Flöge, Alan Arazi +44
This first release of Prior Labs in relational learning shows our continued commitment to open science. We open-source three pieces of software that we expect to accelerate researc…
JudgeArena: A Unified Framework for Reproducible LLM-Judge Evaluation
Erlis Lushtaku, Bora Kargi, Ali Elganzory +4
LLM-as-a-judge evaluation has become a dominant paradigm for ranking language models, yet the ecosystem remains fragmented: most benchmarks ship their own code base, hardcode a spe…
From Uncertain Judgments to Calibrated Rankings: Conformal Elo Estimation for LLM Evaluation
Bora Kargi, David Salinas
Evaluating new large language models typically requires costly human annotation campaigns at scale. LLM-as-a-judge offers a cheaper alternative, but judge scores carry systematic e…
Multi-Objective Hierarchical Optimization with Large Language Models
Andrej Schwanke, Lyubomir Ivanov, David Salinas +2
Despite their widespread adoption in various domains, especially due to their powerful reasoning capabilities, Large Language Models (LLMs) are not the off-the-shelf choice to driv…