2 papers
cs.AI2025
JE-IRT: A Geometric Lens on LLM Abilities through Joint Embedding Item Response Theory
Louie Hong Yao, Nicholas Jarvis, Tiffany Zhan +3
Standard LLM evaluation practices compress diverse abilities into single scores, obscuring their inherently multidimensional nature. We present JE-IRT, a geometric item-response fr…
cs.CL2025
Towards Robust Evaluation of Visual Activity Recognition: Resolving Verb Ambiguity with Sense Clustering
Louie Hong Yao, Nicholas Jarvis, Tianyu Jiang
Evaluating visual activity recognition systems is challenging due to inherent ambiguities in verb semantics and image interpretation. When describing actions in images, synonymous…