3 citations · 4 across the 5 of their papers we have counts for
5 papers
Beyond Static Leaderboards: Predictive Validity for the Evaluation of LLM Agents
Dhaval C. Patel, Kaoutar El Maghraoui, Shuxin Lin +58
Agent benchmarks are growing fast, but no single benchmark touches more than four or five of the dimensions that deployment exposes. This paper aggregates the largest coordinated d…
SpatialMath: Spatial Comprehension-Infused Symbolic Reasoning for Mathematical Problem-Solving
Ashutosh Bajpai, Akshat Bhandari, Akshay Nambi +1
Multimodal Small-to-Medium sized Language Models (MSLMs) have demonstrated strong capabilities in integrating visual and textual information but still face significant limitations…
Analyzing Effects of Fake Training Data on the Performance of Deep Learning Systems
Pratinav Seth, Akshat Bhandari, Kumud Lakara
Deep learning models frequently suffer from various problems such as class imbalance and lack of robustness to distribution shift. It is often difficult to find data suitable for t…
Performance evaluation of deep segmentation models for Contrails detection
Akshat Bhandari, Sriya Rallabandi, Sanchit Singhal +2
Contrails, short for condensation trails, are line-shaped ice clouds produced by aircraft engine exhaust when they fly through cold and humid air. They generate a greenhouse effect…
Evaluating Predictive Uncertainty and Robustness to Distributional Shift Using Real World Data
Kumud Lakara, Akshat Bhandari, Pratinav Seth +1
Most machine learning models operate under the assumption that the training, testing and deployment data is independent and identically distributed (i.i.d.). This assumption doesn'…