92 citations · 103 across the 7 of their papers we have counts for
7 papers
Beyond Static Leaderboards: Predictive Validity for the Evaluation of LLM Agents
Dhaval C. Patel, Kaoutar El Maghraoui, Shuxin Lin +58
Agent benchmarks are growing fast, but no single benchmark touches more than four or five of the dimensions that deployment exposes. This paper aggregates the largest coordinated d…
Internalizing Tool Knowledge in Small Language Models via QLoRA Fine-Tuning
Yuval Shemla, Ayal Yakobe, Tanmay Agarwal +2
Large language models are increasingly used as planning components in agentic systems, but current tool-use pipelines often require full tool schemas to be included in every prompt…
ORB: Operating Room Bot, Automating Operating Room Logistics through Mobile Manipulation
Jinkai Qiu, Yungjun Kim, Gaurav Sethia +4
Efficiently delivering items to an ongoing surgery in a hospital operating room can be a matter of life or death. In modern hospital settings, delivery robots have successfully tra…
Modeling Dynamic Environments with Scene Graph Memory
Andrey Kurenkov, Michael Lingelbach, Tanmay Agarwal +7
Embodied AI agents that search for objects in large environments such as households often need to make efficient decisions by predicting object locations based on partial informati…
The ObjectFolder Benchmark: Multisensory Learning with Neural and Real Objects
Ruohan Gao, Yiming Dou, Hao Li +5
We introduce the ObjectFolder Benchmark, a benchmark suite of 10 tasks for multisensory object-centric learning, centered around object recognition, reconstruction, and manipulatio…
Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecasting
Benjamin Wilson, William Qi, Tanmay Agarwal +10
We introduce Argoverse 2 (AV2) - a collection of three datasets for perception and forecasting research in the self-driving domain. The annotated Sensor Dataset contains 1,000 sequ…
Affordance-based Reinforcement Learning for Urban Driving
Tanmay Agarwal, Hitesh Arora, Jeff Schneider
Traditional autonomous vehicle pipelines that follow a modular approach have been very successful in the past both in academia and industry, which has led to autonomy deployed on r…