activity
20172021
most citedEvalAI: Towards Better Evaluation Systems for AI Agents

44 citations · 82 across the 4 of their papers we have counts for

collaborators

9 papers

cs.CV2021

RobustNav: Towards Benchmarking Robustness in Embodied Navigation

Prithvijit Chattopadhyay, Judy Hoffman, Roozbeh Mottaghi +1

As an attempt towards assessing the robustness of embodied navigation agents, we propose RobustNav, a framework to quantify the performance of embodied navigation agents when expos…

cs.CV2020

Learning to Balance Specificity and Invariance for In and Out of Domain Generalization

Prithvijit Chattopadhyay, Yogesh Balaji, Judy Hoffman

We introduce Domain-specific Masks for Generalization, a model for improving both in-domain and out-of-domain generalization performance. For domain generalization, the goal is to…

cs.CV2020

Likelihood Landscapes: A Unifying Principle Behind Many Adversarial Defenses

Fu Lin, Rohit Mittapalli, Prithvijit Chattopadhyay +2

Convolutional Neural Networks have been shown to be vulnerable to adversarial examples, which are known to locate in subspaces close to where normal data lies but are not naturally…

cs.LG2019

Improving Generative Visual Dialog by Answering Diverse Questions

Vishvak Murahari, Prithvijit Chattopadhyay, Dhruv Batra +2

Prior work on training generative Visual Dialog models with reinforcement learning(Das et al.) has explored a Qbot-Abot image-guessing game and shown that this 'self-talk' approach…

cs.LG2019

IR-VIC: Unsupervised Discovery of Sub-goals for Transfer in RL

Nirbhay Modhe, Prithvijit Chattopadhyay, Mohit Sharma +4

We propose a novel framework to identify sub-goals useful for exploration in sequential decision making tasks under partial observability. We utilize the variational intrinsic cont…

cs.AI201944 cited

EvalAI: Towards Better Evaluation Systems for AI Agents

Deshraj Yadav, Rishabh Jain, Harsh Agrawal +6

We introduce EvalAI, an open source platform for evaluating and comparing machine learning (ML) and artificial intelligence algorithms (AI) at scale. EvalAI is built to provide a s…