24 citations · 109 across the 19 of their papers we have counts for
10 papers · 1 filter
Open Problems in Machine Unlearning for AI Safety
Fazl Barez, Tingchen Fu, Ameya Prabhu +16
As AI systems become more capable, widely deployed, and increasingly autonomous in critical areas such as cybersecurity, biological research, and healthcare, ensuring their safety…
Efficient Lifelong Model Evaluation in an Era of Rapid Progress
Ameya Prabhu, Vishaal Udandarao, Philip Torr +3
Standardized benchmarks drive progress in machine learning. However, with repeated testing, the risk of overfitting grows as algorithms over-exploit benchmark idiosyncrasies. In ou…
Corrective Machine Unlearning
Shashwat Goel, Ameya Prabhu, Philip Torr +2
Machine Learning models increasingly face data integrity challenges due to the use of large-scale training datasets drawn from the Internet. We study what model developers can do i…
From Categories to Classifiers: Name-Only Continual Learning by Exploring the Web
Ameya Prabhu, Hasan Abed Al Kader Hammoud, Ser-Nam Lim +3
Continual Learning (CL) often relies on the availability of extensive annotated datasets, an assumption that is unrealistically time-consuming and costly in practice. We explore a…
Rapid Adaptation in Online Continual Learning: Are We Evaluating It Right?
Hasan Abed Al Kader Hammoud, Ameya Prabhu, Ser-Nam Lim +3
We revisit the common practice of evaluating adaptation of Online Continual Learning (OCL) algorithms through the metric of online accuracy, which measures the accuracy of the mode…
Real-Time Evaluation in Online Continual Learning: A New Hope
Yasir Ghunaim, Adel Bibi, Kumail Alhamoud +5
Current evaluations of Continual Learning (CL) methods typically assume that there is no constraint on training time and computation. This is an unrealistic assumption for any real…
Computationally Budgeted Continual Learning: What Does Matter?
Ameya Prabhu, Hasan Abed Al Kader Hammoud, Puneet Dokania +4
Continual Learning (CL) aims to sequentially train models on streams of incoming data that vary in distribution by preserving previous knowledge while adapting to new data. Current…
Towards Adversarial Evaluations for Inexact Machine Unlearning
Shashwat Goel, Ameya Prabhu, Amartya Sanyal +3
Machine Learning models face increased concerns regarding the storage of personal user data and adverse impacts of corrupted data like backdoors or systematic bias. Machine Unlearn…
No Cost Likelihood Manipulation at Test Time for Making Better Mistakes in Deep Networks
Shyamgopal Karthik, Ameya Prabhu, Puneet K. Dokania +1
There has been increasing interest in building deep hierarchy-aware classifiers that aim to quantify and reduce the severity of mistakes, and not just reduce the number of errors.…
"You might also like this model": Data Driven Approach for Recommending Deep Learning Models for Unknown Image Datasets
Ameya Prabhu, Riddhiman Dasgupta, Anush Sankaran +2
For an unknown (new) classification dataset, choosing an appropriate deep learning architecture is often a recursive, time-taking, and laborious process. In this research, we propo…