150 citations · 554 across the 18 of their papers we have counts for
3 papers · 1 filter
Implicit Rate-Constrained Optimization of Non-decomposable Objectives
Abhishek Kumar, Harikrishna Narasimhan, Andrew Cotter
We consider a popular family of constrained optimization problems arising in machine learning that involve optimizing a non-decomposable evaluation metric with a certain thresholde…
Churn Reduction via Distillation
Heinrich Jiang, Harikrishna Narasimhan, Dara Bahri +2
In real-world systems, models are frequently updated as more data becomes available, and in addition to achieving high accuracy, the goal is to also maintain a low difference in pr…
Distilling Double Descent
Andrew Cotter, Aditya Krishna Menon, Harikrishna Narasimhan +3
Distillation is the technique of training a "student" model based on examples that are labeled by a separate "teacher" model, which itself is trained on a labeled dataset. The most…