activity
20172025
most citedMetric Elicitation; Moving from Theory to Practice

2 citations · 3 across the 4 of their papers we have counts for

collaborators

13 papers

cs.LG2025

FisherSFT: Data-Efficient Supervised Fine-Tuning of Language Models Using Information Gain

Rohan Deb, Kiran Thekumparampil, Kousha Kalantari +3

Supervised fine-tuning (SFT) is a standard approach to adapting large language models (LLMs) to new domains. In this work, we improve the statistical efficiency of SFT by selecting…

cs.LG2025

An Efficient Plugin Method for Metric Optimization of Black-Box Models

Siddartha Devic, Nurendra Choudhary, Anirudh Srinivasan +3

Many machine learning algorithms and classifiers are available only via API queries as a ``black-box'' -- that is, the downstream user has no ability to change, re-train, or fine-t…

cs.LG2025

Logits are All We Need to Adapt Closed Models

Gaurush Hiranandani, Haolun Wu, Subhojyoti Mukherjee +1

Many commercial Large Language Models (LLMs) are often closed-source, limiting developers to prompt tuning for aligning content generation with specific applications. While these m…

cs.LG2024

Comparing Few to Rank Many: Active Human Preference Learning using Randomized Frank-Wolfe

Kiran Koshy Thekumparampil, Gaurush Hiranandani, Kousha Kalantari +2

We study learning of human preferences from a limited comparison feedback. This task is ubiquitous in machine learning. Its applications such as reinforcement learning from human f…

cs.CL20241 cited

Context-Aware Clustering using Large Language Models

Sindhu Tipirneni, Ravinarayana Adkathimar, Nurendra Choudhary +5

Despite the remarkable success of Large Language Models (LLMs) in text understanding and generation, their potential for text clustering tasks remains underexplored. We observed th…

stat.ML20222 cited

Metric Elicitation; Moving from Theory to Practice

Safinah Ali, Sohini Upadhyay, Gaurush Hiranandani +2

Metric Elicitation (ME) is a framework for eliciting classification metrics that better align with implicit user preferences based on the task and context. The existing ME strategy…