4 papers
Cost-Aware Best-LLM Identification using Dueling Feedback
Sarvesh Gharat, Nikhil Karamchandani, Jayakrishnan Nair
Inspired by the problem of identifying the best model from a collection of large language models (LLMs) with heterogeneous querying costs, we formulate and analyse a variant of the…
Sequence prediction under a lying oracle
Puspabeethi Samanta, Nikhil Karamchandani, Jayakrishnan Nair
We consider the problem of sequential prediction of an -ary sequence, where at each epoch, (i) the environment selects an outcome from an -ary alphabet, (ii) the learner sele…
Representative Arm Identification: A fixed confidence approach to identify cluster representatives
Sarvesh Gharat, Aniket Yadav, Nikhil Karamchandani +1
We study the representative arm identification (RAI) problem in the multi-armed bandits (MAB) framework, wherein we have a collection of arms, each associated with an unknown rewar…
Fixed confidence community mode estimation
Meera Pai, Nikhil Karamchandani, Jayakrishnan Nair
Our aim is to estimate the largest community (a.k.a., mode) in a population composed of multiple disjoint communities. This estimation is performed in a fixed confidence setting vi…