3 papers
cs.LG2025
Beyond Johnson-Lindenstrauss: Uniform Bounds for Sketched Bilinear Forms
Rohan Deb, Qiaobo Li, Mayank Shrivastava +1
Uniform bounds on sketched inner products of vectors or matrices underpin several important computational and statistical results in machine learning and randomized algorithms, inc…
cs.LG2025
FisherSFT: Data-Efficient Supervised Fine-Tuning of Language Models Using Information Gain
Rohan Deb, Kiran Thekumparampil, Kousha Kalantari +3
Supervised fine-tuning (SFT) is a standard approach to adapting large language models (LLMs) to new domains. In this work, we improve the statistical efficiency of SFT by selecting…
cs.LG2024
Conservative Contextual Bandits: Beyond Linear Representations
Rohan Deb, Mohammad Ghavamzadeh, Arindam Banerjee
Conservative Contextual Bandits (CCBs) address safety in sequential decision making by requiring that an agent's policy, along with minimizing regret, also satisfies a safety const…