From the 1 of 30 linked papers with an AI index.
2 citations · 2 across the 10 of their papers we have counts for
6 papers · 1 filter
Optimal Guarantees for Auditing Rényi Differentially Private Machine Learning
Benjamin D. Kim, Lav R. Varshney, Daniel Alabi
We study black-box auditing for machine learning algorithms that claim R \ 'enyi differential privacy (RDP) guarantees. We introduce an auditing framework, based on hypothesis test…
Fed-SB: A Silver Bullet for Extreme Communication Efficiency and Performance in (Private) Federated LoRA Fine-Tuning
Raghav Singhal, Kaustubh Ponkshe, Rohit Vartak +2
Low-Rank Adaptation (LoRA) has become ubiquitous for efficiently fine-tuning foundation models. However, federated fine-tuning using LoRA is challenging due to suboptimal updates a…
A Theory of Inference Compute Scaling: Reasoning through Directed Stochastic Skill Search
Austin R. Ellis-Mohr, Anuj K. Nayak, Lav R. Varshney
Large language models (LLMs) demand considerable computational, energy, and financial resources during both training and deployment. While scaling laws for training have guided muc…
Online Reinforcement Learning with Passive Memory
Anay Pattanaik, Lav R. Varshney
This paper considers an online reinforcement learning algorithm that leverages pre-collected data (passive memory) from the environment for online interaction. We show that using p…
Efficient Model-Agnostic Multi-Group Equivariant Networks
Razan Baltaji, Sourya Basu, Lav R. Varshney
Constructing model-agnostic group equivariant networks, such as equitune (Basu et al., 2023b) and its generalizations (Kim et al., 2023), can be computationally expensive for large…
Nonstationary Reinforcement Learning with Linear Function Approximation
Huozhi Zhou, Jinglin Chen, Lav R. Varshney +1
We consider reinforcement learning (RL) in episodic Markov decision processes (MDPs) with linear function approximation under drifting environment. Specifically, both the reward an…