5.1k citations · 5.7k across the 37 of their papers we have counts for
20 papers · 1 filter
Test-Time Scaling in Diffusion LLMs via Hidden Semi-Autoregressive Experts
Jihoon Lee, Hoyeon Moon, Kevin Zhai +6
Diffusion-based large language models (dLLMs) are trained flexibly to model extreme dependence in the data distribution; however, how to best utilize this information at inference…
MIRA: Towards Mitigating Reward Hacking in Inference-Time Alignment of T2I Diffusion Models
Kevin Zhai, Utsav Singh, Anirudh Thatipelli +5
Diffusion models excel at generating images conditioned on text prompts, but the resulting images often do not satisfy user-specific criteria measured by scalar rewards such as Aes…
Direct Preference Optimization for Primitive-Enabled Hierarchical RL: A Bilevel Approach
Utsav Singh, Souradip Chakraborty, Wesley A. Suttle +6
Hierarchical reinforcement learning (HRL) enables agents to solve complex, long-horizon tasks by decomposing them into manageable sub-tasks. However, HRL methods face two fundament…
Data-Centric Human Preference with Rationales for Direct Preference Alignment
Hoang Anh Just, Ming Jin, Anit Sahu +2
Aligning language models with human preferences through reinforcement learning from human feedback is crucial for their safe and effective deployment. The human preference is typic…
Get more for less: Principled Data Selection for Warming Up Fine-Tuning in LLMs
Feiyang Kang, Hoang Anh Just, Yifan Sun +5
This work focuses on leveraging and selecting from vast, unlabeled, open data to pre-fine-tune a pre-trained language model. The goal is to minimize the need for costly domain-spec…
Performance Scaling via Optimal Transport: Enabling Data Selection from Partially Revealed Sources
Feiyang Kang, Hoang Anh Just, Anit Kumar Sahu +1
Traditionally, data selection has been studied in settings where all samples from prospective sources are fully revealed to a machine learning developer. However, in practical data…
FedBC: Calibrating Global and Local Models via Federated Learning Beyond Consensus
Amrit Singh Bedi, Chen Fan, Alec Koppel +4
In this work, we quantitatively calibrate the performance of global and local models in federated learning through a multi-criterion optimization-based framework, which we cast as…
Self-Aware Personalized Federated Learning
Huili Chen, Jie Ding, Eric Tramel +4
In the context of personalized federated learning (FL), the critical challenge is to balance local model improvement and global model tuning when the personal and global objectives…
Federated Learning Challenges and Opportunities: An Outlook
Jie Ding, Eric Tramel, Anit Kumar Sahu +3
Federated learning (FL) has been developed as a promising framework to leverage the resources of edge devices, enhance customers' privacy, comply with regulations, and reduce devel…
Partial Model Averaging in Federated Learning: Performance Guarantees and Benefits
Sunwoo Lee, Anit Kumar Sahu, Chaoyang He +1
Local Stochastic Gradient Descent (SGD) with periodic model averaging (FedAvg) is a foundational algorithm in Federated Learning. The algorithm independently runs SGD on multiple w…
You Only Query Once: Effective Black Box Adversarial Attacks with Minimal Repeated Queries
Devin Willmott, Anit Kumar Sahu, Fatemeh Sheikholeslami +2
Researchers have repeatedly shown that it is possible to craft adversarial attacks on deep classifiers (small perturbations that significantly change the class label), even in the…
Gaussian MRF Covariance Modeling for Efficient Black-Box Adversarial Attacks
Anit Kumar Sahu, Satya Narayan Shukla, J. Zico Kolter
We study the problem of generating adversarial examples in a black-box setting, where we only have access to a zeroth order oracle, providing us with loss function evaluations. Alt…
Simple and Efficient Hard Label Black-box Adversarial Attacks in Low Query Budget Regimes
Satya Narayan Shukla, Anit Kumar Sahu, Devin Willmott +1
We focus on the problem of black-box adversarial attacks, where the aim is to generate adversarial examples for deep learning models solely based on information limited to output l…
FedDANE: A Federated Newton-Type Method
Tian Li, Anit Kumar Sahu, Manzil Zaheer +3
Federated learning aims to jointly learn statistical models over massively distributed remote devices. In this work, we propose FedDANE, an optimization method that we adapt from D…
Black-box Adversarial Attacks with Bayesian Optimization
Satya Narayan Shukla, Anit Kumar Sahu, Devin Willmott +1
We focus on the problem of black-box adversarial attacks, where the aim is to generate adversarial examples using information limited to loss function evaluations of input-output p…
Noisy Batch Active Learning with Deterministic Annealing
Gaurav Gupta, Anit Kumar Sahu, Wan-Yi Lin
We study the problem of training machine learning models incrementally with batches of samples annotated with noisy oracles. We select each batch of samples that are important and…
Federated Learning: Challenges, Methods, and Future Directions
Tian Li, Anit Kumar Sahu, Ameet Talwalkar +1
Federated learning involves training statistical models over remote devices or siloed data centers, such as mobile phones or hospitals, while keeping data localized. Training in he…
MATCHA: Speeding Up Decentralized SGD via Matching Decomposition Sampling
Jianyu Wang, Anit Kumar Sahu, Zhouyi Yang +2
This paper studies the problem of error-runtime trade-off, typically encountered in decentralized training based on stochastic gradient descent (SGD) using a given network. While a…
Distributed stochastic optimization with gradient tracking over strongly-connected networks
Ran Xin, Anit Kumar Sahu, Usman A. Khan +1
In this paper, we study distributed stochastic optimization to minimize a sum of smooth and strongly-convex local cost functions over a network of agents, communicating over a stro…
Federated Optimization in Heterogeneous Networks
Tian Li, Anit Kumar Sahu, Manzil Zaheer +3
Federated Learning is a distributed learning paradigm with two key challenges that differentiate it from traditional distributed optimization: (1) significant variability in terms…