25 citations · 63 across the 10 of their papers we have counts for
11 papers · 1 filter
Get more for less: Principled Data Selection for Warming Up Fine-Tuning in LLMs
Feiyang Kang, Hoang Anh Just, Yifan Sun +5
This work focuses on leveraging and selecting from vast, unlabeled, open data to pre-fine-tune a pre-trained language model. The goal is to minimize the need for costly domain-spec…
Self-Aware Personalized Federated Learning
Huili Chen, Jie Ding, Eric Tramel +4
In the context of personalized federated learning (FL), the critical challenge is to balance local model improvement and global model tuning when the personal and global objectives…
Federated Learning Challenges and Opportunities: An Outlook
Jie Ding, Eric Tramel, Anit Kumar Sahu +3
Federated learning (FL) has been developed as a promising framework to leverage the resources of edge devices, enhance customers' privacy, comply with regulations, and reduce devel…
Partial Model Averaging in Federated Learning: Performance Guarantees and Benefits
Sunwoo Lee, Anit Kumar Sahu, Chaoyang He +1
Local Stochastic Gradient Descent (SGD) with periodic model averaging (FedAvg) is a foundational algorithm in Federated Learning. The algorithm independently runs SGD on multiple w…
You Only Query Once: Effective Black Box Adversarial Attacks with Minimal Repeated Queries
Devin Willmott, Anit Kumar Sahu, Fatemeh Sheikholeslami +2
Researchers have repeatedly shown that it is possible to craft adversarial attacks on deep classifiers (small perturbations that significantly change the class label), even in the…
Gaussian MRF Covariance Modeling for Efficient Black-Box Adversarial Attacks
Anit Kumar Sahu, Satya Narayan Shukla, J. Zico Kolter
We study the problem of generating adversarial examples in a black-box setting, where we only have access to a zeroth order oracle, providing us with loss function evaluations. Alt…