95 citations · 855 across the 81 of their papers we have counts for
85 papers
Differentially Private Paired Table-Image Multimodal Synthesis
Kai Chen, Josephine Lamp, Somesh Jha +1
Differentially private (DP) synthesis has been extensively studied for tabular and image data separately, yet many real-world datasets contain images paired with multivariate tabul…
Pareto-Secure Machine Learning (PSML): Fingerprinting and Securing Inference Serving Systems
Debopam Sanyal, Jui-Tse Hung, Manav Agrawal +6
Model-serving systems have become increasingly popular, especially in real-time web applications. In such systems, users send queries to the server and specify the desired performa…
Identifying and Mitigating the Security Risks of Generative AI
Clark Barrett, Brad Boyd, Elie Burzstein +20
Every major technical invention resurfaces the dual-use dilemma -- the new technology has the potential to be used for good as well as for harm. Generative AI (GenAI) techniques, s…
Theoretically Principled Trade-off for Stateful Defenses against Query-Based Black-Box Attacks
Ashish Hooda, Neal Mangaokar, Ryan Feng +3
Adversarial examples threaten the integrity of machine learning systems with alarming success rates even under constrained black-box conditions. Stateful defenses have emerged as a…
Stratified Adversarial Robustness with Rejection
Jiefeng Chen, Jayaram Raghuram, Jihye Choi +3
Recently, there is an emerging interest in adversarially training a classifier with a rejection option (also known as a selective classifier) for boosting adversarial robustness. W…
Rethinking Diversity in Deep Neural Network Testing
Zi Wang, Jihye Choi, Ke Wang +1
Motivated by the success of traditional software testing, numerous diversity measures have been proposed for testing deep neural networks (DNNs). In this study, we propose a shift…
ASPEST: Bridging the Gap Between Active Learning and Selective Prediction
Jiefeng Chen, Jinsung Yoon, Sayna Ebrahimi +3
Selective prediction aims to learn a reliable model that abstains from making predictions when uncertain. These predictions can then be deferred to humans for further evaluation. A…
Efficient Symbolic Reasoning for Neural-Network Verification
Zi Wang, Somesh Jha, Krishnamurthy +1
The neural network has become an integral part of modern software systems. However, they still suffer from various problems, in particular, vulnerability to adversarial attacks. In…
Stateful Defenses for Machine Learning Models Are Not Yet Secure Against Black-box Attacks
Ryan Feng, Ashish Hooda, Neal Mangaokar +3
Recent work has proposed stateful defense models (SDMs) as a compelling strategy to defend against a black-box attacker who only has query access to the model, as is common for onl…
The Trade-off between Universality and Label Efficiency of Representations from Contrastive Learning
Zhenmei Shi, Jiefeng Chen, Kunyang Li +4
Pre-training representations (a.k.a. foundation models) has recently become a prevalent learning paradigm, where one first pre-trains a representation using large-scale unlabeled d…
Formal Analysis of the API Proxy Problem
Somesh Jha, Mihai Christodorescu, Anh Pham
Implementing a security mechanism on top of APIs requires clear understanding of the semantics of each API, to ensure that security entitlements are enforced consistently and compl…
Holistic Cube Analysis: A Query Framework for Data Insights
Xi Wu, Shaleen Deep, Joe Benassi +11
Many data insight questions can be viewed as searching in a large space of tables and finding important ones, where the notion of importance is defined in some adhoc user defined m…
Learning Modulo Theories
Matt Fredrikson, Kaiji Lu, Saranya Vijayakumar +3
Recent techniques that integrate \emph{solver layers} into Deep Neural Networks (DNNs) have shown promise in bridging a long-standing gap between inductive learning and symbolic re…
Private Multi-Winner Voting for Machine Learning
Adam Dziedzic, Christopher A Choquette-Choo, Natalie Dullerud +6
Private multi-winner voting is the task of revealing -hot binary vectors satisfying a bounded differential privacy (DP) guarantee. This task has been understudied in machine lea…
Federated Boosted Decision Trees with Differential Privacy
Samuel Maddock, Graham Cormode, Tianhao Wang +2
There is great demand for scalable, secure, and efficient privacy-preserving machine learning models that can be trained over distributed data. While deep learning models typically…
Overparameterization from Computational Constraints
Sanjam Garg, Somesh Jha, Saeed Mahloujifar +2
Overparameterized models with millions of parameters have been hugely successful. In this work, we ask: can the need for large models be, at least in part, due to the \emph{computa…
Defending Object Detectors against Patch Attacks with Out-of-Distribution Smoothing
Ryan Feng, Neal Mangaokar, Jihye Choi +2
Patch attacks against object detectors have been of recent interest due to their being physically realizable and more closely aligned with practical systems. In response to this th…
Optimal Membership Inference Bounds for Adaptive Composition of Sampled Gaussian Mechanisms
Saeed Mahloujifar, Alexandre Sablayrolles, Graham Cormode +1
Given a trained model and a data sample, membership-inference (MI) attacks predict whether the sample was in the model's training set. A common countermeasure against MI attacks is…
Concept-based Explanations for Out-Of-Distribution Detectors
Jihye Choi, Jayaram Raghuram, Ryan Feng +3
Out-of-distribution (OOD) detection plays a crucial role in ensuring the safe deployment of deep neural network (DNN) classifiers. While a myriad of methods have focused on improvi…
A Quantitative Geometric Approach to Neural-Network Smoothness
Zi Wang, Gautam Prakriya, Somesh Jha
Fast and precise Lipschitz constant estimation of neural networks is an important task for deep learning. Researchers have recently found an intrinsic trade-off between the accurac…
Using Illustrations to Communicate Differential Privacy Trust Models: An Investigation of Users' Comprehension, Perception, and Data Sharing Decision
Aiping Xiong, Chuhao Wu, Tianhao Wang +4
Proper communication is key to the adoption and implementation of differential privacy (DP). However, a prior study found that laypeople did not understand the data perturbation pr…
An Exploration of Multicalibration Uniform Convergence Bounds
Harrison Rosenberg, Robi Bhattacharjee, Kassem Fawaz +1
Recent works have investigated the sample complexity necessary for fair machine learning. The most advanced of such sample complexity bounds are developed by analyzing multicalibra…
D4: Detection of Adversarial Diffusion Deepfakes Using Disjoint Ensembles
Ashish Hooda, Neal Mangaokar, Ryan Feng +3
Detecting diffusion-generated deepfake images remains an open problem. Current detection methods fail against an adversary who adds imperceptible adversarial perturbations to the d…
EIFFeL: Ensuring Integrity for Federated Learning
Amrita Roy Chowdhury, Chuan Guo, Somesh Jha +1
Federated learning (FL) enables clients to collaborate with a server to train a machine learning model. To ensure privacy, the server performs secure aggregation of updates from th…