290 citations · 1.1k across the 23 of their papers we have counts for
25 papers
Zero-Forgetting CISS via Dual-Phase Cognitive Cascades
Yuquan Lu, Yifu Guo, Zishan Xu +6
Continual semantic segmentation (CSS) is a cornerstone task in computer vision that enables a large number of downstream applications, but faces the catastrophic forgetting challen…
On the Exploitability of Instruction Tuning
Manli Shu, Jiongxiao Wang, Chen Zhu +3
Instruction tuning is an effective technique to align large language models (LLMs) with human intents. In this work, we investigate how an adversary can exploit instruction tuning…
Plug-In Inversion: Model-Agnostic Inversion for Vision with Data Augmentations
Amin Ghiasi, Hamid Kazemi, Steven Reich +3
Existing techniques for model inversion typically rely on hard-to-tune regularizers, such as total variation or feature regularization, which must be individually calibrated for ea…
VQ-GNN: A Universal Framework to Scale up Graph Neural Networks using Vector Quantization
Mucong Ding, Kezhi Kong, Jingling Li +4
Most state-of-the-art Graph Neural Networks (GNNs) can be defined as a form of graph convolution which can be realized by message passing between direct neighbors or beyond. To sca…
Understanding the Role of Self-Supervised Learning in Out-of-Distribution Detection Task
Jiuhai Chen, Chen Zhu, Bin Dai
Self-supervised learning (SSL) has achieved great success in a variety of computer vision tasks. However, the mechanism of how SSL works in these tasks remains a mystery. In this p…
Long-Short Transformer: Efficient Transformers for Language and Vision
Chen Zhu, Wei Ping, Chaowei Xiao +4
Transformers have achieved success in both language and vision domains. However, it is prohibitively expensive to scale them to long sequences such as long documents or high-resolu…
The Intrinsic Dimension of Images and Its Impact on Learning
Phillip Pope, Chen Zhu, Ahmed Abdelkader +2
It is widely believed that natural image data exhibits low-dimensional structure despite the high dimensionality of conventional pixel representations. This idea underlies a common…
GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training
Chen Zhu, Renkun Ni, Zheng Xu +3
Innovations in neural architectures have fostered significant breakthroughs in language modeling and computer vision. Unfortunately, novel architectures often result in challenging…
Modifying Memories in Transformer Models
Chen Zhu, Ankit Singh Rawat, Manzil Zaheer +4
Large Transformer models have achieved impressive performance in many natural language tasks. In particular, Transformer based language models have been shown to have great capabil…
Are Adversarial Examples Created Equal? A Learnable Weighted Minimax Risk for Robustness under Non-uniform Attacks
Huimin Zeng, Chen Zhu, Tom Goldstein +1
Adversarial Training is proved to be an efficient method to defend against adversarial examples, being one of the few defenses that withstand strong attacks. However, traditional d…
Towards Accurate Quantization and Pruning via Data-free Knowledge Transfer
Chen Zhu, Zheng Xu, Ali Shafahi +3
When large scale training data is available, one can obtain compact and accurate networks to be deployed in resource-constrained environments effectively through quantization and p…
Robust Optimization as Data Augmentation for Large-scale Graphs
Kezhi Kong, Guohao Li, Mucong Ding +5
Data augmentation helps neural networks generalize better by enlarging the training set, but it remains an open question how to effectively augment graph data to enhance the perfor…
Large-Scale Adversarial Training for Vision-and-Language Representation Learning
Zhe Gan, Yen-Chun Chen, Linjie Li +3
We present VILLA, the first known effort on large-scale adversarial training for vision-and-language (V+L) representation learning. VILLA consists of two training stages: (i) task-…
Headless Horseman: Adversarial Attacks on Transfer Learning Models
Ahmed Abdelkader, Michael J. Curry, Liam Fowl +5
Transfer learning facilitates the training of task-specific classifiers using pre-trained models as feature extractors. We present a family of transferable adversarial attacks agai…
Certified Defenses for Adversarial Patches
Ping-Yeh Chiang, Renkun Ni, Ahmed Abdelkader +3
Adversarial patch attacks are among one of the most practical threat models against real-world computer vision systems. This paper studies certified and empirical defenses against…
Improving the Tightness of Convex Relaxation Bounds for Training Certifiably Robust Classifiers
Chen Zhu, Renkun Ni, Ping-yeh Chiang +3
Convex relaxations are effective for training and certifying neural networks against norm-bounded adversarial attacks, but they leave a large gap between certifiable and empirical…
Learning from Noisy Anchors for One-stage Object Detection
Hengduo Li, Zuxuan Wu, Chen Zhu +3
State-of-the-art object detectors rely on regressing and classifying an extensive list of possible anchors, which are divided into positive and negative samples based on their inte…
Deep k-NN Defense against Clean-label Data Poisoning Attacks
Neehar Peri, Neal Gupta, W. Ronny Huang +5
Targeted clean-label data poisoning is a type of adversarial attack on machine learning systems in which an adversary injects a few correctly-labeled, minimally-perturbed samples i…
FreeLB: Enhanced Adversarial Training for Natural Language Understanding
Chen Zhu, Yu Cheng, Zhe Gan +3
Adversarial training, which minimizes the maximal risk for label-preserving input perturbations, has proved to be effective for improving the generalization of language models. In…
Transferable Clean-Label Poisoning Attacks on Deep Neural Nets
Chen Zhu, W. Ronny Huang, Ali Shafahi +4
Clean-label poisoning attacks inject innocuous looking (and "correctly" labeled) poison images into training data, causing a model to misclassify a targeted image after being train…
Adversarially robust transfer learning
Ali Shafahi, Parsa Saadatpanah, Chen Zhu +4
Transfer learning, in which a network is trained on one task and re-purposed on another, is often used to produce neural network classifiers when data is scarce or full-scale train…
Fine-grained Video Categorization with Redundancy Reduction Attention
Chen Zhu, Xiao Tan, Feng Zhou +4
For fine-grained categorization tasks, videos could serve as a better source than static images as videos have a higher chance of containing discriminative patterns. Nevertheless,…
Learning Visual Knowledge Memory Networks for Visual Question Answering
Zhou Su, Chen Zhu, Yinpeng Dong +3
Visual question answering (VQA) requires joint comprehension of images and natural language questions, where many questions can't be directly or clearly answered from visual conten…
Compressing Neural Networks using the Variational Information Bottleneck
Bin Dai, Chen Zhu, David Wipf
Neural networks can be compressed to reduce memory and computational requirements, or to increase accuracy by facilitating the use of a larger base architecture. In this paper we f…