78 citations · 198 across the 9 of their papers we have counts for
10 papers
Battle of the Backbones: A Large-Scale Comparison of Pretrained Models across Computer Vision Tasks
Micah Goldblum, Hossein Souri, Renkun Ni +10
Neural network based computer vision systems are typically built on a backbone, a pretrained or randomly initialized feature extractor. Several years ago, the default option was an…
K-SAM: Sharpness-Aware Minimization at the Speed of SGD
Renkun Ni, Ping-yeh Chiang, Jonas Geiping +3
Sharpness-Aware Minimization (SAM) has recently emerged as a robust technique for improving the accuracy of deep neural networks. However, SAM incurs a high computational cost in p…
GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training
Chen Zhu, Renkun Ni, Zheng Xu +3
Innovations in neural architectures have fostered significant breakthroughs in language modeling and computer vision. Unfortunately, novel architectures often result in challenging…
Data Augmentation for Meta-Learning
Renkun Ni, Micah Goldblum, Amr Sharaf +2
Conventional image classifiers are trained by randomly sampling mini-batches of images. To achieve state-of-the-art performance, practitioners use sophisticated data augmentation s…
WrapNet: Neural Net Inference with Ultra-Low-Resolution Arithmetic
Renkun Ni, Hong-min Chu, Oscar Castañeda +3
Low-resolution neural networks represent both weights and activations with few bits, drastically reducing the multiplication complexity. Nonetheless, these products are accumulated…
Certified Defenses for Adversarial Patches
Ping-Yeh Chiang, Renkun Ni, Ahmed Abdelkader +3
Adversarial patch attacks are among one of the most practical threat models against real-world computer vision systems. This paper studies certified and empirical defenses against…
Improving the Tightness of Convex Relaxation Bounds for Training Certifiably Robust Classifiers
Chen Zhu, Renkun Ni, Ping-yeh Chiang +3
Convex relaxations are effective for training and certifying neural networks against norm-bounded adversarial attacks, but they leave a large gap between certifiable and empirical…
Unraveling Meta-Learning: Understanding Feature Representations for Few-Shot Tasks
Micah Goldblum, Steven Reich, Liam Fowl +3
Meta-learning algorithms produce feature extractors which achieve state-of-the-art performance on few-shot classification. While the literature is rich with meta-learning methods,…
WITCHcraft: Efficient PGD attacks with random step size
Ping-Yeh Chiang, Jonas Geiping, Micah Goldblum +4
State-of-the-art adversarial attacks on neural networks use expensive iterative methods and numerous random restarts from different initial points. Iterative FGSM-based methods wit…
Learning Accurate Low-Bit Deep Neural Networks with Stochastic Quantization
Yinpeng Dong, Renkun Ni, Jianguo Li +3
Low-bit deep neural networks (DNNs) become critical for embedded applications due to their low storage requirement and computing efficiency. However, they suffer much from the non-…