78 citations · 198 across the 9 of their papers we have counts for
7 papers · 1 filter
K-SAM: Sharpness-Aware Minimization at the Speed of SGD
Renkun Ni, Ping-yeh Chiang, Jonas Geiping +3
Sharpness-Aware Minimization (SAM) has recently emerged as a robust technique for improving the accuracy of deep neural networks. However, SAM incurs a high computational cost in p…
GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training
Chen Zhu, Renkun Ni, Zheng Xu +3
Innovations in neural architectures have fostered significant breakthroughs in language modeling and computer vision. Unfortunately, novel architectures often result in challenging…
Data Augmentation for Meta-Learning
Renkun Ni, Micah Goldblum, Amr Sharaf +2
Conventional image classifiers are trained by randomly sampling mini-batches of images. To achieve state-of-the-art performance, practitioners use sophisticated data augmentation s…
WrapNet: Neural Net Inference with Ultra-Low-Resolution Arithmetic
Renkun Ni, Hong-min Chu, Oscar Castañeda +3
Low-resolution neural networks represent both weights and activations with few bits, drastically reducing the multiplication complexity. Nonetheless, these products are accumulated…
Improving the Tightness of Convex Relaxation Bounds for Training Certifiably Robust Classifiers
Chen Zhu, Renkun Ni, Ping-yeh Chiang +3
Convex relaxations are effective for training and certifying neural networks against norm-bounded adversarial attacks, but they leave a large gap between certifiable and empirical…
Unraveling Meta-Learning: Understanding Feature Representations for Few-Shot Tasks
Micah Goldblum, Steven Reich, Liam Fowl +3
Meta-learning algorithms produce feature extractors which achieve state-of-the-art performance on few-shot classification. While the literature is rich with meta-learning methods,…
WITCHcraft: Efficient PGD attacks with random step size
Ping-Yeh Chiang, Jonas Geiping, Micah Goldblum +4
State-of-the-art adversarial attacks on neural networks use expensive iterative methods and numerous random restarts from different initial points. Iterative FGSM-based methods wit…