76 citations · 241 across the 13 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CV2022★ 1 cited
Accelerating Vision Transformer Training via a Patch Sampling Schedule
Bradley McDanel, Chi Phuong Huynh
We introduce the notion of a Patch Sampling Schedule (PSS), that varies the number of Vision Transformer (ViT) patches used per batch during training. Since all patches are not equ…
cs.LG2022
Accelerating DNN Training with Structured Data Gradient Pruning
Bradley McDanel, Helia Dinh, John Magallanes
Weight pruning is a technique to make Deep Neural Network (DNN) inference more computationally efficient by reducing the number of model parameters over the course of training. How…