46 citations · 85 across the 10 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2020
Cross-Iteration Batch Normalization
Zhuliang Yao, Yue Cao, Shuxin Zheng +2
A well-known issue of Batch Normalization is its significantly reduced effectiveness in the case of small mini-batch sizes. When a mini-batch contains few examples, the statistics…
cs.LG2019
Single-Net Continual Learning with Progressive Segmented Training (PST)
Xiaocong Du, Gouranga Charan, Frank Liu +1
There is an increasing need of continual learning in dynamic systems, such as the self-driving vehicle, the surveillance drone, and the robotic system. Such a system requires learn…
cs.LG2016
Reducing the Model Order of Deep Neural Networks Using Information Theory
Ming Tu, Visar Berisha, Yu Cao +1
Deep neural networks are typically represented by a much larger number of parameters than shallow models, making them prohibitive for small footprint devices. Recent research shows…