Sequenced-Replacement Sampling for Deep Learning

Chiu Man Ho, Dae Hoon Park, Wei Yang +1

We propose sequenced-replacement sampling (SRS) for training deep neural networks. The basic idea is to assign a fixed sequence index to each sample in the dataset. Once a mini-bat…