Information Losses in Neural Classifiers from Sampling

Brandon Foggo, Nanpeng Yu, Jie Shi +1

This paper considers the subject of information losses arising from the finite datasets used in the training of neural classifiers. It proves a relationship between such losses as…