The Statistical Inefficiency of Sparse Coding for Images (or, One Gabor to Rule them All)

James Bergstra, Aaron Courville, Yoshua Bengio

Sparse coding is a proven principle for learning compact representations of images. However, sparse coding by itself often leads to very redundant dictionaries. With images, this o…