Fourier Preconditioning for Neural Feature Learning

Preston Pitzer, Anish Pradhan, Harpreet S. Dhillon

Mutual information (MI)-inspired feature learning techniques are capable of generating low-dimensional embeddings that retain nonlinear dependence structures, but direct estimation…