Neural Normalized Compression Distance and the Disconnect Between Compression and Classification

John Hurwitz, Charles Nicholas, Edward Raff

It is generally well understood that predictive classification and compression are intrinsically related concepts in information theory. Indeed, many deep learning methods are expl…