Understanding Encoder-Decoder Structures in Machine Learning Using Information Measures

Jorge F. Silva, Victor Faraggi, Camilo Ramirez +2

We present new results to model and understand the role of encoder-decoder design in machine learning (ML) from an information-theoretic angle. We use two main information concepts…