On information gain, Kullback-Leibler divergence, entropy production and the involution kernel

Artur O. Lopes, Jairo K. Mengue

It is well known that in Information Theory and Machine Learning the Kullback-Leibler divergence, which extends the concept of Shannon entropy, plays a fundamental role. Given an {…