200 citations · 675 across the 45 of their papers we have counts for
4 papers · 1 filter
A Short Note on the Jensen-Shannon Divergence between Simple Mixture Distributions
Bernhard C. Geiger
This short note presents results about the symmetric Jensen-Shannon divergence between two discrete mixture distributions and . Specifically, for , is the m…
Understanding Neural Networks and Individual Neuron Importance via Information-Ordered Cumulative Ablation
Rana Ali Amjad, Kairen Liu, Bernhard C. Geiger
In this work, we investigate the use of three information-theoretic quantities -- entropy, mutual information with the class variable, and a class selectivity measure based on Kull…
Learning Representations for Neural Network-Based Classification Using the Information Bottleneck Principle
Rana Ali Amjad, Bernhard C. Geiger
In this theory paper, we investigate training deep neural networks (DNNs) for classification via minimizing the information bottleneck (IB) functional. We show that the resulting o…
Co-Clustering via Information-Theoretic Markov Aggregation
Clemens Bloechl, Rana Ali Amjad, Bernhard C. Geiger
We present an information-theoretic cost function for co-clustering, i.e., for simultaneous clustering of two sets based on similarities between their elements. By constructing a s…