55 citations · 102 across the 14 of their papers we have counts for
Showing 2016Show all
2 papers · 1 filter
cs.LG2016★ 3 cited
Relative Natural Gradient for Learning Large Complex Models
Ke Sun, Frank Nielsen
Fisher information and natural gradient provided deep insights and powerful tools to artificial neural networks. However related analysis becomes more and more difficult as the lea…
cs.LG2016★ 55 cited
Guaranteed bounds on the Kullback-Leibler divergence of univariate mixtures using piecewise log-sum-exp inequalities
Frank Nielsen, Ke Sun
Information-theoretic measures such as the entropy, cross-entropy and the Kullback-Leibler divergence between two mixture models is a core primitive in many signal processing tasks…