output
19942026
most citedFedKD: Communication Efficient Federated Learning via Knowledge Distillation

623 citations

Showing 2019Show all

10 papers · 1 filter

cs.IT2019★ 137 cited

On a generalization of the Jensen-Shannon divergence

Frank Nielsen

The Jensen-Shannon divergence is a renown bounded symmetrization of the Kullback-Leibler divergence which does not require probability densities to have matching supports. In this…

cs.AI2019★ 5 cited

Continuous Value Iteration (CVI) Reinforcement Learning and Imaginary Experience Replay (IER) for learning multi-goal, continuous action and state space controllers

Andreas Gerken, Michael Spranger

This paper presents a novel model-free Reinforcement Learning algorithm for learning behavior in continuous action, state, and goal spaces. The algorithm approximates optimal value…

gr-qc2019★ 22 cited

Generalized Gibbs Ensembles in Discrete Quantum Gravity

Goffredo Chirco, Isha Kotecha

Maximum entropy principle and Souriau's symplectic generalization of Gibbs states have provided crucial insights leading to extensions of standard equilibrium statistical mechanics…

cs.LG2019★ 22 cited

Mind2Mind : transfer learning for GANs

Yaël Frégier, Jean-Baptiste Gouray

Training generative adversarial networks (GANs) on high quality (HQ) images involves important computing resources. This requirement represents a bottleneck for the development of…

cs.IT2019★ 12 cited

A closed-form formula for the Kullback-Leibler divergence between Cauchy distributions

Frédéric Chyzak, Frank Nielsen

We report a closed-form expression for the Kullback-Leibler divergence between Cauchy distributions which involves the calculation of a novel definite integral. The formula shows t…

cs.LG2019★ 4 cited

A Geometric Modeling of Occam's Razor in Deep Learning

Ke Sun, Frank Nielsen

Why do deep neural networks (DNNs) benefit from very high dimensional parameter spaces? Their huge parameter complexities vs stunning performance in practice is all the more intrig…