4 papers
Information Geometry of Variational Bayes
Mohammad Emtiyaz Khan
We highlight a fundamental connection between information geometry and variational Bayes (VB) and discuss its consequences for machine learning. Under certain conditions, a VB solu…
Knowledge Adaptation as Posterior Correction
Mohammad Emtiyaz Khan
Adaptation is the holy grail of intelligence, but even the best AI models lack the adaptability of toddlers. In spite of great progress, little is known about the mechanisms by whi…
Variational Learning Induces Adaptive Label Smoothing
Sin-Han Yang, Zhedong Liu, Gian Maria Marconi +1
We show that variational learning naturally induces an adaptive label smoothing where label noise is specialized for each example. Such label-smoothing is useful to handle examples…
Natural Variational Annealing for Multimodal Optimization
Tâm LeMinh, Julyan Arbel, Thomas Möllenhoff +2
We introduce a new multimodal optimization approach called Natural Variational Annealing (NVA) that combines the strengths of three foundational concepts to simultaneously search f…