1 citations · 2 across the 6 of their papers we have counts for
4 papers · 1 filter
Information Geometry of Variational Bayes
Mohammad Emtiyaz Khan
We highlight a fundamental connection between information geometry and variational Bayes (VB) and discuss its consequences for machine learning. Under certain conditions, a VB solu…
Knowledge Adaptation as Posterior Correction
Mohammad Emtiyaz Khan
Adaptation is the holy grail of intelligence, but even the best AI models lack the adaptability of toddlers. In spite of great progress, little is known about the mechanisms by whi…
Variational Learning Induces Adaptive Label Smoothing
Sin-Han Yang, Zhedong Liu, Gian Maria Marconi +1
We show that variational learning naturally induces an adaptive label smoothing where label noise is specialized for each example. Such label-smoothing is useful to handle examples…
Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI
Theodore Papamarkou, Maria Skoularidou, Konstantina Palla +22
In the current landscape of deep learning research, there is a predominant emphasis on achieving high predictive accuracy in supervised tasks involving large image and language dat…