11 citations · 25 across the 7 of their papers we have counts for
4 papers · 1 filter
Beyond Spectral Decomposition: Bayesian Contrastive Learning and its Non-negative Formulation via Factor Analysis
Zhibin Duan, Tiansheng Wen, Yifei Wang +3
Factor analysis, often regarded as a Bayesian variant of matrix factorization, offers superior capabilities in capturing uncertainty, modeling complex dependencies, and ensuring ro…
Towards Client Driven Federated Learning
Songze Li, Chenqing Zhu
Conventional federated learning (FL) frameworks follow a server-driven model where the server determines session initiation and client participation, which faces challenges in acco…
Pre-Train Your Loss: Easy Bayesian Transfer Learning with Informative Priors
Ravid Shwartz-Ziv, Micah Goldblum, Hossein Souri +4
Deep learning is increasingly moving towards a transfer learning paradigm whereby large foundation models are fine-tuned on downstream tasks, starting from an initialization learne…
Reducing the Teacher-Student Gap via Spherical Knowledge Disitllation
Jia Guo, Minghao Chen, Yao Hu +3
Knowledge distillation aims at obtaining a compact and effective model by learning the mapping function from a much larger one. Due to the limited capacity of the student, the stud…