activity
20232026
most citedTowards an empirical understanding of MoE design choices

1 citations · 4 across the 10 of their papers we have counts for

collaborators
Showing 2023Show all

2 papers · 1 filter

cs.LG2023★ 1 cited

Collaborative Learning via Prediction Consensus

Dongyang Fan, Celestine Mendler-Dünner, Martin Jaggi

We consider a collaborative learning setting where the goal of each agent is to improve their own model by leveraging the expertise of collaborators, in addition to their own train…

cs.LG2023

Ghost Noise for Regularizing Deep Neural Networks

Atli Kosson, Dongyang Fan, Martin Jaggi

Batch Normalization (BN) is widely used to stabilize the optimization process and improve the test performance of deep neural networks. The regularization effect of BN depends on t…