2 citations · 2 across the 3 of their papers we have counts for
Showing cs.NEShow all
2 papers · 1 filter
cs.NE2026
Mixture of Experts with Soft Nearest Neighbor Loss: Resolving Expert Collapse via Representation Disentanglement
Abien Fred Agarap, Arnulfo P. Azcarraga
The Mixture-of-Experts (MoE) model uses a set of expert networks that specialize on subsets of a dataset under the supervision of a gating network. A common issue in MoE architectu…
cs.NE2024★ 2 cited
k-Winners-Take-All Ensemble Neural Network
Abien Fred Agarap, Arnulfo P. Azcarraga
Ensembling is one approach that improves the performance of a neural network by combining a number of independent neural networks, usually by either averaging or summing up their i…