2.5k citations · 2.5k across the 2 of their papers we have counts for
3 papers
cs.NE2026★ 2.5k cited
Deep Learning using Rectified Linear Units (ReLU)
Abien Fred Agarap
The Rectified Linear Unit (ReLU) is a foundational activation function in artficial neural networks. Recent literature frequently misattributes its origin to the 2018 (initial) ver…
cs.LG2026
Apparent Age Estimation: Challenges and Outcomes
Justin Rainier Go, Lorenz Bernard Marqueses, Mikaella Kaye Martinez +2
Apparent age estimation is a valuable tool for business personalization, yet current models frequently exhibit demographic biases. We review prior works on the DEX method by applyi…
cs.NE2026
Mixture of Experts with Soft Nearest Neighbor Loss: Resolving Expert Collapse via Representation Disentanglement
Abien Fred Agarap, Arnulfo P. Azcarraga
The Mixture-of-Experts (MoE) model uses a set of expert networks that specialize on subsets of a dataset under the supervision of a gating network. A common issue in MoE architectu…