2 citations · 2 across the 2 of their papers we have counts for
3 papers
cs.LG2026
MoRE: Scaling mixture of experts with hardware-aware low-rank routing
Honam Wong, Surbhi Goel, Enric Boix-Adserà
Mixture-of-Experts (MoE) layers are central to frontier language models, and recent architectures push toward more and smaller experts. In this regime, the standard linear router b…
stat.ML2024
Benign overfitting in Fixed Dimension via Physics-Informed Learning with Smooth Inductive Bias
Honam Wong, Wendao Wu, Fanghui Liu +1
Recent advances in machine learning have inspired a surge of research into reconstructing specific quantities of interest from measurements that comply with certain physical laws.…
cs.LG2023★ 2 cited
Spurious Feature Diversification Improves Out-of-distribution Generalization
Yong Lin, Lu Tan, Yifan Hao +5
Generalization to out-of-distribution (OOD) data is a critical challenge in machine learning. Ensemble-based methods, like weight space ensembles that interpolate model parameters,…