Showing 2025Show all
2 papers · 1 filter
cs.LG2025
Load Balancing Mixture of Experts with Similarity Preserving Routers
Nabil Omi, Siddhartha Sen, Ali Farhadi
Sparse Mixture of Experts (MoE) models offer a scalable and efficient architecture for training large neural networks by activating only a subset of parameters ("experts") for each…
cs.LG2025
Generative Modeling of Individual Behavior at Scale
Nabil Omi, Lucas Caccia, Anurag Sarkar +2
There has been a growing interest in using AI to model human behavior, particularly in domains where humans interact with this technology. While most existing work models human beh…