2 papers
math.OC2024
Specifying and Solving Robust Empirical Risk Minimization Problems Using CVXPY
Eric Luxenberg, Dhruv Malik, Yuanzhi Li +2
We consider robust empirical risk minimization (ERM), where model parameters are chosen to minimize the worst-case empirical loss when each data point varies over a given convex un…
cs.LG2024
Beyond Parameter Count: Implicit Bias in Soft Mixture of Experts
Youngseog Chung, Dhruv Malik, Jeff Schneider +2
The traditional viewpoint on Sparse Mixture of Experts (MoE) models is that instead of training a single large expert, which is computationally expensive, we can train many small e…