2 citations · 2 across the 7 of their papers we have counts for
3 papers · 1 filter
DAG-MoE: From Simple Mixture to Structural Aggregation in Mixture-of-Experts
Jiarui Feng, Hanqing Zeng, Karish Grover +11
Mixture-of-Experts (MoE) models have become a leading approach for decoupling parameter count from computational cost in large language models, yet effectively scaling MoE performa…
Text Has Curvature
Karish Grover, Hanqing Zeng, Yinglong Xia +2
Does natural language text have an intrinsic curvature? Language is increasingly modeled in curved geometries - hyperbolic spaces for hierarchy, mixed-curvature manifolds for compo…
Feedback Control for Multi-Objective Graph Self-Supervision
Karish Grover, Theodore Vasiloudis, Han Xie +3
Can multi-task self-supervised learning on graphs be coordinated without the usual tug-of-war between objectives? Graph self-supervised learning (SSL) offers a growing toolbox of p…