56 citations · 71 across the 7 of their papers we have counts for
5 papers · 1 filter
Efficient MoE Serving in the Memory-Bound Regime: Balance Activated Experts, Not Tokens
Yanpeng Yu, Haiyue Ma, Krish Agarwal +10
Expert Parallelism (EP) permits Mixture of Experts (MoE) models to scale beyond a single GPU. To address load imbalance across GPUs in EP, existing approaches aim to balance the nu…
PULSE: Accelerating Distributed Pointer-Traversals on Disaggregated Memory (Extended Version)
Yupeng Tang, Seung-seob Lee, Abhishek Bhattacharjee +1
Caches at CPU nodes in disaggregated memory architectures amortize the high data access latency over the network. However, such caches are fundamentally unable to improve performan…
A Multi-Site Accelerator-Rich Processing Fabric for Scalable Brain-Computer Interfacing
Karthik Sriram, Raghavendra Pradyumna Pothukuchi, Michał Gerasimiuk +5
Hull is an accelerator-rich distributed implantable Brain-Computer Interface (BCI) that reads biological neurons at data rates that are 2-3 orders of magnitude higher than the prio…
GCS: Generalized Cache Coherence For Efficient Synchronization
Yanpeng Yu, Seung-seob Lee, Anurag Khandelwal +1
We explore the design of scalable synchronization primitives for disaggregated shared memory. Porting existing synchronization primitives to disaggregated shared memory results in…
MIND: In-Network Memory Management for Disaggregated Data Centers
Seung-seob Lee, Yanpeng Yu, Yupeng Tang +3
Memory-compute disaggregation promises transparent elasticity, high utilization and balanced usage for resources in data centers by physically separating memory and compute into ne…