12 citations · 14 across the 4 of their papers we have counts for
4 papers
Making MoE-based LLM Inference Resilient with Tarragon
Songyu Zhang, Aaron Tam, Myungjin Lee +2
Mixture-of-Experts (MoE) models are increasingly used to serve LLMs at scale, but failures become common as deployment scale grows. Existing systems exhibit poor failure resilience…
Palladium: A DPU-enabled Multi-Tenant Serverless Cloud over Zero-copy Multi-node RDMA Fabrics
Shixiong Qi, Songyu Zhang, K. K. Ramakrishnan +3
Serverless computing promises enhanced resource efficiency and lower user costs, yet is burdened by a heavyweight, CPU-bound data plane. Prior efforts exploiting shared memory redu…
LIFL: A Lightweight, Event-driven Serverless Platform for Federated Learning
Shixiong Qi, K. K. Ramakrishnan, Myungjin Lee
Federated Learning (FL) typically involves a large-scale, distributed system with individual user devices/servers training models locally and then aggregating their model updates o…
MiddleNet: A Unified, High-Performance NFV and Middlebox Framework with eBPF and DPDK
Shixiong Qi, Ziteng Zeng, Leslie Monis +1
Traditional network resident functions (e.g., firewalls, network address translation) and middleboxes (caches, load balancers) have moved from purpose-built appliances to software-…