1 citations · 1 across the 5 of their papers we have counts for
6 papers
PLoRA: An NDP-Enhanced Pooled-Memory System for Cost-Efficient Multi-LoRA Serving
Zhongkai Yu, Ohm Rishabh Venkatachalam, Zheng Wang +9
Multi-LoRA serving is how one base model becomes thousands of specialized variants, one adapter per user, task, or agent, and the deployments can hold 1000-plus adapters. Serving t…
Patterns behind Chaos: Forecasting Data Movement for Efficient Large-Scale MoE LLM Inference
Zhongkai Yu, Yue Guan, Zihao Yu +6
Large-scale Mixture of Experts (MoE) Large Language Models (LLMs) have recently become the frontier open-weight models, achieving remarkable model capability similar to proprietary…
DHIL-GT: Scalable Graph Transformer with Decoupled Hierarchy Labeling
Ningyi Liao, Zihao Yu, Siqiang Luo
Graph Transformer (GT) has recently emerged as a promising neural network architecture for learning graph-structured data. However, its global attention mechanism with quadratic co…
CAMAL: Optimizing LSM-trees via Active Learning
Weiping Yu, Siqiang Luo, Zihao Yu +1
We use machine learning to optimize LSM-tree structure, aiming to reduce the cost of processing various read/write operations. We introduce a new approach Camal, which boasts the f…
Unifews: You Need Fewer Operations for Efficient Graph Neural Networks
Ningyi Liao, Zihao Yu, Ruixiao Zeng +1
Graph Neural Networks (GNNs) have shown promising performance, but at the cost of resource-intensive operations on graph-scale matrices. To reduce computational overhead, previous…
Accelerating Text-to-Image Editing via Cache-Enabled Sparse Diffusion Inference
Zihao Yu, Haoyang Li, Fangcheng Fu +2
Due to the recent success of diffusion models, text-to-image generation is becoming increasingly popular and achieves a wide range of applications. Among them, text-to-image editin…