1 citations · 1 across the 3 of their papers we have counts for
4 papers
Matrix-PIC: Harnessing Matrix Outer-product for High-Performance Particle-in-Cell Simulations
Yizhuo Rao, Xingjian Cui, Jiabin Xie +5
Particle-in-Cell (PIC) simulations spend most of their execution time on particle--grid interactions, where fine-grained atomic updates become a major bottleneck on traditional man…
TD-Pipe: Temporally-Disaggregated Pipeline Parallelism Architecture for High-Throughput LLM Inference
Hongbin Zhang, Taosheng Wei, Zhenyi Zheng +3
As the model size continuously increases, pipeline parallelism shows great promise in throughput-oriented LLM inference due to its low demand on communications. However, imbalanced…
EcoServe: Enabling Cost-effective LLM Serving with Proactive Intra- and Inter-Instance Orchestration
Jiangsu Du, Hongbin Zhang, Taosheng Wei +4
Existing LLM serving strategies can be categorized based on whether prefill and decode phases are disaggregated: non-disaggregated (NoDG) or fully disaggregated (FuDG). However, th…
Boosting LLM Serving through Spatial-Temporal GPU Resource Sharing
Zejia Lin, Hongxin Xu, Guanyi Chen +3
Modern LLM serving systems confront inefficient GPU utilization due to the fundamental mismatch between compute-intensive prefill and memory-bound decode phases. While current prac…