2 papers
cs.DC2025
Deal: Distributed End-to-End GNN Inference for All Nodes
Shiyang Chen, Xiang Song, Vasiloudis Theodore +1
Graph Neural Networks (GNNs) are a new research frontier with various applications and successes. The end-to-end inference for all nodes, is common for GNN embedding models, which…
cs.DC2024
KVDirect: Distributed Disaggregated LLM Inference
Shiyang Chen, Rain Jiang, Dezhi Yu +6
Large Language Models (LLMs) have become the new foundation for many applications, reshaping human society like a storm. Disaggregated inference, which separates prefill and decode…