4 papers · 1 filter
Towards Simple Models of Complex SmartNICs
Robert Chang, Teng Jiang, Wonsup Yoon +3
Cloud vendors push ambitious in-network processing (e.g., crypto, telemetry) onto the NIC to offload servers even as link rates climb to terabit speeds. Vendors have responded with…
Dooly: Configuration-Agnostic, Redundancy-Aware Profiling for LLM Inference Simulation
Joon Ha Kim, Geon-Woo Kim, Anoop Rachakonda +1
Selecting the optimal LLM inference configuration requires evaluation across hardware, serving engines, attention backends, and model architectures, since no single choice performs…
Reforge: Low-Latency Distributed GNN Serving with Selective Embedding Recomputation
Geon-Woo Kim, Donghyun Kim, Jeongyoon Moon +5
Graph Neural Networks (GNNs) have been widely adopted for their ability to compute expressive node representations in graph datasets. However, serving GNNs on large graphs is chall…
Accelerating Distributed Deep Learning using Lossless Homomorphic Compression
Haoyu Li, Yuchen Xu, Jiayi Chen +5
As deep neural networks (DNNs) grow in complexity and size, the resultant increase in communication overhead during distributed training has become a significant bottleneck, challe…