2 citations · 2 across the 5 of their papers we have counts for
7 papers
RoutingBench: Can Agentic Routing Analysis Scale to Production Datacenter Networks?
Wenlong Ding, Zhixiong Niu, Jianan Yang +6
Recent advances in AI models and agentic technologies make AI for network operations (NetOps) within reach. However, scalability remains a key bottleneck of agentic NetOps when ana…
Not All AI Agents Are Equal: Characterizing Resource and Performance Dynamics
Wonmi Choi, Minuk Park, Zhixiong Niu +3
LLM-based AI agents process user requests through iterative reasoning and tool execution, often involving the invocation of remote LLM APIs with local tool containers. This executi…
Xronos: Heterogeneity-Aware Tensor Parallelism for Collaborative LLM Fine-Tuning on Edge CPUs
Wonmi Choi, Sunjae Park, Dohyeok Kwon +4
Collaborative fine-tuning on edge devices adapts large language models to domain-specific data while keeping each device's data local. State-of-the-art (SOTA) collaborative fine-tu…
OasisKV: Scaling In-Decode KV Cache Beyond HBM with Lookahead Sparse Prefetching
Can Xiao, Sukmin Cho, Junbong We +7
Large language model (LLM) inference serving is increasingly constrained by memory rather than compute. As long-context and long-form reasoning workloads become more prevalent, the…
An Efficient Hybrid Sparse Attention with CPU-GPU Parallelism for Long-Context Inference
Feiyu Yao, Zhixiong Niu, Xiaqing Li +3
Long-context inference increasingly operates over CPU-resident KV caches, either because decoding-time KV states exceed GPU memory capacity or because disaggregated prefill-decode…
ACM MMSys 2024 Bandwidth Estimation in Real Time Communications Challenge
Sami Khairy, Gabriel Mittag, Vishak Gopal +6
The quality of experience (QoE) delivered by video conferencing systems to end users depends in part on correctly estimating the capacity of the bottleneck link between the sender…
Meili: Enabling SmartNIC as a Service in the Cloud
Qiang Su, Shaofeng Wu, Zhixiong Niu +5
SmartNICs are touted as an attractive substrate for network application offloading, offering benefits in programmability, host resource saving, and energy efficiency. The current u…