78 citations · 194 across the 14 of their papers we have counts for
Showing 2026Show all
3 papers · 1 filter
cs.DC2026
SET: Stream-Event-Triggered Scheduling for Efficient CUDA Graph Pipelines
Zhengxiong Li, Tsung-Wei Huang, Umit Ogras
Achieving peak GPU performance remains a significant challenge as the system throughput is constrained by host-device synchronization delays and kernel scheduling overheads, even w…
cs.AR2026
LEXI: Lossless Exponent Coding for Efficient Inter-Chiplet Communication in Hybrid LLMs
Miao Sun, Alish Kanani, Kaushik Shroff +1
Data movement overheads increase the inference latency of state-of-the-art large language models (LLMs). These models commonly use the bfloat16 (BF16) format for stable training. F…
cs.AR2026
DUET: Disaggregated Hybrid Mamba-Transformer LLMs with Prefill and Decode-Specific Packages
Alish Kanani, Sangwan Lee, Han Lyu +3
Large language models operate in distinct compute-bound prefill followed by memory bandwidth-bound decode phases. Hybrid Mamba-Transformer models inherit this asymmetry while addin…