11 citations · 17 across the 7 of their papers we have counts for
3 papers · 1 filter
EAServe: Encode-Aware Disaggregated Serving for Multimodal Large Language Models
Kunxiong Zhu, Zhihao Shu, Hangyu Zheng +4
Disaggregating the two stages, Prefill and Decode, onto separate GPU pools is now a standard optimization for (text-only) LLM serving. However, multimodal LLMs (MLLMs), which add a…
Mask-Aware Execution for Efficient JEPA Training
Md Musfiqur Rahman Sanim, Zhihao Shu, Bahram Afsharmanesh +3
Joint Embedding Predictive Architectures (JEPAs) are becoming a core representation-learning primitive and a building block for latent world models across vision, video, audio, bra…
FlashMem: Supporting Modern DNN Workloads on Mobile with GPU Memory Hierarchy Optimizations
Zhihao Shu, Md Musfiqur Rahman Sanim, Hangyu Zheng +4
The increasing size and complexity of modern deep neural networks (DNNs) pose significant challenges for on-device inference on mobile GPUs, with limited memory and computational r…