3 papers
cs.AI2026
EGG: An Expert-Guided Agent Framework for Kernel Generation
Yaochen Han, Ke Fan, Hongxu Jiang +5
High-performance GPU kernels are critical for reducing the exponentially growing computational costs of large language models (LLMs), but their development heavily relies on manual…
cs.DC2025
FlexPie: Accelerate Distributed Inference on Edge Devices with Flexible Combinatorial Optimization[Technical Report]
Runhua Zhang, Hongxu Jiang, Jinkun Geng +3
The rapid advancement of deep learning has catalyzed the development of novel IoT applications, which often deploy pre-trained deep neural network (DNN) models across multiple edge…
cs.DC2023
Xenos: Dataflow-Centric Optimization to Accelerate Model Inference on Edge Devices
Zhang Runhua, Jiang Hongxu, Tian Fangzheng +7
Edge computing has been emerging as a popular scenario for model inference. However, the inference performance on edge devices (e.g., Multi-Core DSP, FGPA, etc.) suffers from ineff…