Mingyang Li

works on

consumer devices 1 cpu-gpu offloading 1 inference optimization 1 large language models 1 tensor scheduling 1

From the 1 of 1 linked paper with an AI index.

collaborators

Showing cs.DCShow all

1 paper · 1 filter

cs.DC2026

Automated Tensor Scheduling for Hybrid CPU-GPU LLM Inference on Consumer Devices

Yangyijian Liu, Hongyi Ye, Mingyang Li +1

The paper introduces ATSInfer, a system that schedules tensor-level offloading between CPU and GPU to improve large language model inference on consumer devices, using static place…