works on
edge llm inference 1energy-efficient computing 1gpu-npu co-execution 1heterogeneous scheduling 1micro-batching 1

From the 1 of 1 linked paper with an AI index.

collaborators

1 paper

cs.DC2026

HeteroMosaic: Exposing and Exploiting Heterogeneous Execution Opportunities for Energy-Efficient Edge LLM Inference

Gregory Hyegang Jun, Wesley Pang, Eddie Richter +4

The paper introduces HeteroMosaic, a scheduling framework that coordinates CPUs, integrated GPUs, and NPUs on edge SoCs to run large language model inference more quickly and with…