Inter-Layer Scheduling Space Exploration for Multi-model Inference on Heterogeneous Chiplets

Mohanad Odema, Hyoukjun Kwon, Mohammad Abdullah Al Faruque

To address increasing compute demand from recent multi-model workloads with heavy models like large language models, we propose to deploy heterogeneous chiplet-based multi-chip mod…