Parallax: Runtime Parallelization for Operator Fallbacks in Heterogeneous Edge Systems

Chong Tang, Hao Dai, Jagmohan Chauhan

The growing demand for real-time DNN applications on edge devices necessitates faster inference of increasingly complex models. Although many devices include specialized accelerato…