CaMDN: Enhancing Cache Efficiency for Multi-tenant DNNs on Integrated NPUs

Tianhao Cai, Liang Wang, Limin Xiao +4

With the rapid development of DNN applications, multi-tenant execution, where multiple DNNs are co-located on a single SoC, is becoming a prevailing trend. Although many methods ar…