An efficient and flexible inference system for serving heterogeneous ensembles of deep neural networks

Pierrick Pochelu, Serge G. Petiton, Bruno Conche

Ensembles of Deep Neural Networks (DNNs) have achieved qualitative predictions but they are computing and memory intensive. Therefore, the demand is growing to make them answer a h…