SoftNeuro: Fast Deep Inference using Multi-platform Optimization

Masaki Hilaga, Yasuhiro Kuroda, Hitoshi Matsuo +4

Faster inference of deep learning models is highly demanded on edge devices and even servers, for both financial and environmental reasons. To address this issue, we propose SoftNe…