A JIT Compiler for Neural Network Inference

Felix Thielke, Arne Hasselbring

This paper describes a C++ library that compiles neural network models at runtime into machine code that performs inference. This approach in general promises to achieve the best p…