Coordinate Descent for Network Linearization

Vlad Rakhlin, Amir Jevnisek, Shai Avidan

ReLU activations are the main bottleneck in Private Inference that is based on ResNet networks. This is because they incur significant inference latency. Reducing ReLU count is a d…