K-TanH: Efficient TanH For Deep Learning

Abhisek Kundu, Alex Heinecke, Dhiraj Kalamkar +7

We propose K-TanH, a novel, highly accurate, hardware efficient approximation of popular activation function TanH for Deep Learning. K-TanH consists of parameterized low-precision…