Softmax Optimizations for Intel Xeon Processor-based Platforms

Jacek Czaja, Michal Gallus, Tomasz Patejko +1

Softmax is popular normalization method used in machine learning. Deep learning solutions like Transformer or BERT use the softmax function intensively, so it is worthwhile to opti…