Benchmarking and In-depth Performance Study of Large Language Models on Habana Gaudi Processors

Chengming Zhang, Baixi Sun, Xiaodong Yu +5

Transformer models have achieved remarkable success in various machine learning tasks but suffer from high computational complexity and resource requirements. The quadratic complex…