MIVE: A Minimalist Integer Vector Engine for Softmax LayerNorm and RMSNorm Acceleration

Kosmas Alexandridis, Giorgos Dimitrakopoulos

The rapid growth of Large Language Models (LLMs) has intensified the need for specialized hardware accelerators that can satisfy stringent inference latency and power constraints.…