Predictive first-principles simulations for co-designing next-generation energy-efficient AI systems

Denis Mamaluy, Md Rahatul Islam Udoy, Juan P. Mendez +3

In modern generative-AI workloads, matrix-vector/matrix-matrix multiplications (\emph{MatMul}) dominate the compute and energy cost. Achieving dramatic reductions in energy per tok…