Fine-Grained Energy Prediction For Parallellized LLM Inference With PIE-P

Anurag Dutt, Young Won Choi, Avirup Sil +3

With the widespread adoption of Large Language Models (LLMs), energy costs of running LLMs is quickly becoming a critical concern. However, precisely measuring the energy consumpti…