System-performance and cost modeling of Large Language Model training and inference

Wenzhe Guo, Joyjit Kundu, Uras Tos +4

Large language models (LLMs), based on transformer architectures, have revolutionized numerous domains within artificial intelligence, science, and engineering due to their excepti…