An Explorative Study on Distributed Computing Techniques in Training and Inference of Large Language Models

Sheikh Azizul Hakim, Saem Hasan

Large language models (LLM) are advanced AI systems trained on extensive textual data, leveraging deep learning techniques to understand and generate human-like language. Today's L…