FlexModel: A Framework for Interpretability of Distributed Large Language Models

Matthew Choi, Muhammad Adil Asif, John Willes +1

With the growth of large language models, now incorporating billions of parameters, the hardware prerequisites for their training and deployment have seen a corresponding increase.…