Profiling Lightweight Large Language Models

Tomohiro Harada, Enrique Alba, Gabriel Luque

Lightweight large language models (LLMs) are increasingly being deployed locally on personal computers and are expected to play a growing role in resource-constrained edge and mobi…