Merino: Entropy-driven Design for Generative Language Models on IoT Devices

Youpeng Zhao, Ming Lin, Huadong Tang +2

Generative Large Language Models (LLMs) stand as a revolutionary advancement in the modern era of artificial intelligence (AI). However, scaling down LLMs for resource-constrained…