EdgeProfiler: A Fast Profiling Framework for Lightweight LLMs on Edge Using Analytical Model

Alyssa Pinnock, Shakya Jayakody, Kawsher A Roxy +1

This paper introduces EdgeProfiler, a fast profiling framework designed for evaluating lightweight Large Language Models (LLMs) on edge systems. While LLMs offer remarkable capabil…