TZ-LLM: Protecting On-Device Large Language Models with Arm TrustZone

Xunjie Wang, Jiacheng Shi, Zihan Zhao +3

Large Language Models (LLMs) deployed on mobile devices offer benefits like user privacy and reduced network latency, but introduce a significant security risk: the leakage of prop…