Prompt Inference Attack on Distributed Large Language Model Inference Frameworks

Xinjian Luo, Ting Yu, Xiaokui Xiao

The inference process of modern large language models (LLMs) demands prohibitive computational resources, rendering them infeasible for deployment on consumer-grade devices. To add…