VeriLLM: A Lightweight Framework for Publicly Verifiable Decentralized Inference

Ke Wang, Zishuo Zhao, Xinyuan Song +7

Decentralized inference provides a scalable and resilient paradigm for serving large language models (LLMs), enabling fragmented global resource utilization and reducing reliance o…