Understanding LLM Hallucinations Caused by Soft Errors

Jinghao Wen, Dongning Ma, Ruixuan Wang +2

While hallucinations in Large Language Models (LLMs) have been extensively studied from a software perspective, limited attention has been paid to hardware-level factors. In this p…