Shakespearean Sparks: The Dance of Hallucination and Creativity in LLMs' Decoding Layers

Zicong He, Boxuan Zhang, Lu Cheng

Large language models (LLMs) are known to hallucinate, a phenomenon often linked to creativity. While previous research has primarily explored this connection through theoretical o…