Tail-Aware Information-Theoretic Bounds for LLM Alignment under Heavy-Tailed Rewards

Huiming Zhang, Binghan Li, Wan Tian +1

Classical information-theoretic learning bounds typically rely on KL mutual information and moment-generating-function (MGF) arguments, which are well matched to bounded or sub-Gau…