DEL: Digit Entropy Loss for Numerical Learning of Large Language Models

Zhaohui Zheng, Chenhang He, Shihao Wang +3

Number prediction stands as a fundamental capability of large language models (LLMs) in mathematical problem-solving and code generation. The widely adopted maximum likelihood esti…