Rethinking the Understanding Ability across LLMs through Mutual Information

Shaojie Wang, Sirui Ding, Na Zou

Recent advances in large language models (LLMs) have revolutionized natural language processing, yet evaluating their intrinsic linguistic understanding remains challenging. Moving…