On the Fundamental Limits of LLMs at Scale

Muhammad Ahmed Mohsin, Muhammad Umer, Ahsan Bilal +13

Large Language Models (LLMs) have benefited enormously from scaling, yet these gains are bounded by five fundamental limitations: (1) hallucination, (2) context compression, (3) re…