The AI Scaling Wall of Diminishing Returns: Of LLMs, Electric Dogs, and General Relativity

Abstract

LLMs are hitting the scaling wall - compute grows 10-100x while accuracy barely moves. This note quantifies the slowdown and argues that the next leap in AI will come not from bigger models, but from smarter, more efficient ones.