Learning reshapes power-law anisotropy in internal representations

Asahi Nakamuta, Jun-nosuke Teramae

Power-law anisotropy in internal representations has been observed across a wide range of biological and artificial neural systems, from state-of-the-art language models to the mou…