The information geometry of large language models is shared, learned, and controllable

Dario Picozzi

Large language models learn similar behaviours, yet it remains unclear what structure they share or how to change one behaviour without disturbing others. The Fisher-Rao geometry o…