The Information Geometry of Softmax: Probing and Steering

Kiho Park, Todd Nief, Yo Joong Choe +1

This paper concerns the question of how AI systems encode semantic structure into the geometric structure of their representation spaces. The motivating observation is that the nat…