Gauge Freedom and Metric Dependence in Neural Representation Spaces

Jericho Cain

Neural network representations are often analyzed as vectors in a fixed Euclidean space. However, their coordinates are not uniquely defined. If a hidden representation is transfor…