Probabilistic Subspace Manifolds for Contextual Inference in Large Language Models

Christopher Nightingale, Dominic Lavington, Jonathan Thistlethwaite +3

Representing token embeddings as probability distributions over learned manifolds allows for more flexible contextual inference, reducing representational rigidity while enhancing…