Exploring the Impact of a Transformer's Latent Space Geometry on Downstream Task Performance

Anna C. Marbut, John W. Chandler, Travis J. Wheeler

It is generally thought that transformer-based large language models benefit from pre-training by learning generic linguistic knowledge that can be focused on a specific task durin…