When can isotropy help adapt LLMs' next word prediction to numerical domains?

Rashed Shelim, Shengzhe Xu, Walid Saad +1

Vector representations of contextual embeddings learned by pre-trained large language models (LLMs) are effective in various downstream tasks in numerical domains such as time seri…