Showing cs.CLShow all
3 papers · 1 filter
cs.CL2024
OccamLLM: Fast and Exact Language Model Arithmetic in a Single Step
Owen Dugan, Donato Manuel Jimenez Beneto, Charlotte Loh +3
Despite significant advancements in text generation and reasoning, Large Language Models (LLMs) still face challenges in accurately performing complex arithmetic operations. Langua…
cs.CL2024
On a Novel Application of Wasserstein-Procrustes for Unsupervised Cross-Lingual Learning
Guillem RamÃrez, Rumen Dangovski, Preslav Nakov +1
The emergence of unsupervised word embeddings, pre-trained on very large monolingual text corpora, is at the core of the ongoing neural revolution in Natural Language Processing (N…
cs.CL2024
Data-Informed Global Sparseness in Attention Mechanisms for Deep Neural Networks
Ileana Rugina, Rumen Dangovski, Li Jing +2
Attention mechanisms play a crucial role in the neural revolution of Natural Language Processing (NLP). With the growth of attention-based models, several pruning techniques have b…