3 citations · 3 across the 1 of their papers we have counts for
2 papers
cs.CL2024
From Tokens to Words: On the Inner Lexicon of LLMs
Guy Kaplan, Matanel Oren, Yuval Reif +1
Natural language is composed of words, but modern large language models (LLMs) process sub-words as input. A natural question raised by this discrepancy is whether LLMs encode word…
cs.CL2024
Transformers are Multi-State RNNs
Matanel Oren, Michael Hassid, Nir Yarden +2
Transformers are considered conceptually different from the previous generation of state-of-the-art NLP models - recurrent neural networks (RNNs). In this work, we demonstrate that…