2 papers
cs.CL2026
Tokens, the oft-overlooked appetizer: Large language models, the distributional hypothesis, and meaning
Julia Witte Zimmerman, Denis Hudon, Kathryn Cramer +9
Tokenization is a necessary component within the current architecture of many language mod-els, including the transformer-based large language models (LLMs) of Generative AI, yet i…
cs.CL2024
A blind spot for large language models: Supradiegetic linguistic information
Julia Witte Zimmerman, Denis Hudon, Kathryn Cramer +5
Large Language Models (LLMs) like ChatGPT reflect profound changes in the field of Artificial Intelligence, achieving a linguistic fluency that is impressively, even shockingly, hu…