1 citations · 1 across the 2 of their papers we have counts for
3 papers
cs.CL2025
Know Your Limits: Entropy Estimation Modeling for Compression and Generalization
Benjamin L. Badger, Matthew Neligeorge
Language prediction is constrained by informational entropy intrinsic to language, such that there exists a limit to how accurate any language model can become and equivalently a l…
cs.CL2024
Masked Mixers for Language Generation and Retrieval
Benjamin L. Badger
Attention mechanisms that confer selective focus on a strict subset of input elements are nearly ubiquitous in language models today. We posit there to be downside to the use of at…
cs.LG2022★ 1 cited
Small Language Models for Tabular Data
Benjamin L. Badger
Supervised deep learning is most commonly applied to difficult problems defined on large and often extensively curated datasets. Here we demonstrate the ability of deep representat…