34 citations · 38 across the 4 of their papers we have counts for
7 papers
Bit Cipher -- A Simple yet Powerful Word Representation System that Integrates Efficiently with Language Models
Haoran Zhao, Jake Ryland Williams
While Large Language Models (LLMs) become ever more dominant, classic pre-trained word embeddings sustain their relevance through computational efficiency and nuanced linguistic in…
Explicit Foundation Model Optimization with Self-Attentive Feed-Forward Neural Units
Jake Ryland Williams, Haoran Zhao
Iterative approximation methods using backpropagation enable the optimization of neural networks, but they remain computationally expensive, especially when used at scale. This pap…
Reducing the Need for Backpropagation and Discovering Better Optima With Explicit Optimizations of Neural Networks
Jake Ryland Williams, Haoran Zhao
Iterative differential approximation methods that rely upon backpropagation have enabled the optimization of neural networks; however, at present, they remain computationally expen…
Constructing a taxonomy of fine-grained human movement and activity motifs through social media
Morgan R. Frank, Jake Ryland Williams, Lewis Mitchell +3
Profiting from the emergence of web-scale social data sets, numerous recent studies have systematically explored human mobility patterns over large populations and large time scale…
Text mixing shapes the anatomy of rank-frequency distributions: A modern Zipfian mechanics for natural language
Jake Ryland Williams, James P. Bagrow, Christopher M. Danforth +1
Natural languages are full of rules and exceptions. One of the most famous quantitative rules is Zipf's law which states that the frequency of occurrence of a word is approximately…
Human language reveals a universal positivity bias
Peter Sheridan Dodds, Eric M. Clark, Suma Desu +11
Using human evaluation of 100,000 words spread across 24 corpora in 10 languages diverse in origin and culture, we present evidence of a deep imprint of human sociality in language…