8 citations · 12 across the 10 of their papers we have counts for
3 papers · 1 filter
EigenNoise: A Contrastive Prior to Warm-Start Representations
Hunter Scott Heidenreich, Jake Ryland Williams
In this work, we present a naive initialization scheme for word vectors based on a dense, independent co-occurrence model and provide preliminary results that suggest it is competi…
To Know by the Company Words Keep and What Else Lies in the Vicinity
Jake Ryland Williams, Hunter Scott Heidenreich
The development of state-of-the-art (SOTA) Natural Language Processing (NLP) systems has steadily been establishing new techniques to absorb the statistics of linguistic data. Thes…
Is space a word, too?
Jake Ryland Williams, Giovanni C. Santia
For words, rank-frequency distributions have long been heralded for adherence to a potentially-universal phenomenon known as Zipf's law. The hypothetical form of this empirical phe…