1 citations · 2 across the 9 of their papers we have counts for
4 papers · 1 filter
Where to cut, how deep: BPE and Unigram-LM on chemistry SMILES
Hunter Heidenreich
Every chemical language model reading SMILES begins with a tokenizer, yet the field has inherited byte-pair encoding (BPE) from natural language with little scrutiny. In natural la…
Large Language Models for Page Stream Segmentation
Hunter Heidenreich, Ratish Dalvi, Rohith Mukku +2
Page Stream Segmentation (PSS) is an essential prerequisite for automated document processing at scale. However, research progress has been limited by the absence of realistic publ…
EigenNoise: A Contrastive Prior to Warm-Start Representations
Hunter Scott Heidenreich, Jake Ryland Williams
In this work, we present a naive initialization scheme for word vectors based on a dense, independent co-occurrence model and provide preliminary results that suggest it is competi…
To Know by the Company Words Keep and What Else Lies in the Vicinity
Jake Ryland Williams, Hunter Scott Heidenreich
The development of state-of-the-art (SOTA) Natural Language Processing (NLP) systems has steadily been establishing new techniques to absorb the statistics of linguistic data. Thes…