37 citations · 37 across the 2 of their papers we have counts for
2 papers
cs.CL2026
Scratchpad Patching: Decoupling Compute from Patch Size in Byte-Level Language Models
Lin Zheng, Vasilisa Bashlovkina, Timothy Dozat +3
Tokenizer-free language models eliminate the tokenizer step of the language modeling pipeline by operating directly on bytes; patch-based variants further aggregate contiguous byte…
cs.CL2021★ 37 cited
Neural Data Augmentation via Example Extrapolation
Kenton Lee, Kelvin Guu, Luheng He +2
In many applications of machine learning, certain categories of examples may be underrepresented in the training data, causing systems to underperform on such "few-shot" cases at t…