1 citations · 1 across the 2 of their papers we have counts for
2 papers
cs.CL2025
Weight-based Analysis of Detokenization in Language Models: Understanding the First Stage of Inference Without Inference
Go Kamoda, Benjamin Heinzerling, Tatsuro Inaba +3
According to the stages-of-inference hypothesis, early layers of language models map their subword-tokenized input, which does not necessarily correspond to a linguistically meanin…
cs.CL2025★ 1 cited
FinchGPT: a Transformer based language model for birdsong analysis
Kosei Kobayashi, Kosuke Matsuzaki, Masaya Taniguchi +3
The long-range dependencies among the tokens, which originate from hierarchical structures, are a defining hallmark of human language. However, whether similar dependencies exist w…