129 citations · 148 across the 20 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Rethinking Contextualization by Reinterpreting Attention Head Channels
Hakaze Cho, Haolin Yang, Zhun Sun +3
Contextualization, the core operation of language modeling, transmits information across words to build sentence-specific word representations. Prior works mainly study contextuali…
cs.LG2023
Tracing and Manipulating Intermediate Values in Neural Math Problem Solvers
Yuta Matsumoto, Benjamin Heinzerling, Masashi Yoshikawa +1
How language models process complex input that requires multiple steps of inference is not well understood. Previous research has shown that information about intermediate values o…