291 citations · 328 across the 6 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Head Dimension Matters in Language Models for Long-Context Retrieval
Seiya Tokui, Shoichiro Yamaguchi, Sosuke Kobayashi
Multi-head attention retrieves and combines context representations through query--key interactions and value aggregation, with head dimension constraining the per-head representat…
cs.LG2019★ 27 cited
Chainer: A Deep Learning Framework for Accelerating the Research Cycle
Seiya Tokui, Ryosuke Okuta, Takuya Akiba +7
Software frameworks for neural networks play a key role in the development and application of deep learning methods. In this paper, we introduce the Chainer framework, which intend…