6 citations · 31 across the 19 of their papers we have counts for
4 papers · 1 filter
Automatic Domain Adaptation by Transformers in In-Context Learning
Ryuichiro Hataya, Kota Matsui, Masaaki Imaizumi
Selecting or designing an appropriate domain adaptation algorithm for a given problem remains challenging. This paper presents a Transformer model that can provably approximate and…
Quantum Circuit -algebra Net
Yuka Hashimoto, Ryuichiro Hataya
This paper introduces quantum circuit -algebra net, which provides a connection between -algebra nets proposed in classical machine learning and quantum circuits. Using $…
Self-attention Networks Localize When QK-eigenspectrum Concentrates
Han Bao, Ryuichiro Hataya, Ryo Karakida
The self-attention mechanism prevails in modern machine learning. It has an interesting functionality of adaptively selecting tokens from an input sequence by modulating the degree…
Glocal Hypergradient Estimation with Koopman Operator
Ryuichiro Hataya, Yoshinobu Kawahara
Gradient-based hyperparameter optimization methods update hyperparameters using hypergradients, gradients of a meta criterion with respect to hyperparameters. Previous research use…