3 papers
cs.LG2026
In-context learning of closed form solution to simple linear regression task using transformer with linear self-attention
Katsuyuki Hagiwara
In-context learning is a remarkable property of transformers and has recently received a lot of interest. In many studies of in-context learning, it has been shown that transformer…
cs.LG2025
An extension of linear self-attention for in-context learning
Katsuyuki Hagiwara
In-context learning is a remarkable property of transformers and has been the focus of recent research. An attention mechanism is a key component in transformers, in which an atten…
cs.LG2024
A semi-supervised learning using over-parameterized regression
Katsuyuki Hagiwara
Semi-supervised learning (SSL) is an important theme in machine learning, in which we have a few labeled samples and many unlabeled samples. In this paper, for SSL in a regression…