3 citations · 6 across the 5 of their papers we have counts for
5 papers
On the Effect of Pre-training for Transformer in Different Modality on Offline Reinforcement Learning
Shiro Takagi
We empirically investigate how pre-training on data of different modalities, such as language and vision, affects fine-tuning of Transformer-based models to Mujoco offline reinforc…
Empirical Study on Optimizer Selection for Out-of-Distribution Generalization
Hiroki Naganuma, Kartik Ahuja, Shiro Takagi +5
Modern deep learning systems do not generalize well when the test data distribution is slightly different to the training data distribution. While much promising work has been acco…
Convergence of neural networks to Gaussian mixture distribution
Yasuhiko Asao, Ryotaro Sakamoto, Shiro Takagi
We give a proof that, under relatively mild conditions, fully-connected feed-forward deep random neural networks converge to a Gaussian mixture distribution as only the width of th…
Image recognition via Vietoris-Rips complex
Yasuhiko Asao, Jumpei Nagase, Ryotaro Sakamoto +1
Extracting informative features from images has been of capital importance in computer vision. In this paper, we propose a way to extract such features from images by a method base…
Statistical Mechanical Analysis of Catastrophic Forgetting in Continual Learning with Teacher and Student Networks
Haruka Asanuma, Shiro Takagi, Yoshihiro Nagano +3
When a computational system continuously learns from an ever-changing environment, it rapidly forgets its past experiences. This phenomenon is called catastrophic forgetting. While…