10 citations · 22 across the 14 of their papers we have counts for
3 papers · 1 filter
Fast Saturating Gate for Learning Long Time Scales with Recurrent Neural Networks
Kentaro Ohno, Sekitoshi Kanai, Yasutoshi Ida
Gate functions in recurrent models, such as an LSTM and GRU, play a central role in learning various time scales in modeling time series data by using a bounded activation function…
One-vs-the-Rest Loss to Focus on Important Samples in Adversarial Training
Sekitoshi Kanai, Shin'ya Yamaguchi, Masanori Yamada +3
This paper proposes a new loss function for adversarial training. Since adversarial training has difficulties, e.g., necessity of high model capacity, focusing on important data po…
Meta-ticket: Finding optimal subnetworks for few-shot learning within randomly initialized neural networks
Daiki Chijiwa, Shin'ya Yamaguchi, Atsutoshi Kumagai +1
Few-shot learning for neural networks (NNs) is an important problem that aims to train NNs with a few data. The main challenge is how to avoid overfitting since over-parameterized…