10 citations · 22 across the 14 of their papers we have counts for
14 papers
Non-negative Elastic Net Decoding for Information Retrieval
Koki Okajima, Yasutoshi Ida, Tsukasa Yoshida +1
Dense retrieval has become the dominant paradigm in information retrieval, in which each document is scored against a query by the inner product of their vector embeddings, and the…
Meta-learning Representations for Learning from Multiple Annotators
Atsutoshi Kumagai, Tomoharu Iwata, Taishi Nishiyama +2
We propose a meta-learning method for learning from multiple noisy annotators. In many applications such as crowdsourcing services, labels for supervised learning are given by mult…
Zero-shot Concept Bottleneck Models
Shin'ya Yamaguchi, Kosuke Nishida, Daiki Chijiwa +1
Concept bottleneck models (CBMs) are inherently interpretable and intervenable neural network models, which explain their final label prediction by the intermediate prediction of h…
Evaluating Time-Series Training Dataset through Lens of Spectrum in Deep State Space Models
Sekitoshi Kanai, Yasutoshi Ida, Kazuki Adachi +3
This study investigates a method to evaluate time-series datasets in terms of the performance of deep neural networks (DNNs) with state space models (deep SSMs) trained on the data…
Fast Regularized Discrete Optimal Transport with Group-Sparse Regularizers
Yasutoshi Ida, Sekitoshi Kanai, Kazuki Adachi +2
Regularized discrete optimal transport (OT) is a powerful tool to measure the distance between two discrete distributions that have been constructed from data samples on two differ…
Fast Saturating Gate for Learning Long Time Scales with Recurrent Neural Networks
Kentaro Ohno, Sekitoshi Kanai, Yasutoshi Ida
Gate functions in recurrent models, such as an LSTM and GRU, play a central role in learning various time scales in modeling time series data by using a bounded activation function…
One-vs-the-Rest Loss to Focus on Important Samples in Adversarial Training
Sekitoshi Kanai, Shin'ya Yamaguchi, Masanori Yamada +3
This paper proposes a new loss function for adversarial training. Since adversarial training has difficulties, e.g., necessity of high model capacity, focusing on important data po…
Meta-ticket: Finding optimal subnetworks for few-shot learning within randomly initialized neural networks
Daiki Chijiwa, Shin'ya Yamaguchi, Atsutoshi Kumagai +1
Few-shot learning for neural networks (NNs) is an important problem that aims to train NNs with a few data. The main challenge is how to avoid overfitting since over-parameterized…
Pruning Randomly Initialized Neural Networks with Iterative Randomization
Daiki Chijiwa, Shin'ya Yamaguchi, Yasutoshi Ida +2
Pruning the weights of randomly initialized neural networks plays an important role in the context of lottery ticket hypothesis. Ramanujan et al. (2020) empirically showed that onl…
Smoothness Analysis of Adversarial Training
Sekitoshi Kanai, Masanori Yamada, Hiroshi Takahashi +2
Deep neural networks are vulnerable to adversarial attacks. Recent studies about adversarial robustness focus on the loss landscape in the parameter space since it is related to op…
Constraining Logits by Bounded Function for Adversarial Robustness
Sekitoshi Kanai, Masanori Yamada, Shin'ya Yamaguchi +2
We propose a method for improving adversarial robustness by addition of a new bounded function just before softmax. Recent studies hypothesize that small logits (inputs of softmax)…
Absum: Simple Regularization Method for Reducing Structural Sensitivity of Convolutional Neural Networks
Sekitoshi Kanai, Yasutoshi Ida, Yasuhiro Fujiwara +2
We propose Absum, which is a regularization method for improving adversarial robustness of convolutional neural networks (CNNs). Although CNNs can accurately recognize images, rece…
Network Implosion: Effective Model Compression for ResNets via Static Layer Pruning and Retraining
Yasutoshi Ida, Yasuhiro Fujiwara
Residual Networks with convolutional layers are widely used in the field of machine learning. Since they effectively extract features from input data by stacking multiple layers, t…
Adaptive Learning Rate via Covariance Matrix Based Preconditioning for Deep Neural Networks
Yasutoshi Ida, Yasuhiro Fujiwara, Sotetsu Iwamura
Adaptive learning rate algorithms such as RMSProp are widely used for training deep neural networks. RMSProp offers efficient training since it uses first order gradients to approx…