4 papers
Rényi Attention Entropy for Patch Pruning
Hiroaki Aizawa, Yuki Igaue
Transformers are strong baselines in both vision and language because self-attention captures long-range dependencies across tokens. However, the cost of self-attention grows quadr…
Logit Mixture Outlier Exposure for Fine-grained Out-of-Distribution Detection
Akito Shinohara, Kohei Fukuda, Hiroaki Aizawa
The ability to detect out-of-distribution data is essential not only for ensuring robustness against unknown or unexpected input data but also for improving the generalization perf…
Class-wise Flooding Regularization for Imbalanced Image Classification
Hiroaki Aizawa, Yuta Naito, Kohei Fukuda
The purpose of training neural networks is to achieve high generalization performance on unseen inputs. However, when trained on imbalanced datasets, a model's prediction tends to…
Taylor Outlier Exposure
Kohei Fukuda, Hiroaki Aizawa
Out-of-distribution (OOD) detection is the task of identifying data sampled from distributions that were not used during training. This task is essential for reliable machine learn…