3 papers
cs.LG2023
Free energy of Bayesian Convolutional Neural Network with Skip Connection
Shuya Nagayasu, Sumio Watanabe
Since the success of Residual Network(ResNet), many of architectures of Convolutional Neural Networks(CNNs) have adopted skip connection. While the generalization performance of CN…
cs.LG2023
Bayesian Free Energy of Deep ReLU Neural Network in Overparametrized Cases
Shuya Nagayasu, Sumio Watanabe
In many research fields in artificial intelligence, it has been shown that deep neural networks are useful to estimate unknown functions on high dimensional input spaces. However,…
math.ST2020
Asymptotic Behavior of Free Energy When Optimal Probability Distribution Is Not Unique
Shuya Nagayasu, Sumio Watanabe
Bayesian inference is a widely used statistical method. The free energy and generalization loss, which are used to estimate the accuracy of Bayesian inference, are known to be smal…