2 papers
cs.LG2026
Neural network initialization with nonlinear characteristics and information on hierarchical features
Hikaru Homma, Jun Ohkubo
Initialization of neural network parameters, such as weights and biases, has a crucial impact on learning performance; if chosen well, we can even avoid the need for additional tra…
cs.LG2024
Aspects of importance sampling in parameter selection for neural networks using ridgelet transform
Hikaru Homma, Jun Ohkubo
The choice of parameters in neural networks is crucial in the performance, and an oracle distribution derived from the ridgelet transform enables us to obtain suitable initial para…