3 papers
cond-mat.dis-nn2026
Dynamical mean field approach to associative memory model with non-monotonic transfer functions
Yoshiyuki Kabashima, Kazushi Mimura
The Hopfield associative memory model stores random patterns in synaptic couplings according to Hebb's rule and retrieves them through gradient descent on an energy function. This…
cond-mat.dis-nn2025
Dynamical Properties of Dense Associative Memory
Kazushi Mimura, Jun'ichi Takeuchi, Yuto Sumikawa +2
Dense associative memory, a fundamental instance of modern Hopfield networks, can store a large number of memory patterns as equilibrium states of recurrent networks. While the sta…
cs.LG2025
Neural Tangent Kernels and Fisher Information Matrices for Simple ReLU Networks with Random Hidden Weights
Jun'ichi Takeuchi, Yoshinari Takeishi, Noboru Murata +3
Fisher information matrices and neural tangent kernels (NTK) for 2-layer ReLU networks with random hidden weight are argued. We discuss the relation between both notions as a linea…