81 citations · 825 across the 77 of their papers we have counts for
14 papers · 1 filter
On-Line Learning Theory of Soft Committee Machines with Correlated Hidden Units - Steepest Gradient Descent and Natural Gradient Descent -
Masato Inoue, Hyeyoung Park, Masato Okada
The permutation symmetry of the hidden units in multilayer perceptrons causes the saddle structure and plateaus of the learning dynamics in gradient learning methods. The correlati…
Impact of deviation from precise balance of spike-timing-dependent plasticity
Narihisa Matsumoto, Masato Okada
Recent biological experimental findings have shown that synaptic plasticity depends on the relative timing of pre- and post-synaptic spikes and this is called spike-timing-dependen…
Mixed states in a sparsely encoded associative memory model storing ultrametric patterns
Tomoyuki Kimoto, Masato Okada
When mixed states are composed of s memory patterns, s types of mixed states, which can become equilibrium states of the model, can be generated. We previously reported that storag…
Associative Memory by Recurrent Neural Networks with Delay Elements
Seiji Miyoshi, Hiro-Fumi Yanai, Masato Okada
The synapses of real neural systems seem to have delays. Therefore, it is worthwhile to analyze associative memory models with delayed synapses. Thus, a sequential associative memo…
Robustness of retrieval properties against imbalance between long-term potentiation and depression of spike-timing-dependent plasticity
Narihisa Matsumoto, Masato Okada
Spike-timing-dependent plasticity (STDP) has recently been shown in some physiological studies. STDP depends on the precise temporal relationship of pre- and post-synaptic spikes.…
One step RSB scheme for the rate distortion function
Tatsuto Murayama, Masato Okada
We apply statistical mechanics to an inverse problem of linear mapping to investigate the physics of the irreversible compression. We use the replica symmetry breaking (RSB) techni…