Stochastic gradient method with accelerated stochastic dynamics
arXiv:1511.06036 · doi:10.1088/1742-6596/699/1/012019
Abstract
In this paper, we propose a novel technique to implement stochastic gradient methods, which are beneficial for learning from large datasets, through accelerated stochastic dynamics. A stochastic gradient method is based on mini-batch learning for reducing the computational cost when the amount of data is large. The stochasticity of the gradient can be mitigated by the injection of Gaussian noise, which yields the stochastic Langevin gradient method; this method can be used for Bayesian posterior sampling. However, the performance of the stochastic Langevin gradient method depends on the mixing rate of the stochastic dynamics. In this study, we propose violating the detailed balance condition to enhance the mixing rate. Recent studies have revealed that violating the detailed balance condition accelerates the convergence to a stationary state and reduces the correlation time between the samplings. We implement this violation of the detailed balance condition in the stochastic gradient Langevin method and test our method for a simple model to demonstrate its performance.
arXiv comment12 pages, proceedings for International Meeting on High-Dimensional Data Driven Science (HD3-2015) (http://www.sparse-modeling.jp/HD3-2015/index_e.html)
References in corpus (21)
- Exchange Monte Carlo Method and Application to Spin Glass Simulations
- Markov Chain Monte Carlo Method without Detailed Balance
- Adaptive Cluster Expansion for Inferring Boltzmann Machines with Noisy Data
- Small-correlation expansions for the inverse Ising problem
- Irreversible Monte Carlo Algorithms for Efficient Sampling
- Adaptive cluster expansion for the inverse Ising problem: convergence, algorithm and tests
- The Bethe approximation for solving the inverse Ising problem: a comparison with other inference methods
- Pseudolikelihood Decimation Algorithm Improving the Inference of the Interaction Network in a General Class of Ising Models
- Violation of detailed balance accelerates relaxation
- Quantum annealing with Jarzynski equality
- Susceptibility Propagation by Using Diagonal Consistency
- Mathematical understanding of detailed balance condition violation and its application to Langevin dynamics
- A mean field method with correlations determined by linear response
- Detection of cheating by decimation algorithm
- Optimization of Markov process violates detailed balance condition
- Non-equilibrium Relations for Spin Glasses with Gauge Symmetry
- Nonequilibrium work performed in quantum annealing
- L_1-regularized Boltzmann machine learning using majorizer minimization
- Fluctuation Theorems on Nishimori Line
- Belief propagation with multipoint correlations and its application to Inverse problem
- Nonequilibrium relations in spin glasses
Cited by in corpus (5)
- Eigenvalue analysis of an irreversible random walk with skew detailed balance conditions
- Sampling efficiency of transverse forces in dense liquids
- Efficient Irreversible Monte Carlo samplers
- Irreversible Boltzmann samplers in dense liquids: weak-coupling approximation and mode-coupling theory
- Transfer Entropy and Flow of Information in Two-Skyrmion System