Statistical Mechanics of Learning: A Variational Approach for Real Data

Abstract

Using a variational technique, we generalize the statistical physics approach of learning from random examples to make it applicable to real data. We demonstrate the validity and relevance of our method by computing approximate estimators for generalization errors that are based on training data alone.

4 pages, 2 figures

Cited by in corpus (5)

• Information theoretic approach to interactive learning
• Learning curves for multi-task Gaussian process regression
• Characterization of the convergence of stationary Fokker-Planck learning
• Variational Gaussian Approximation in Replica Analysis of Parametric Models
• Replica Analysis for Ensemble Techniques in Variable Selection