Moment inequalities for functions of independent random variables

Abstract

A general method for obtaining moment inequalities for functions of independent random variables is presented. It is a generalization of the entropy method which has been used to derive concentration inequalities for such functions [Boucheron, Lugosi and Massart Ann. Probab. 31 (2003) 1583-1614], and is based on a generalized tensorization inequality due to Latala and Oleszkiewicz [Lecture Notes in Math. 1745 (2000) 147-168]. The new inequalities prove to be a versatile tool in a wide range of applications. We illustrate the power of the method by showing how it can be used to effortlessly re-derive classical inequalities including Rosenthal and Kahane-Khinchine-type inequalities for sums of independent random variables, moment inequalities for suprema of empirical processes and moment inequalities for Rademacher chaos and U-statistics. Some of these corollaries are apparently new. In particular, we generalize Talagrand's exponential inequality for Rademacher chaos of order 2 to any order. We also discuss applications for other complex functions of independent random variables, such as suprema of Boolean polynomials which include, as special cases, subgraph counting problems in random graphs.

Published at http://dx.doi.org/10.1214/009117904000000856 in the Annals of Probability (http://www.imstat.org/aop/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (2)

• Exponential and moment inequalities for U-statistics
• Between Sobolev and Poincaré

Cited by in corpus (27)

• 2004 IMS Medallion Lecture: Local Rademacher complexities and oracle inequalities in risk minimization
• Sharp nonasymptotic bounds on the norm of random matrices with independent entries
• Gaussian approximation of suprema of empirical processes
• Moving Beyond Sub-Gaussianity in High-Dimensional Statistics: Applications in Covariance Estimation and Linear Regression
• Moment inequalities for U-statistics
• Binomial-Poisson entropic inequalities and the M/M/$\infty$ queue
• Optimal concentration inequalities for dynamical systems
• Subadditivity of Matrix phi-Entropy and Concentration of Random Matrices
• On the choice of weight functions for linear representations of persistence diagrams
• Logarithmic Sobolev inequalities for finite spin systems and applications
• The convex distance inequality for dependent random variables, with applications to the stochastic travelling salesman and other problems
• Measure Concentration for Compound Poisson Distributions
• Concentration inequalities for bounded functionals via generalized log-Sobolev inequalities
• Modified log-Sobolev inequalities, Beckner inequalities and moment estimates
• Characterisations of Matrix and Operator-Valued $\Phi$-Entropies, and Operator Efron-Stein Inequalities
• Higher Order Concentration of Measure
• Characterisation of matrix entropies
• Simultaneous estimation of the mean and the variance in heteroscedastic Gaussian regression
• Modified log-Sobolev inequalities and two-level concentration
• Improving Beckner's bound via Hermite functions
• Fluctuation bounds for chaos plus noise in dynamical systems
• Effective resistance of random trees
• The LIL for $U$-statistics in Hilbert spaces
• Reweighting samples under covariate shift using a Wasserstein distance criterion
• Concentration and moment inequalities for sums of independent heavy-tailed random matrices
• Discussion of ``2004 IMS Medallion Lecture: Local Rademacher complexities and oracle inequalities in risk minimization'' by V. Koltchinskii
• Optimal convergence rates in stochastic homogenization in a balanced random environment