Lasso and probabilistic inequalities for multivariate point processes

Abstract

Due to its low computational cost, Lasso is an attractive regularization method for high-dimensional statistical settings. In this paper, we consider multivariate counting processes depending on an unknown function parameter to be estimated by linear combinations of a fixed dictionary. To select coefficients, we propose an adaptive ${\ell }_1$-penalization methodology, where data-driven weights of the penalty are derived from new Bernstein type inequalities for martingales. Oracle inequalities are established under assumptions on the Gram matrix of the dictionary. Nonasymptotic probabilistic results for multivariate Hawkes processes are proven, which allows us to check these assumptions by considering general dictionaries based on histograms, Fourier or wavelet bases. Motivated by problems of neuronal activity inference, we finally carry out a simulation study for multivariate Hawkes processes and compare our methodology with the adaptive Lasso procedure proposed by Zou in (J. Amer. Statist. Assoc. 101 (2006) 1418-1429). We observe an excellent behavior of our procedure. We rely on theoretical aspects for the essential question of tuning our methodology. Unlike adaptive Lasso of (J. Amer. Statist. Assoc. 101 (2006) 1418-1429), our tuning procedure is proven to be robust with respect to all the parameters of the problem, revealing its potential for concrete purposes, in particular in neuroscience.

Published at http://dx.doi.org/10.3150/13-BEJ562 in the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm)

References in corpus (7)

• Asymptotic properties of bridge estimators in sparse high-dimensional regression models
• High-dimensional generalized linear models and the lasso
• Sparsity oracle inequalities for the Lasso
• Aggregation for Gaussian regression
• Exponential inequalities for self-normalized martingales with applications
• Recurrent Interactions in Spiking Networks with Arbitrary Topology
• Stochastic kinetic models: Dynamic independence, modularity and graphs

Cited by in corpus (15)

• An estimation procedure for the Hawkes process
• The role of volume in order book dynamics: a multivariate Hawkes process analysis
• Renewal in Hawkes processes with self-excitation and inhibition
• Modeling bid and ask price dynamics with an extended Hawkes process and its empirical applications for high-frequency stock market data
• A system of interacting neurons with short term synaptic facilitation
• The Effect of Graph Connecitivity on Metastability on a Stochastic System of Spiking Neurons
• Analyzing order flows in limit order books with ratios of Cox-type intensities
• Limit theorems for Hawkes processes including inhibition
• The statistical physics of discovering exogenous and endogenous factors in a chain of events
• Poincaré type inequalities for compact degenerate pure jump Markov processes
• Generalized Evolutionary Point Processes: Model Specifications and Model Comparison
• Modified log-Sobolev inequality for a compact PJMP with degenerate jumps
• Exponential moments for Hawkes processes under minimal assumptions
• Causal Discovery in High-Dimensional Point Process Networks with Hidden Nodes
• Scaling limits for supercritical nearly unstable Hawkes processes