A Direct Estimation of High Dimensional Stationary Vector Autoregressions

Abstract

The vector autoregressive (VAR) model is a powerful tool in modeling complex time series and has been exploited in many fields. However, fitting high dimensional VAR model poses some unique challenges: On one hand, the dimensionality, caused by modeling a large number of time series and higher order autoregressive processes, is usually much higher than the time series length; On the other hand, the temporal dependence structure in the VAR model gives rise to extra theoretical challenges. In high dimensions, one popular approach is to assume the transition matrix is sparse and fit the VAR model using the "least squares" method with a lasso-type penalty. In this manuscript, we propose an alternative way in estimating the VAR model. The main idea is, via exploiting the temporal dependence structure, to formulate the estimating problem into a linear program. There is instant advantage for the proposed approach over the lasso-type estimators: The estimation equation can be decomposed into multiple sub-equations and accordingly can be efficiently solved in a parallel fashion. In addition, our method brings new theoretical insights into the VAR model analysis. So far the theoretical results developed in high dimensions (e.g., Song and Bickel (2011) and Kock and Callot (2012)) mainly pose assumptions on the design matrix of the formulated regression problems. Such conditions are indirect about the transition matrices and not transparent. In contrast, our results show that the operator norm of the transition matrices plays an important role in estimation accuracy. We provide explicit rates of convergence for both estimation and prediction. In addition, we provide thorough experiments on both synthetic and real-world equity data to show that there are empirical advantages of our method over the lasso-type estimators in both parameter estimation and forecasting.

36 pages, 3 figure

References in corpus (1)

• Learning Networks of Stochastic Differential Equations

Cited by in corpus (28)

• Bayesian Temporal Factorization for Multidimensional Time Series Prediction
• Principal component analysis for second-order stationary vector time series
• Change-Point Estimation in High-Dimensional Markov Random Field Models
• High Dimensional Forecasting via Interpretable Vector Autoregression
• FNETS: Factor-adjusted network estimation and forecasting for high-dimensional time series
• Regularized estimation of linear functionals of precision matrices for high-dimensional time series
• Estimating Structured Vector Autoregressive Model
• Foundations of Sequence-to-Sequence Modeling for Time Series
• Localizing Changes in High-Dimensional Vector Autoregressive Processes
• Bootstrap Based Inference for Sparse High-Dimensional Time Series Models
• High-Dimensional Low-Rank Tensor Autoregressive Time Series Modeling
• High-dimensional vector autoregressive time series modeling via tensor decomposition
• High Dimensional and Banded Vector Autoregressions
• Multi-linear Tensor Autoregressive Models
• Sparse transition matrix estimation for high-dimensional and locally stationary vector autoregressive models
• Sparse and Low-bias Estimation of High Dimensional Vector Autoregressive Models
• Confidence intervals for parameters in high-dimensional sparse vector autoregression
• Statistical Estimation of High-Dimensional Vector Autoregressive Models
• Penalised inference for autoregressive moving average models with time-dependent predictors
• A General Theory for Large-Scale Curve Time Series via Functional Stability Measure
• Direct estimation of differential Granger causality between two high-dimensional time series
• Sparse estimation of parameter support sets for generalized vector autoregressions by resampling and model aggregation
• Minimax Estimation of Partially-Observed Vector AutoRegressions
• Simultaneous Statistical Inference for Second Order Parameters of Time Series under Weak Conditions
• Testing for high-dimensional network parameters in auto-regressive models
• A Bernstein-type Inequality for High Dimensional Linear Processes with Applications to Robust Estimation of Time Series Regressions
• Modeling high dimensional multichannel brain signals
• Estimating high-dimensional Markov-switching VARs