Asymptotics for minimisers of convex processes

Abstract

By means of two simple convexity arguments we are able to develop a general method for proving consistency and asymptotic normality of estimators that are defined by minimisation of convex criterion functions. This method is then applied to a fair range of different statistical estimation problems, including Cox regression, logistic and Poisson regression, least absolute deviation regression outside model conditions, and pseudo-likelihood estimation for Markov chains. Our paper has two aims. The first is to exposit the method itself, which in many cases, under reasonable regularity conditions, leads to new proofs that are simpler than the traditional proofs. Our second aim is to exploit the method to its limits for logistic regression and Cox regression, where we seek asymptotic results under as weak regularity conditions as possible. For Cox regression in particular we are able to weaken previously published regularity conditions substantially.

Unpublished, but much cited, preprint from 1993

Cited by in corpus (33)

• Quantile-adaptive model-free variable screening for high-dimensional heterogeneous data
• Oracle inequalities for the lasso in the Cox model
• Uniform bias study and Bahadur representation for local polynomial estimators of the conditional quantile function
• Gibbs posterior concentration rates under sub-exponential type losses
• Bayesian analysis for a generalised Dirichlet process prior
• A semiparametric scale-mixture regression model and predictive recursion maximum likelihood
• Adaptive Risk Bounds in Univariate Total Variation Denoising and Trend Filtering
• Multivariate extensions of isotonic regression and total variation denoising via entire monotonicity and Hardy-Krause variation
• Maximum sampled conditional likelihood for informative subsampling
• Double Robust Semi-Supervised Inference for the Mean: Selection Bias under MAR Labeling with Decaying Overlap
• Logistic Regression for Massive Data with Rare Events
• Nonuniform Negative Sampling and Log Odds Correction with Rare Events Data
• AIC for Non-concave Penalized Likelihood Method
• More Efficient Estimation for Logistic Regression with Optimal Subsample
• Optimal subsampling for quantile regression in big data
• Deterministic Inequalities for Smooth M-estimators
• Performance of Efron and Tibshirani's semiparametric density estimator
• Normalised Local Hazard Plots
• Asymptotic consistency and order specification for logistic classifier chains in multi-label learning
• The $l_q$ consistency of the Dantzig Selector for Cox's Proportional Hazards Model
• Approximate Laplace approximations for scalable model selection
• Local Bayesian Regression
• Semiparametric Copula Quantile Regression for Complete or Censored Data
• Estimation and Selection Properties of the LAD Fused Lasso Signal Approximator
• Quantile regression with generated dependent variable and covariates
• Nonparametric posterior learning for emission tomography with multimodal data
• Optimal stable Ornstein-Uhlenbeck regression
• Estimation of Graphical Models using the $L_{1,2}$ Norm
• Infinitely Stochastic Micro Forecasting
• Statistical Inference from Partially Nominated Sets: An Application to Estimating the Prevalence of Osteoporosis
• Concentration of the Frobenius norm of generalized matrix inverses
• Asymptotic theory for maximum likelihood estimates in reduced-rank multivariate generalised linear models
• On the Consistency of the Bias Correction Term of the AIC for the Non-Concave Penalized Likelihood Method