General frequentist properties of the posterior profile distribution

Abstract

In this paper, inference for the parametric component of a semiparametric model based on sampling from the posterior profile distribution is thoroughly investigated from the frequentist viewpoint. The higher-order validity of the profile sampler obtained in Cheng and Kosorok [Ann. Statist. 36 (2008)] is extended to semiparametric models in which the infinite dimensional nuisance parameter may not have a root-$n$ convergence rate. This is a nontrivial extension because it requires a delicate analysis of the entropy of the semiparametric models involved. We find that the accuracy of inferences based on the profile sampler improves as the convergence rate of the nuisance parameter increases. Simulation studies are used to verify this theoretical result. We also establish that an exact frequentist confidence interval obtained by inverting the profile log-likelihood ratio can be estimated with higher-order accuracy by the credible set of the same type obtained from the posterior profile distribution. Our theory is verified for several specific examples.

arXiv commentPublished in at http://dx.doi.org/10.1214/07-AOS536 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (4)

• Robust Inference for Univariate Proportional Hazards Frailty Regression Models
• Penalized log-likelihood estimation for partly linear transformation models with current status data
• Penalized maximum likelihood and semiparametric second-order efficiency
• Higher order semiparametric frequentist inference with the profile sampler

Cited by in corpus (10)

• Bootstrap consistency for general semiparametric $M$-estimation
• The semiparametric Bernstein-von Mises theorem
• Finite Sample Bernstein -- von Mises Theorem for Semiparametric Problems
• Joint asymptotics for semi-nonparametric regression models with partially linear structure
• Bayesian frequentist hybrid inference
• On Deep Instrumental Variables Estimate
• Semiparametric posterior limits under local asymptotic exponentiality
• Semiparametric Bernstein-von Mises Theorem: Second Order Studies
• Semiparametric posterior limits
• Convergence Rate of K-Step Maximum Likelihood Estimate in Semiparametric Models