Separable factor analysis with applications to mortality data

Abstract

Human mortality data sets can be expressed as multiway data arrays, the dimensions of which correspond to categories by which mortality rates are reported, such as age, sex, country and year. Regression models for such data typically assume an independent error distribution or an error model that allows for dependence along at most one or two dimensions of the data array. However, failing to account for other dependencies can lead to inefficient estimates of regression parameters, inaccurate standard errors and poor predictions. An alternative to assuming independent errors is to allow for dependence along each dimension of the array using a separable covariance model. However, the number of parameters in this model increases rapidly with the dimensions of the array and, for many arrays, maximum likelihood estimates of the covariance parameters do not exist. In this paper, we propose a submodel of the separable covariance model that estimates the covariance matrix for each dimension as having factor analytic structure. This model can be viewed as an extension of factor analysis to array-valued data, as it uses a factor model to estimate the covariance along each dimension of the array. We discuss properties of this model as they relate to ordinary factor analysis, describe maximum likelihood and Bayesian estimation methods, and provide a likelihood ratio testing procedure for selecting the factor model ranks. We apply this methodology to the analysis of data from the Human Mortality Database, and show in a cross-validation experiment how it outperforms simpler methods. Additionally, we use this model to impute mortality rates for countries that have no mortality data for several years. Unlike other approaches, our methodology is able to estimate similarities between the mortality rates of countries, time periods and sexes, and use this information to assist with the imputations.

Published in at http://dx.doi.org/10.1214/13-AOAS694 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (3)

• Horseshoes in multidimensional scaling and local kernel methods
• Transposable regularized covariance models with an application to missing data imputation
• Bayesian inference for general Gaussian graphical models with application to multivariate lattice data

Cited by in corpus (11)

• Supervised multiway factorization
• A Singular Value Decomposition-based Factorization and Parsimonious Component Model of Demographic Quantities Correlated by Age: Predicting Complete Demographic Age Schedules with Few Parameters
• Modelling heterogeneity in Latent Space Models for Multidimensional Networks
• Analysis of multiview legislative networks with structured matrix factorization: Does Twitter influence translate to the real world?
• Restricted Covariance Priors with Applications in Spatial Statistics
• Bayesian Joint Spike-and-Slab Graphical Lasso
• Parsimonious Tensor Response Regression
• A stratified age-period-cohort model for spatial heterogeneity in all-cause mortality
• A Doubly-Enhanced EM Algorithm for Model-Based Tensor Clustering
• A General Age-Specific Mortality Model with An Example Indexed by Child or Child/Adult Mortality
• Bayesian Multi-scale Modeling of Factor Matrix without using Partition Tree