Deep Neural Networks for Detecting Statistical Model Misspecifications. The Case of Measurement Invariance

Abstract

While in recent years a number of new statistical approaches have been proposed to model group differences with a different assumption on the nature of the measurement invariance of the instruments, the tools for detecting local misspecifications of these models have not been fully developed yet. In this study, we present a novel approach using a Deep Neural Network (DNN). We compared the proposed model with the most popular traditional methods: Modification Indices (MI) and Expected Parameter Change (EPC) indicators from the Confirmatory Factor Analysis (CFA) modeling, logistic DIF detection, and sequential procedure introduced with the CFA alignment approach. Simulation studies show that the proposed method outperformed traditional methods in almost all scenarios, or it was at least as accurate as the best one. We also provide an empirical example utilizing European Social Survey data including items known to be miss-translated, which are correctly identified with presented DNN approach.

arXiv comment46 pages, 7 figures, 4 tables

References in corpus (13)

• Adam: A Method for Stochastic Optimization
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
• Improving neural networks by preventing co-adaptation of feature detectors
• Medical Image Analysis using Convolutional Neural Networks: A Review
• Searching for Exotic Particles in High-Energy Physics with Deep Learning
• Deep learning to represent sub-grid processes in climate models
• AtomNet: A Deep Convolutional Neural Network for Bioactivity Prediction in Structure-based Drug Discovery
• Multi-task Neural Networks for QSAR Predictions
• The large learning rate phase of deep learning: the catapult mechanism
• Understanding the Disharmony between Dropout and Batch Normalization by Variance Shift
• Exploratory and Confirmatory Factor Analyses of Religiosity. A Four-Factor Conceptual Model
• Using Deep Neural Networks to Automate Large Scale Statistical Analysis for Big Data Applications