Deep Neural Networks for Choice Analysis: Extracting Complete Economic Information for Interpretation

Abstract

While deep neural networks (DNNs) have been increasingly applied to choice analysis showing high predictive power, it is unclear to what extent researchers can interpret economic information from DNNs. This paper demonstrates that DNNs can provide economic information as complete as classical discrete choice models (DCMs). The economic information includes choice predictions, choice probabilities, market shares, substitution patterns of alternatives, social welfare, probability derivatives, elasticities, marginal rates of substitution (MRS), and heterogeneous values of time (VOT). Unlike DCMs, DNNs can automatically learn the utility function and reveal behavioral patterns that are not prespecified by domain experts. However, the economic information obtained from DNNs can be unreliable because of the three challenges associated with the automatic learning capacity: high sensitivity to hyperparameters, model non-identification, and local irregularity. To demonstrate the strength and challenges of DNNs, we estimated the DNNs using a stated preference survey, extracted the full list of economic information from the DNNs, and compared them with those from the DCMs. We found that the economic information either aggregated over trainings or population is more reliable than the disaggregate information of the individual observations or trainings, and that even simple hyperparameter searching can significantly improve the reliability of the economic information extracted from the DNNs. Future studies should investigate other regularizations and DNN architectures, better optimization algorithms, and robust DNN training methods to address DNNs' three challenges, to provide more reliable economic information from DNN-based choice models.

References in corpus (25)

• Adam: A Method for Stochastic Optimization
• Distilling the Knowledge in a Neural Network
• Improving neural networks by preventing co-adaptation of feature detectors
• Practical Bayesian Optimization of Machine Learning Algorithms
• Intriguing properties of neural networks
• Neural Architecture Search with Reinforcement Learning
• Towards A Rigorous Science of Interpretable Machine Learning
• Axiomatic Attribution for Deep Networks
• Methods for Interpreting and Understanding Deep Neural Networks
• Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samples
• Understanding deep learning requires rethinking generalization
• Deep Learning for Short-Term Traffic Flow Prediction
• SmoothGrad: removing noise by adding noise
• How to Explain Individual Classification Decisions
• The Loss Surfaces of Multilayer Networks
• Object Detectors Emerge in Deep Scene CNNs
• Identifying and attacking the saddle point problem in high-dimensional non-convex optimization
• Scalable Bayesian Optimization Using Deep Neural Networks
• Adversarial Machine Learning at Scale
• Improving the Adversarial Robustness and Interpretability of Deep Neural Networks by Regularizing their Input Gradients
• Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks
• BOHB: Robust and Efficient Hyperparameter Optimization at Scale
• The power of deeper networks for expressing natural functions
• Scalable Population Synthesis with Deep Generative Modeling
• Norm-Based Capacity Control in Neural Networks

Cited by in corpus (4)

• Decoding pedestrian and automated vehicle interactions using immersive virtual reality and interpretable deep learning
• A Neural-embedded Choice Model: TasteNet-MNL Modeling Taste Heterogeneity with Flexibility and Interpretability
• Discrete Choice Analysis with Machine Learning Capabilities
• Deep Neural Networks for Choice Analysis: Architectural Design with Alternative-Specific Utility Functions