Variational Bayes survival analysis for unemployment modelling
arXiv:2102.02295 · doi:10.1016/j.knosys.2021.107335
Abstract
Mathematical modelling of unemployment dynamics attempts to predict the probability of a job seeker finding a job as a function of time. This is typically achieved by using information in unemployment records. These records are right censored, making survival analysis a suitable approach for parameter estimation. The proposed model uses a deep artificial neural network (ANN) as a non-linear hazard function. Through embedding, high-cardinality categorical features are analysed efficiently. The posterior distribution of the ANN parameters are estimated using a variational Bayes method. The model is evaluated on a time-to-employment data set spanning from 2011 to 2020 provided by the Slovenian public employment service. It is used to determine the employment probability over time for each individual on the record. Similar models could be applied to other questions with multi-dimensional, high-cardinality categorical data including censored records. Such data is often encountered in personal records, for example in medical records.
References in corpus (22)
- Adam: A Method for Stochastic Optimization
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- Variational Inference: A Review for Statisticians
- Stochastic Backpropagation and Approximate Inference in Deep Generative Models
- DeepSurv: Personalized Treatment Recommender System Using A Cox Proportional Hazards Deep Neural Network
- On the Convergence of Adam and Beyond
- A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay
- Pyro: Deep Universal Probabilistic Programming
- Deep Neural Networks as Gaussian Processes
- Global labor flow network reveals the hierarchical organization and dynamics of geo-industrial clusters in the world economy
- Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Review
- Scalable Variational Gaussian Process Classification
- Entity Embeddings of Categorical Variables
- Time-to-Event Prediction with Neural Networks and Cox Regression
- Automatic Differentiation Variational Inference
- Deep Survival Analysis
- Automated Variational Inference in Probabilistic Programming
- Automatic Variational Inference in Stan
- Variational Bayesian algorithm for quantized compressed sensing
- A Unifying Framework for Gaussian Process Pseudo-Point Approximations using Power Expectation Propagation
- Robust, Accurate Stochastic Optimization for Variational Inference
- Variational Bayesian Inference for Hidden Markov Models With Multivariate Gaussian Output Distributions