Combining Static and Dynamic Features for Multivariate Sequence Classification

Abstract

Model precision in a classification task is highly dependent on the feature space that is used to train the model. Moreover, whether the features are sequential or static will dictate which classification method can be applied as most of the machine learning algorithms are designed to deal with either one or another type of data. In real-life scenarios, however, it is often the case that both static and dynamic features are present, or can be extracted from the data. In this work, we demonstrate how generative models such as Hidden Markov Models (HMM) and Long Short-Term Memory (LSTM) artificial neural networks can be used to extract temporal information from the dynamic data. We explore how the extracted information can be combined with the static features in order to improve the classification performance. We evaluate the existing techniques and suggest a hybrid approach, which outperforms other methods on several public datasets.

Presented at IEEE DSAA 2016

References in corpus (7)

• Scikit-learn: Machine Learning in Python
• Sequence to Sequence Learning with Neural Networks
• Practical Bayesian Optimization of Machine Learning Algorithms
• Unsupervised Learning of Video Representations using LSTMs
• Consistency of random forests
• Narrowing the Gap: Random Forests In Theory and In Practice
• Ensemble of Generative and Discriminative Techniques for Sentiment Analysis of Movie Reviews

Cited by in corpus (6)

• Combining Sequential and Aggregated Data for Churn Prediction in Casual Freemium Games
• A clustering approach to time series forecasting using neural networks: A comparative study on distance-based vs. feature-based clustering methods
• Early Predictions for Medical Crowdfunding: A Deep Learning Approach Using Diverse Inputs
• Static Seeding and Clustering of LSTM Embeddings to Learn from Loosely Time-Decoupled Events
• A Knowledge Distillation Ensemble Framework for Predicting Short and Long-term Hospitalisation Outcomes from Electronic Health Records Data
• Understanding Information Processing in Human Brain by Interpreting Machine Learning Models