Explaining the Unique Nature of Individual Gait Patterns with Deep Learning

Abstract

Machine learning (ML) techniques such as (deep) artificial neural networks (DNN) are solving very successfully a plethora of tasks and provide new predictive models for complex physical, chemical, biological and social systems. However, in most cases this comes with the disadvantage of acting as a black box, rarely providing information about what made them arrive at a particular prediction. This black box aspect of ML techniques can be problematic especially in medical diagnoses, so far hampering a clinical acceptance. The present paper studies the uniqueness of individual gait patterns in clinical biomechanics using DNNs. By attributing portions of the model predictions back to the input variables (ground reaction forces and full-body joint angles), the Layer-Wise Relevance Propagation (LRP) technique reliably demonstrates which variables at what time windows of the gait cycle are most relevant for the characterisation of gait patterns from a certain individual. By measuring the time-resolved contribution of each input variable to the prediction of ML techniques such as DNNs, our method describes the first general framework that enables to understand and interpret non-linear ML methods in (biomechanical) gait analysis and thereby supplies a powerful tool for analysis, diagnosis and treatment of human gait.

arXiv comment17 pages (23 pages including references, 24 pages including references and auxiliary statements, 33 pages including references, auxiliary statements and and supplementary material). 5 figures, 3 tables, 4 supplementary figures, 9 supplementary tables. Accepted for publication at Scientific Reports: https://doi.org/10.1038/s41598-019-38748-8

References in corpus (6)

• Methods for Interpreting and Understanding Deep Neural Networks
• Quantum-Chemical Insights from Deep Tensor Neural Networks
• Explaining NonLinear Classification Decisions with Deep Taylor Decomposition
• Interpretable Explanations of Black Boxes by Meaningful Perturbation
• How to Explain Individual Classification Decisions
• "What is Relevant in a Text Document?": An Interpretable Machine Learning Approach

Cited by in corpus (13)

• Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications
• Unmasking Clever Hans Predictors and Assessing What Machines Really Learn
• Towards Explainable Artificial Intelligence
• Ground Truth Evaluation of Neural Network Explanations with CLEVR-XAI
• From Clustering to Cluster Explanations via Neural Networks
• On the Explanation of Machine Learning Predictions in Clinical Gait Analysis
• Explaining and Interpreting LSTMs
• Systematic Comparison of the Influence of Different Data Preprocessing Methods on the Performance of Gait Classifications Using Machine Learning
• Automated freezing of gait assessment with marker-based motion capture and multi-stage spatial-temporal graph convolutional neural networks
• Explaining Deep Learning Models for Age-related Gait Classification based on time series acceleration
• Understanding Person Identification through Gait
• Machine Learning in Biomechanics: Key Applications and Limitations in Walking, Running, and Sports Movements
• A False Sense of Privacy: Towards a Reliable Evaluation Methodology for the Anonymization of Biometric Data