A Deep Learning Framework for Assessing Physical Rehabilitation Exercises

Abstract

Computer-aided assessment of physical rehabilitation entails evaluation of patient performance in completing prescribed rehabilitation exercises, based on processing movement data captured with a sensory system. Despite the essential role of rehabilitation assessment toward improved patient outcomes and reduced healthcare costs, existing approaches lack versatility, robustness, and practical relevance. In this paper, we propose a deep learning-based framework for automated assessment of the quality of physical rehabilitation exercises. The main components of the framework are metrics for quantifying movement performance, scoring functions for mapping the performance metrics into numerical scores of movement quality, and deep neural network models for generating quality scores of input movements via supervised learning. The proposed performance metric is defined based on the log-likelihood of a Gaussian mixture model, and encodes low-dimensional data representation obtained with a deep autoencoder network. The proposed deep spatio-temporal neural network arranges data into temporal pyramids, and exploits the spatial characteristics of human movements by using sub-networks to process joint displacements of individual body parts. The presented framework is validated using a dataset of ten rehabilitation exercises. The significance of this work is that it is the first that implements deep neural networks for assessment of rehabilitation performance.

arXiv comment10 pages, 7 figures

References in corpus (5)

• Two-Stream Convolutional Networks for Action Recognition in Videos
• NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understanding
• An End-to-End Spatio-Temporal Attention Model for Human Action Recognition from Skeleton Data
• Hierarchical Attention Network for Action Recognition in Videos
• A Fine-to-Coarse Convolutional Neural Network for 3D Human Action Recognition

Cited by in corpus (9)

• A Review of Computational Approaches for Evaluation of Rehabilitation Exercises
• D-STGCNT: A Dense Spatio-Temporal Graph Conv-GRU Network based on transformer for assessment of patient physical rehabilitation
• Automatic Assessment of Functional Movement Screening Exercises with Deep Learning Architectures
• Rehabilitation Exercise Quality Assessment through Supervised Contrastive Learning with Hard and Soft Negatives
• MAGR: Manifold-Aligned Graph Regularization for Continual Action Quality Assessment
• MR-STGN: Multi-Residual Spatio Temporal Graph Network Using Attention Fusion for Patient Action Assessment
• Continual Learning from Synthetic Data for a Humanoid Exercise Robot
• ExeChecker: Where Did I Go Wrong?
• A Standardized Benchmark for Skeleton-Based Rehabilitation Assessment Using Deep Learning