Robust tracking of respiratory rate in high-dynamic range scenes using mobile thermal imaging

Abstract

The ability to monitor respiratory rate is extremely important for medical treatment, healthcare and fitness sectors. In many situations, mobile methods, which allow users to undertake every day activities, are required. However, current monitoring systems can be obtrusive, requiring users to wear respiration belts or nasal probes. Recent advances in thermographic systems have shrunk their size, weight and cost, to the point where it is possible to create smart-phone based respiration rate monitoring devices that are not affected by lighting conditions. However, mobile thermal imaging is challenged in scenes with high thermal dynamic ranges. This challenge is further amplified by general problems such as motion artifacts and low spatial resolution, leading to unreliable breathing signals. In this paper, we propose a novel and robust approach for respiration tracking which compensates for the negative effects of variations in the ambient temperature and motion artifacts and can accurately extract breathing rates in highly dynamic thermal scenes. It has three main contributions. The first is a novel Optimal Quantization technique which adaptively constructs a color mapping of absolute temperature to improve segmentation, classification and tracking. The second is the Thermal Gradient Flow method that computes thermal gradient magnitude maps to enhance accuracy of the nostril region tracking. Finally, we introduce the Thermal Voxel method to increase the reliability of the captured respiration signals compared to the traditional averaging method. We demonstrate the extreme robustness of our system to track the nostril-region and measure the respiratory rate in high dynamic range scenes.

Vol. 8, No. 10, 1 Oct 2017, Biomedical Optics Express 4480 - Full abstract can be found in this journal article (due to limited word counts of 'arXiv abstract')

Cited by in corpus (13)

• DeepBreath: Deep Learning of Breathing Patterns for Automatic Stress Recognition using Low-Cost Thermal Imaging in Unconstrained Settings
• Instant Automated Inference of Perceived Mental Stress through Smartphone PPG and Thermal Imaging
• Multispectral Video Fusion for Non-contact Monitoring of Respiratory Rate and Apnea
• Shared User Interfaces of Physiological Data: Systematic Review of Social Biofeedback Systems and Contexts in HCI
• Deep Thermal Imaging: Proximate Material Type Recognition in the Wild through Deep Learning of Spatial Surface Temperature Patterns
• Rethinking Eye-blink: Assessing Task Difficulty through Physiological Representation of Spontaneous Blinking
• Combining Visible Light and Infrared Imaging for Efficient Detection of Respiratory Infections such as COVID-19 on Portable Device
• Estimating Carotid Pulse and Breathing Rate from Near-infrared Video of the Neck
• ThermSense: Smartphone-based Breathing Sensing Platform using Noncontact Low-Cost Thermal Camera
• Physiological and Affective Computing through Thermal Imaging: A Survey
• Hearing through Vibrations: Perception of Musical Emotions by Profoundly Deaf People
• Nose Heat: Exploring Stress-induced Nasal Thermal Variability through Mobile Thermal Imaging
• Identification of deep breath while moving forward based on multiple body regions and graph signal analysis