Fully Learnable Deep Wavelet Transform for Unsupervised Monitoring of High-Frequency Time Series

Abstract

High-Frequency (HF) signals are ubiquitous in the industrial world and are of great use for monitoring of industrial assets. Most deep learning tools are designed for inputs of fixed and/or very limited size and many successful applications of deep learning to the industrial context use as inputs extracted features, which is a manually and often arduously obtained compact representation of the original signal. In this paper, we propose a fully unsupervised deep learning framework that is able to extract a meaningful and sparse representation of raw HF signals. We embed in our architecture important properties of the fast discrete wavelet transformation (FDWT) such as (1) the cascade algorithm, (2) the conjugate quadrature filter property that links together the wavelet, the scaling and transposed filter functions, and (3) the coefficient denoising. Using deep learning, we make this architecture fully learnable: both the wavelet bases and the wavelet coefficient denoising are learnable. To achieve this objective, we propose a new activation function that performs a learnable hard-thresholding of the wavelet coefficients. With our framework, the denoising FDWT becomes a fully learnable unsupervised tool that does neither require any type of pre- nor post-processing, nor any prior knowledge on wavelet transform. We demonstrate the benefits of embedding all these properties on three machine-learning tasks performed on open source sound datasets. We perform an ablation study of the impact of each property on the performance of the architecture, achieve results well above baseline and outperform other state-of-the-art methods.

16 pages, 7 figures, 3 tables

References in corpus (4)

• An Iterative Wavelet Threshold for Signal Denoising
• Unsupervised Transfer Learning for Anomaly Detection: Application to Complementary Operating Condition Transfer
• Missing-Class-Robust Domain Adaptation by Unilateral Alignment for Fault Diagnosis
• Convolutional Neural Networks Analyzed via Convolutional Sparse Coding

Cited by in corpus (14)

• TFN: An Interpretable Neural Network with Time-Frequency Transform Embedded for Intelligent Fault Diagnosis
• TCCT: Tightly-Coupled Convolutional Transformer on Time Series Forecasting
• Filter-informed Spectral Graph Wavelet Networks for Multiscale Feature Extraction and Intelligent Fault Diagnosis
• Domain knowledge-informed Synthetic fault sample generation with Health Data Map for cross-domain Planetary Gearbox Fault Diagnosis
• Acceleration-guided Acoustic Signal Denoising Framework Based on Learnable Wavelet Transform Applied to Slab Track Condition Monitoring
• A Comparison of Deep Learning Architectures for Spacecraft Anomaly Detection
• Learnable Wavelet Packet Transform for Data-Adapted Spectrograms
• Interpreting What Typical Fault Signals Look Like via Prototype-matching
• Compressing the two-particle Green's function using wavelets: Theory and application to the Hubbard atom
• A Bidirectional Long Short Term Memory Approach for Infrastructure Health Monitoring Using On-board Vibration Response
• Physics-Constrained Denoising Autoencoders for Data-Scarce Wildfire UAV Sensing
• A Generic Machine Learning Framework for Fully-Unsupervised Anomaly Detection with Contaminated Data
• RINS-T: Robust Implicit Neural Solvers for Time Series Linear Inverse Problems
• WaveletInception Networks for on-board Vibration-Based Infrastructure Health Monitoring