Extracting strong measurement noise from stochastic series: applications to empirical data

Abstract

It is a big challenge in the analysis of experimental data to disentangle the unavoidable measurement noise from the intrinsic dynamical noise. Here we present a general operational method to extract measurement noise from stochastic time series, even in the case when the amplitudes of measurement noise and uncontaminated signal are of the same order of magnitude. Our approach is based on a recently developed method for a nonparametric reconstruction of Langevin processes. Minimizing a proper non-negative function the procedure is able to correctly extract strong measurement noise and to estimate drift and diffusion coefficients in the Langevin equation describing the evolution of the original uncorrupted signal. As input, the algorithm uses only the two first conditional moments extracted directly from the stochastic series and is therefore suitable for a broad panoply of different signals. To demonstrate the power of the method we apply the algorithm to synthetic as well as climatological measurement data, namely the daily North Atlantic Oscillation index, shedding new light on the discussion of the nature of its underlying physical processes.

15 pages, 9 figures

References in corpus (3)

• Levy Flights, Non-local Search and Simulated Annealing
• On the proper reconstruction of complex dynamical systems spoilt by strong measurement noise
• Markov properties in presence of measurement noise

Cited by in corpus (13)

• Air quality prediction using optimal neural networks with stochastic variables
• The Langevin Approach: An R Package for Modeling Markov Processes
• Estimation of drift and diffusion functions from time series data: A maximum likelihood framework
• Robust identification of harmonic oscillator parameters using the adjoint Fokker-Planck equation
• Analysis of stochastic time series in the presence of strong measurement noise
• Uncovering wind turbine properties through two-dimensional stochastic modeling of wind dynamics
• Analysis and data-driven reconstruction of bivariate jump-diffusion processes
• Principal axes for stochastic dynamics
• Searching for optimal variables in real multivariate stochastic data
• A simple noise reduction method based on nonlinear forecasting
• Reconstructing the intermittent dynamics of the torque in wind turbines
• Quantifying Tipping Risks in Power Grids and beyond
• Fatigue Loads Estimation Through a Simple Stochastic Model