Regression analysis with missing data and unknown colored noise: application to the MICROSCOPE space mission

Abstract

The analysis of physical measurements often copes with highly correlated noises and interruptions caused by outliers, saturation events or transmission losses. We assess the impact of missing data on the performance of linear regression analysis involving the fit of modeled or measured time series. We show that data gaps can significantly alter the precision of the regression parameter estimation in the presence of colored noise, due to the frequency leakage of the noise power. We present a regression method which cancels this effect and estimates the parameters of interest with a precision comparable to the complete data case, even if the noise power spectral density (PSD) is not known a priori. The method is based on an autoregressive (AR) fit of the noise, which allows us to build an approximate generalized least squares estimator approaching the minimal variance bound. The method, which can be applied to any similar data processing, is tested on simulated measurements of the MICROSCOPE space mission, whose goal is to test the Weak Equivalence Principle (WEP) with a precision of $10^{-15}$. In this particular context the signal of interest is the WEP violation signal expected to be found around a well defined frequency. We test our method with different gap patterns and noise of known PSD and find that the results agree with the mission requirements, decreasing the uncertainty by a factor 60 with respect to ordinary least squares methods. We show that it also provides a test of significance to assess the uncertainty of the measurement.

12 pages, 4 figures, to be published in Phys. Rev. D

References in corpus (9)

• The Confrontation between General Relativity and Experiment
• The generalised Lomb-Scargle periodogram. A new formalism for the floating-mean and Keplerian periodograms
• Torsion-balance tests of the weak equivalence principle
• Violations of the equivalence principle in a dilaton-runaway scenario
• A Bayesian Approach to the Detection Problem in Gravitational Wave Astronomy
• Modelling coloured residual noise in gravitational-wave signal processing
• Data series subtraction with unknown and unmodeled background noise
• Determination of the Equivalence Principle violation signal for the MICROSCOPE space mission: optimization of the signal processing
• Validation of the in-flight calibration procedures for the MICROSCOPE space mission

Cited by in corpus (11)

• MICROSCOPE mission: final results of the test of the Equivalence Principle
• Space test of the Equivalence Principle: first results of the MICROSCOPE mission
• Gravitational-wave parameter estimation with gaps in LISA: a Bayesian data augmentation method
• Result of the MICROSCOPE Weak Equivalence Principle test
• LISA Pathfinder Performance Confirmed in an Open-Loop Configuration: Results from the Free-Fall Actuation Mode
• Exponential shapelets: basis functions for data analysis of isolated features
• Gaussian regression and power spectral density estimation with missing data: The MICROSCOPE space mission as a case study
• MICROSCOPE: systematic errors
• MICROSCOPE mission: Data analysis principle
• Dealing with missing data: An inpainting application to the MICROSCOPE space mission
• Dealing with missing data in the MICROSCOPE space mission: An adaptation of inpainting to handle colored-noise data