Fraudulent White Noise: Flat power spectra belie arbitrarily complex processes

Abstract

Power spectral densities are a common, convenient, and powerful way to analyze signals. So much so that they are now broadly deployed across the sciences and engineering---from quantum physics to cosmology, and from crystallography to neuroscience to speech recognition. The features they reveal not only identify prominent signal-frequencies but also hint at mechanisms that generate correlation and lead to resonance. Despite their near-centuries-long run of successes in signal analysis, here we show that flat power spectra can be generated by highly complex processes, effectively hiding all inherent structure in complex signals. Historically, this circumstance has been widely misinterpreted, being taken as the renowned signature of "structureless" white noise---the benchmark of randomness. We argue, in contrast, to the extent that most real-world complex systems exhibit correlations beyond pairwise statistics their structures evade power spectra and other pairwise statistical measures. As concrete physical examples, we demonstrate that fraudulent white noise hides the predictable structure of both entangled quantum systems and chaotic crystals. To make these words of warning operational, we present constructive results that explore how this situation comes about and the high toll it takes in understanding complex mechanisms. First, we give the closed-form solution for the power spectrum of a very broad class of structurally-complex signal generators. Second, we demonstrate the close relationship between eigen-spectra of evolution operators and power spectra. Third, we characterize the minimal generative structure implied by any power spectrum. Fourth, we show how to construct arbitrarily complex processes with flat power spectra. Finally, leveraging this diagnosis of the problem, we point the way to developing more incisive tools for discovering structure in complex signals.

arXiv comment31 pages, 11 figures; Supplementary Material 24 pages, 5 figures; http://csc.ucdavis.edu/~cmg/compmech/pubs/swn.htm

References in corpus (39)

• Experimental loophole-free violation of a Bell inequality using entangled electron spins separated by 1.3 km
• Planck 2018 results. I. Overview and the cosmological legacy of Planck
• Significant-loophole-free test of Bell's theorem with entangled photons
• A strong loophole-free test of local realism
• Building up spacetime with quantum entanglement
• Applied Koopmanism
• Stacking-Dependent Band Gap and Quantum Transport in Trilayer Graphene
• Spectral Singularities of Complex Scattering Potentials and Infinite Reflection and Transmission Coefficients at real Energies
• Entropy production as correlation between system and reservoir
• Non-Markovian quantum processes: complete framework and efficient characterisation
• Certified randomness in quantum physics
• Ruelle-Perron-Frobenius spectrum for Anosov maps
• Device independent quantum random number generation
• On the numerical approximation of the Perron-Frobenius and Koopman operator
• Information Flows? A Critique of Transfer Entropies
• A brief history of long memory: Hurst, Mandelbrot and the road to ARFIMA
• Spectral content of a single non-Brownian trajectory
• Occam's Quantum Razor: How Quantum Mechanics can reduce the complexity of classical models
• Power spectral density of a single Brownian trajectory: What one can and cannot learn from it
• Multivariate Dependence Beyond Shannon Information
• Randomness extraction from Bell violation with continuous parametric down conversion
• Aging Wiener-Khinchin Theorem
• A practical, unitary simulator for non-Markovian complex processes
• Computational Mechanics of Input-Output Processes: Structured transformations and the $\epsilon$-transducer
• 1/f noise for intermittent quantum dots exhibits non-stationarity and critical exponents
• Non-Hermitian Quantum Mechanics of Non-diagonalizable Hamiltonians: puzzles with self-orthogonal states
• Wiener-Khinchin theorem for nonstationary scale-invariant processes
• Inferring hidden Markov models from noisy time sequences: a method to alleviate degeneracy in molecular dynamics
• Quantum fingerprints of classical Ruelle-Pollicot resonances
• Beyond crystals: the dialectic of materials and information
• Hidden Markov models for stochastic thermodynamics
• A Closed-Form Shave from Occam's Quantum Razor: Exact Results for Quantum Compression
• Optimal stochastic modelling with unitary quantum dynamics
• Many Roads to Synchrony: Natural Time Scales and Their Algorithms
• Aperiodic crystals and beyond
• Spectral properties and classical decays in quantum open systems
• Spectral Simplicity of Apparent Complexity, Part II: Exact Complexities and Complexity Spectra
• Spectral Simplicity of Apparent Complexity, Part I: The Nondiagonalizable Metadynamics of Prediction
• Measurement-Induced Randomness and Structure in Controlled Qubit Processes

Cited by in corpus (8)

• Integrated information as a common signature of dynamical and information-processing complexity
• Quantifying Relevance in Learning and Inference
• Spectral fingerprints of non-equilibrium dynamics: The case of a Brownian gyrator
• Discovering Causal Structure with Reproducing-Kernel Hilbert Space $\epsilon$-Machines
• Frequency-frequency correlations of single-trajectory spectral densities of Gaussian processes
• Noise-to-signal ratio of single-trajectory spectral densities in centered Gaussian processes
• Memory in quantum dot blinking
• Puzzling Variation of Gamma Rays from the Sun over the Solar Cycle Revealed with Fermi-LAT