Fourier Neural Networks: A Comparative Study

Abstract

We review neural network architectures which were motivated by Fourier series and integrals and which are referred to as Fourier neural networks. These networks are empirically evaluated in synthetic and real-world tasks. Neither of them outperforms the standard neural network with sigmoid activation function in the real-world tasks. All neural networks, both Fourier and the standard one, empirically demonstrate lower approximation error than the truncated Fourier series when it comes to an approximation of a known function of multiple variables.

References in corpus (1)

• Learning Longer Memory in Recurrent Neural Networks

Cited by in corpus (5)

• The effect of data encoding on the expressive power of variational quantum machine learning models
• Fully Learnable Deep Wavelet Transform for Unsupervised Monitoring of High-Frequency Time Series
• Quantum self-learning Monte Carlo with quantum Fourier transform sampler
• SigWavNet: Learning Multiresolution Signal Wavelet Network for Speech Emotion Recognition
• FM-LLM: A frequency-enhanced mixture-of-experts framework for adapting LLMs to time series forecasting