Point Neuron Learning: A New Physics-Informed Neural Network Architecture

Abstract

Machine learning and neural networks have advanced numerous research domains, but challenges such as large training data requirements and inconsistent model performance hinder their application in certain scientific problems. To overcome these challenges, researchers have investigated integrating physics principles into machine learning models, mainly through: (i) physics-guided loss functions, generally termed as physics-informed neural networks, and (ii) physics-guided architectural design. While both approaches have demonstrated success across multiple scientific disciplines, they have limitations including being trapped to a local minimum, poor interpretability, and restricted generalizability. This paper proposes a new physics-informed neural network (PINN) architecture that combines the strengths of both approaches by embedding the fundamental solution of the wave equation into the network architecture, enabling the learned model to strictly satisfy the wave equation. The proposed point neuron learning method can model an arbitrary sound field based on microphone observations without any dataset. Compared to other PINN methods, our approach directly processes complex numbers and offers better interpretability and generalizability. We evaluate the versatility of the proposed architecture by a sound field reconstruction problem in a reverberant environment. Results indicate that the point neuron method outperforms two competing methods and can efficiently handle noisy environments with sparse microphone observations.

15 pages, 9 figures. Published in EURASIP Journal on Audio Speech and Music Processing

References in corpus (11)

• Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network
• Theory-guided Data Science: A New Paradigm for Scientific Discovery from Data
• Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networks
• Physics-informed Neural Networks (PINNs) for Wave Propagation and Full Waveform Inversions
• Flow over an espresso cup: Inferring 3D velocity and pressure fields from tomographic background oriented schlieren videos via physics-informed neural networks
• Physics-informed neural networks of the Saint-Venant equations for downscaling a large-scale river model
• A General Approach to Seismic Inversion with Automatic Differentiation
• Learning in Sinusoidal Spaces with Physics-Informed Neural Networks
• Physics-informed neural networks for myocardial perfusion MRI quantification
• Physics-informed neural networks for one-dimensional sound field predictions with parameterized sources and impedance boundaries
• Implicit neural representation with physics-informed neural networks for the reconstruction of the early part of room impulse responses