Deep transfer operator learning for partial differential equations under conditional shift

Abstract

Transfer learning (TL) enables the transfer of knowledge gained in learning to perform one task (source) to a related but different task (target), hence addressing the expense of data acquisition and labeling, potential computational power limitations, and dataset distribution mismatches. We propose a new TL framework for task-specific learning (functional regression in partial differential equations (PDEs)) under conditional shift based on the deep operator network (DeepONet). Task-specific operator learning is accomplished by fine-tuning task-specific layers of the target DeepONet using a hybrid loss function that allows for the matching of individual target samples while also preserving the global properties of the conditional distribution of target data. Inspired by the conditional embedding operator theory, we minimize the statistical distance between labeled target data and the surrogate prediction on unlabeled target data by embedding conditional distributions onto a reproducing kernel Hilbert space. We demonstrate the advantages of our approach for various TL scenarios involving nonlinear PDEs under diverse conditions due to shift in the geometric domain and model dynamics. Our TL framework enables fast and efficient learning of heterogeneous tasks despite significant differences between the source and target domains.

33 pages, 9 figures

Cited by in corpus (11)

• Long-term predictions of turbulence by implicit U-Net enhanced Fourier neural operator
• A multi-fidelity deep operator network (DeepONet) for fusing simulation and monitoring data: Application to real-time settlement prediction during tunnel construction
• In-Context Operator Learning with Data Prompts for Differential Equation Problems
• Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flow
• Synergistic Learning with Multi-Task DeepONet for Efficient PDE Problem Solving
• Variational operator learning: A unified paradigm marrying training neural operators and solving partial differential equations
• On the locality of local neural operator in learning fluid dynamics
• Material-Response-Informed DeepONet and its Application to Polycrystal Stress-strain Prediction in Crystal Plasticity
• Local neural operator for solving transient partial differential equations on varied domains
• G2Φnet: Relating Genotype and Biomechanical Phenotype of Tissues with Deep Learning
• Learnable-Differentiable Finite Volume Solver for Accelerated Simulation of Flows