Data Fusion of Deep Learned Molecular Embeddings for Property Prediction

Abstract

Data-driven approaches such as deep learning can result in predictive models for material properties with exceptional accuracy and efficiency. However, in many applications, data is sparse, severely limiting their accuracy and applicability. To improve predictions, techniques such as transfer learning and multitask learning have been used. The performance of multitask learning models depends on the strength of the underlying correlations between tasks and the completeness of the data set. Standard multitask models tend to underperform when trained on sparse data sets with weakly correlated properties. To address this gap, we fuse deep-learned embeddings generated by independent pretrained single-task models, resulting in a multitask model that inherits rich, property-specific representations. By reusing (rather than retraining) these embeddings, the resulting fused model outperforms standard multitask models and can be extended with fewer trainable parameters. We demonstrate this technique on a widely used benchmark data set of quantum chemistry data for small molecules as well as a newly compiled sparse data set of experimental data collected from literature and our own quantum chemistry and thermochemical calculations.

J. Chem. Inf. Model. 2025

References in corpus (9)

• A Spectral Analysis Method for Automated Generation of Quantum-Accurate Interatomic Potentials
• Polymer Informatics with Multi-Task Learning
• JARVIS-Leaderboard: A Large Scale Benchmark of Materials Design Methods
• Integrating Chemical Language and Molecular Graph in Multimodal Fused Deep Learning for Drug Property Prediction
• PARC: Physics-Aware Recurrent Convolutional Neural Networks to Assimilate Meso-scale Reactive Mechanics of Energetic Materials
• A physics-aware deep learning model for energy localization in multiscale shock-to-detonation simulations of heterogeneous energetic materials
• High Pressure and Temperature Neural Network Reactive Force Field for Energetic Materials
• A Universal Framework for Accurate and Efficient Geometric Deep Learning of Molecular Systems
• Multitask methods for predicting molecular properties from heterogeneous data