PACIA: Parameter-Efficient Adapter for Few-Shot Molecular Property Prediction

Abstract

Molecular property prediction (MPP) plays a crucial role in biomedical applications, but it often encounters challenges due to a scarcity of labeled data. Existing works commonly adopt gradient-based strategy to update a large amount of parameters for task-level adaptation. However, the increase of adaptive parameters can lead to overfitting and poor performance. Observing that graph neural network (GNN) performs well as both encoder and predictor, we propose PACIA, a parameter-efficient GNN adapter for few-shot MPP. We design a unified adapter to generate a few adaptive parameters to modulate the message passing process of GNN. We then adopt a hierarchical adaptation mechanism to adapt the encoder at task-level and the predictor at query-level by the unified GNN adapter. Extensive results show that PACIA obtains the state-of-the-art performance in few-shot MPP problems, and our proposed hierarchical adaptation mechanism is rational and effective.

18pages

References in corpus (16)

• Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
• Prototypical Networks for Few-shot Learning
• Neural Message Passing for Quantum Chemistry
• Generalizing from a Few Examples: A Survey on Few-Shot Learning
• Principal Neighbourhood Aggregation for Graph Nets
• Analyzing Learned Molecular Representations for Property Prediction
• Few-Shot Graph Learning for Molecular Property Prediction
• Molecule Attention Transformer
• Meta-Learning without Memorization
• Fast and Flexible Multi-Task Classification Using Conditional Neural Adaptive Processes
• GNN-FiLM: Graph Neural Networks with Feature-wise Linear Modulation
• Property-Aware Relation Networks for Few-Shot Molecular Property Prediction
• Context-enriched molecule representations improve few-shot drug discovery
• Meta-learning Adaptive Deep Kernel Gaussian Processes for Molecular Property Prediction
• HyperMAML: Few-Shot Adaptation of Deep Models with Hypernetworks
• Molecule Property Prediction and Classification with Graph Hypernetworks