1 citations · 1 across the 11 of their papers we have counts for
11 papers
Neural Parameter Search for Slimmer Fine-Tuned Models and Better Transfer
Guodong Du, Zitao Fang, Jing Li +10
Foundation models and their checkpoints have significantly advanced deep learning, boosting performance across various applications. However, fine-tuned models often struggle outsi…
Multi-Modality Expansion and Retention for LLMs through Parameter Merging and Decoupling
Junlin Li, Guodong DU, Jing Li +8
Fine-tuning Large Language Models (LLMs) with multimodal encoders on modality-specific data expands the modalities that LLMs can handle, leading to the formation of Multimodal LLMs…
Knowledge Fusion of Large Language Models Via Modular SkillPacks
Guodong Du, Zhuo Li, Xuanning Zhou +9
Cross-capability transfer is a key challenge in large language model (LLM) research, with applications in multi-task integration, model compression, and continual learning. Recent…
To See a World in a Spark of Neuron: Disentangling Multi-task Interference for Training-free Model Merging
Zitao Fang, Guodong DU, Shuyang Yu +6
Fine-tuning pre-trained models on targeted datasets enhances task-specific performance but often comes at the expense of generalization. Model merging techniques, which integrate m…
Enhancing Accuracy and Feature Insights in Hydration Free Energy Predictions for Small Molecules with Machine Learning
Mingjun Han, Yukai Zhang, Taotao Yu +3
The accurate prediction of solvation free energy is of significant importance as it governs the behavior of solutes in solution. In this work, we apply a variety of machine learnin…
Parameter Competition Balancing for Model Merging
Guodong Du, Junlin Lee, Jing Li +8
While fine-tuning pretrained models has become common practice, these models often underperform outside their specific domains. Recently developed model merging techniques enable t…
Meta-heuristic Optimizer Inspired by the Philosophy of Yi Jing
Yisheng Yang, Sim Kuan Goh, Qing Cai +2
Drawing inspiration from the philosophy of Yi Jing, the Yin-Yang pair optimization (YYPO) algorithm has been shown to achieve competitive performance in single objective optimizati…
Impacts of Darwinian Evolution on Pre-trained Deep Neural Networks
Guodong Du, Runhua Jiang, Senqiao Yang +5
Darwinian evolution of the biological brain is documented through multiple lines of evidence, although the modes of evolutionary changes remain unclear. Drawing inspiration from th…
Evolutionary Neural Architecture Search for 3D Point Cloud Analysis
Yisheng Yang, Guodong Du, Chean Khim Toa +2
Neural architecture search (NAS) automates neural network design by using optimization algorithms to navigate architecture spaces, reducing the burden of manual architecture design…
Knowledge Fusion By Evolving Weights of Language Models
Guodong Du, Jing Li, Hanting Liu +5
Fine-tuning pre-trained language models, particularly large language models, demands extensive computing resources and can result in varying performance outcomes across different d…
CADE: Cosine Annealing Differential Evolution for Spiking Neural Network
Runhua Jiang, Guodong Du, Shuyang Yu +3
Spiking neural networks (SNNs) have gained prominence for their potential in neuromorphic computing and energy-efficient artificial intelligence, yet optimizing them remains a form…