5 citations · 8 across the 5 of their papers we have counts for
5 papers
Graph-Based Spectral Decomposition for Parameter Coordination in Language Model Fine-Tuning
Hanlu Zhang, Yumeng Ma, Shuo Wang +2
This paper proposes a parameter collaborative optimization algorithm for large language models, enhanced with graph spectral analysis. The goal is to improve both fine-tuning effic…
Feature Alignment-Based Knowledge Distillation for Efficient Compression of Large Language Models
Shuo Wang, Chihang Wang, Jia Gao +3
This study proposes a knowledge distillation algorithm based on large language models and feature alignment, aiming to effectively transfer the knowledge of large pre-trained model…
Optimizing Multi-Task Learning for Enhanced Performance in Large Language Models
Zhen Qi, Jiajing Chen, Shuo Wang +3
This study aims to explore the performance improvement method of large language models based on GPT-4 under the multi-task learning framework and conducts experiments on two tasks:…
A Combined Encoder and Transformer Approach for Coherent and High-Quality Text Generation
Jiajing Chen, Shuo Wang, Zhen Qi +3
This research introduces a novel text generation model that combines BERT's semantic interpretation strengths with GPT-4's generative capabilities, establishing a high standard in…
Advanced RAG Models with Graph Structures: Optimizing Complex Knowledge Reasoning and Text Generation
Yuxin Dong, Shuo Wang, Hongye Zheng +3
This study aims to optimize the existing retrieval-augmented generation model (RAG) by introducing a graph structure to improve the performance of the model in dealing with complex…