338 citations · 367 across the 22 of their papers we have counts for
4 papers · 1 filter
Mitigate Negative Transfer with Similarity Heuristic Lifelong Prompt Tuning
Chenyuan Wu, Gangwei Jiang, Defu Lian
Lifelong prompt tuning has significantly advanced parameter-efficient lifelong learning with its efficiency and minimal storage demands on various tasks. Our empirical studies, how…
DB-GPT-Hub: Towards Open Benchmarking Text-to-SQL Empowered by Large Language Models
Fan Zhou, Siqiao Xue, Danrui Qi +8
Large language models (LLMs) becomes the dominant paradigm for the challenging task of text-to-SQL. LLM-empowered text-to-SQL methods are typically categorized into prompting-based…
Refine Large Language Model Fine-tuning via Instruction Vector
Gangwei Jiang, Zhaoyi Li, Defu Lian +1
Fine-tuning large language models (LLMs) can cause them to lose their general capabilities. However, the intrinsic mechanisms behind such forgetting remain unexplored. In this pape…
Understanding and Patching Compositional Reasoning in LLMs
Zhaoyi Li, Gangwei Jiang, Hong Xie +3
LLMs have marked a revolutonary shift, yet they falter when faced with compositional reasoning tasks. Our research embarks on a quest to uncover the root causes of compositional re…