230 citations · 262 across the 24 of their papers we have counts for
4 papers · 1 filter
Generative Distribution Distillation
Jiequan Cui, Beier Zhu, Qingshan Xu +6
In this paper, we formulate the knowledge distillation (KD) as a conditional generative problem and propose the \textit{Generative Distribution Distillation (GenDD)} framework. A n…
BAL: Balancing Diversity and Novelty for Active Learning
Jingyao Li, Pengguang Chen, Shaozuo Yu +2
The objective of Active Learning is to strategically label a subset of the dataset to maximize performance within a predetermined labeling budget. In this study, we harness feature…
MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tasks
Jingyao Li, Pengguang Chen, Bin Xia +2
Large Language Models (LLMs) have showcased impressive capabilities in handling straightforward programming tasks. However, their performance tends to falter when confronted with m…
Dual-Balancing for Multi-Task Learning
Baijiong Lin, Weisen Jiang, Feiyang Ye +6
Multi-task learning aims to learn multiple related tasks simultaneously and has achieved great success in various fields. However, the disparity in loss and gradient scales among t…