6 papers
UCS: Estimating Unseen Coverage for Improved In-Context Learning
Jiayi Xin, Xiang Li, Evan Qiang +4
In-context learning (ICL) performance depends critically on which demonstrations are placed in the prompt, yet most existing selectors prioritize heuristic notions of relevance or…
PA-RAG: RAG Alignment via Multi-Perspective Preference Optimization
Jiayi Wu, Hengyi Cai, Lingyong Yan +5
The emergence of Retrieval-augmented generation (RAG) has alleviated the issues of outdated and hallucinatory content in the generation of large language models (LLMs), yet it stil…
Cross-model Control: Improving Multiple Large Language Models in One-time Training
Jiayi Wu, Hao Sun, Hengyi Cai +5
The number of large language models (LLMs) with varying parameter scales and vocabularies is increasing. While they deliver powerful performance, they also face a set of common opt…
Let's Be Self-generated via Step by Step: A Curriculum Learning Approach to Automated Reasoning with Large Language Models
Kangyang Luo, Zichen Ding, Zhenmin Weng +5
While Chain of Thought (CoT) prompting approaches have significantly consolidated the reasoning capabilities of large language models (LLMs), they still face limitations that requi…
DFDG: Data-Free Dual-Generator Adversarial Distillation for One-Shot Federated Learning
Kangyang Luo, Shuai Wang, Yexuan Fu +5
Federated Learning (FL) is a distributed machine learning scheme in which clients jointly participate in the collaborative training of a global model by sharing model information r…
Privacy-Preserving Federated Learning with Consistency via Knowledge Distillation Using Conditional Generator
Kangyang Luo, Shuai Wang, Xiang Li +3
Federated Learning (FL) is gaining popularity as a distributed learning framework that only shares model parameters or gradient updates and keeps private data locally. However, FL…