7 papers
Synergizing Large Language Models and Task-specific Models for Time Series Anomaly Detection
Feiyi Chen, Leilei Zhang, Guansong Pang +2
In anomaly detection, methods based on large language models (LLMs) can incorporate expert knowledge by reading professional document, while task-specific small models excel at ext…
Reinforcement Fine-Tuning for History-Aware Dense Retriever in RAG
Yicheng Zhang, Zhen Qin, Zhaomin Wu +2
Retrieval-augmented generation (RAG) enables large language models (LLMs) to produce evidence-based responses, and its performance hinges on the matching between the retriever and…
Empowering RepoQA-Agent based on Reinforcement Learning Driven by Monte-carlo Tree Search
Guochang Li, Yuchen Liu, Zhen Qin +7
Repository-level software engineering tasks require large language models (LLMs) to efficiently navigate and extract information from complex codebases through multi-turn tool inte…
Personalized Federated Fine-Tuning for LLMs via Data-Driven Heterogeneous Model Architectures
Yicheng Zhang, Zhen Qin, Zhaomin Wu +2
Large language models (LLMs) are increasingly powering web-based applications, whose effectiveness relies on fine-tuning with large-scale instruction data. However, such data often…
Federated Data-Efficient Instruction Tuning for Large Language Models
Zhen Qin, Zhaomin Wu, Bingsheng He +1
Instruction tuning is a crucial step in improving the responsiveness of pretrained large language models (LLMs) to human instructions. Federated learning (FL) helps to exploit the…
ExploraCoder: Advancing code generation for multiple unseen APIs via planning and chained exploration
Yunkun Wang, Yue Zhang, Zhen Qin +5
Large language models face intrinsic limitations in coding with APIs that are unseen in their training corpora. As libraries continuously evolve, it becomes impractical to exhausti…