4 papers · 1 filter
Bayesian Model Merging
Kaiyang Li, Shaobo Han, Qing Su +1
Model merging aims to combine multiple task-specific expert models into a single model without joint retraining, offering a practical alternative to multi-task learning when data a…
Low-Rank Adaptation for Critic Learning in Off-Policy Reinforcement Learning
Yuan Zhuang, Yuexin Bian, Sihong He +7
Scaling critic capacity is a promising direction for improving off-policy reinforcement learning (RL). However, recent work shows that larger critics are prone to overfitting and i…
Approximate Subgraph Matching with Neural Graph Representations and Reinforcement Learning
Kaiyang Li, Shihao Ji, Zhipeng Cai +1
Approximate subgraph matching (ASM) is a task that determines the approximate presence of a given query graph in a large target graph. Being an NP-hard problem, ASM is critical in…
Uni-LoRA: One Vector is All You Need
Kaiyang Li, Shaobo Han, Qing Su +3
Low-Rank Adaptation (LoRA) has become the de facto parameter-efficient fine-tuning (PEFT) method for large language models (LLMs) by constraining weight updates to low-rank matrice…