4 papers
The Parts Are Greater Than the Sum: Automated Task Sequencing for Efficient Training of Multi-Policy LLMs
Jiajia Tang, Sizhe Yuen, Francisco Gomez Medina +2
Parameter-Efficient Fine-Tuning (PEFT) commonly adapts large language models using a single shared Low-Rank Adapter (LoRA). This shared optimization space often suffers from interf…
Is Pure Exploitation Sufficient in Exogenous MDPs with Linear Function Approximation?
Hao Liang, Jiayu Cheng, Sean R. Sinclair +1
Exogenous MDPs (Exo-MDPs) capture sequential decision-making where uncertainty comes solely from exogenous inputs that evolve independently of the learner's actions. This structure…
Intrinsic Memory Agents: Heterogeneous Multi-Agent LLM Systems through Structured Contextual Memory
Sizhe Yuen, Francisco Gomez Medina, Ting Su +2
Multi-agent systems built on Large Language Models (LLMs) show exceptional promise for complex collaborative problem-solving, yet they face fundamental challenges stemming from con…
Automatic Dataset Generation for Knowledge Intensive Question Answering Tasks
Sizhe Yuen, Ting Su, Ziyang Wang +2
A question-answering (QA) system is to search suitable answers within a knowledge base. Current QA systems struggle with queries requiring complex reasoning or real-time knowledge…