5 papers
Continual Fine-Tuning of Large Language Models via Program Memory
Hung Le, Svetha Venkatesh
Parameter-Efficient Fine-Tuning (PEFT), particularly Low-Rank Adaptation (LoRA), has become a standard approach for adapting Large Language Models (LLMs) under limited compute. How…
SPaCe: Unlocking Sample-Efficient Large Language Models Training With Self-Pace Curriculum Learning
Dai Do, Manh Nguyen, Svetha Venkatesh +1
Large language models (LLMs) have shown strong reasoning capabilities when fine-tuned with reinforcement learning (RL). However, such methods require extensive data and compute, ma…
Hear Both Sides: Efficient Multi-Agent Debate via Diversity-Aware Message Retention
Manh Nguyen, Anh Nguyen, Dung Nguyen +2
Multi-Agent Debate has emerged as a promising framework for improving the reasoning quality of large language models through iterative inter-agent communication. However, broadcast…
Reasoning Under 1 Billion: Memory-Augmented Reinforcement Learning for Large Language Models
Hung Le, Dai Do, Dung Nguyen +1
Recent advances in fine-tuning large language models (LLMs) with reinforcement learning (RL) have shown promising improvements in complex reasoning tasks, particularly when paired…
Stable Hadamard Memory: Revitalizing Memory-Augmented Agents for Reinforcement Learning
Hung Le, Kien Do, Dung Nguyen +2
Effective decision-making in partially observable environments demands robust memory management. Despite their success in supervised learning, current deep-learning memory models s…