1 citations · 1 across the 8 of their papers we have counts for
4 papers · 1 filter
1% of Tokens Can Be Enough: On Gradient Estimation in On-Policy Distillation
Huanxin Sheng, Zhiling Ye, Haonan Wang +3
Sparse on-policy distillation (OPD) allocates teacher supervision to a small subset of tokens in student-generated trajectories. However, useful teacher guidance can yield a noisy…
MetaToolAgent: Towards Generalizable Tool Usage in LLMs through Meta-Learning
Zheng Fang, Wolfgang Mayer, Zeyu Zhang +4
Tool learning is increasingly important for large language models (LLMs) to effectively coordinate and utilize a diverse set of tools in order to solve complex real-world tasks. By…
Learning to Align, Aligning to Learn: A Unified Approach for Self-Optimized Alignment
Haowen Wang, Yun Yue, Zhiling Ye +12
Alignment methodologies have emerged as a critical pathway for enhancing language model alignment capabilities. While SFT (supervised fine-tuning) accelerates convergence through d…
OrchMoE: Efficient Multi-Adapter Learning with Task-Skill Synergy
Haowen Wang, Tao Sun, Kaixiang Ji +3
We advance the field of Parameter-Efficient Fine-Tuning (PEFT) with our novel multi-adapter method, OrchMoE, which capitalizes on modular skill architecture for enhanced forward tr…