21 citations · 70 across the 19 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
Beyond Imitation: Reflective On-Policy Self-Distillation for LLM Reasoning
Ziqi Zhao, Xinyu Ma, Liu Yang +6
On-policy self-distillation (OPSD) improves the reasoning capabilities of large language models (LLMs) by providing dense token-level supervision for on-policy rollouts. However, e…
cs.CL2024★ 1 cited
MEFT: Memory-Efficient Fine-Tuning through Sparse Adapter
Jitai Hao, WeiWei Sun, Xin Xin +4
Parameter-Efficient Fine-tuning (PEFT) facilitates the fine-tuning of Large Language Models (LLMs) under limited resources. However, the fine-tuning performance with PEFT on comple…