4 citations · 14 across the 59 of their papers we have counts for
3 papers · 1 filter
Tailoring Teaching to Aptitude: Direction-Adaptive Self-Distillation for LLM Reasoning
Hongbin Zhang, Chaozheng Wang, Kehai Chen +4
On-policy self-distillation (OPSD) is an emerging LLM post-training paradigm in which the model serves as its own teacher: conditioned on privileged information such as a reference…
The Hidden Link Between RLHF and Contrastive Learning
Xufei Lv, Kehai Chen, Haoyuan Sun +3
Alignment of large language models (LLMs) with human values has recently garnered significant attention, with prominent examples including the canonical yet costly Reinforcement Le…
MoK-RAG: Mixture of Knowledge Paths Enhanced Retrieval-Augmented Generation for Embodied AI Environments
Zhengsheng Guo, Linwei Zheng, Xinyang Chen +3
While human cognition inherently retrieves information from diverse and specialized knowledge sources during decision-making processes, current Retrieval-Augmented Generation (RAG)…