4 papers · 1 filter
CorrGRPO: Correlation-Normalized GRPO for Multi-Reward Learning
Wenbin Hu, Huihao Jing, Haochen Shi +3
Group Relative Policy Optimization (GRPO) is widely used to train reasoning language models, where it computes advantages by centering and normalizing rewards across rollouts of th…
SoFT: Soft Targets for Generalizable LLM Fine-Tuning
Huihao Jing, Wenbin Hu, Shaojin Chen +7
Distillation enables student language models to acquire new capabilities from expert teachers. However, integrating knowledge from multi-teacher, multi-domain demonstrations into a…
RLPF: Reinforcement Learning from Performance Feedback for Code Generation
Huihao Jing, Haozhe Cui, Wenbin Hu +9
Code models are increasingly trained with execution feedback, but most training signals still stop at correctness. This leaves an important gap for systems code: two programs can p…
Node Level Graph Autoencoder: Unified Pretraining for Textual Graph Learning
Wenbin Hu, Huihao Jing, Qi Hu +2
Textual graphs are ubiquitous in real-world applications, featuring rich text information with complex relationships, which enables advanced research across various fields. Textual…