1.5k citations · 2k across the 57 of their papers we have counts for
18 papers · 1 filter
ARMOR: Stabilizing On-Policy LLM RL with Off-Policy Anchor Samples
Kexin Huang, Junkang Wu, Jinda Lu +7
Reinforcement learning (RL) has significantly enhanced the reasoning capabilities of large language models (LLMs), yet the training process remains notoriously fragile. In this wor…
On the Direction of RLVR Updates for LLM Reasoning: Identification and Exploitation
Kexin Huang, Haoming Meng, Junkang Wu +10
Reinforcement learning with verifiable rewards (RLVR) has substantially improved the reasoning capabilities of large language models. While existing analyses identify that RLVR-ind…
MLLMEraser: Achieving Test-Time Unlearning in Multimodal Large Language Models through Activation Steering
Chenlu Ding, Jiancan Wu, Leheng Sheng +4
Multimodal large language models (MLLMs) have demonstrated remarkable capabilities across vision-language tasks, yet their large-scale deployment raises pressing concerns about mem…
Quantile Advantage Estimation: Stabilizing RLVR for LLM Reasoning
Junkang Wu, Kexin Huang, Jiancan Wu +3
Reinforcement Learning with Verifiable Rewards (RLVR) strengthens LLM reasoning, but training often oscillates between {entropy collapse} and {entropy explosion}. We trace both haz…
RePO: Understanding Preference Learning Through ReLU-Based Optimization
Junkang Wu, Kexin Huang, Xue Wang +5
Aligning large language models (LLMs) with human preferences is critical for real-world deployment, yet existing methods like RLHF face computational and stability challenges. Whil…
Larger or Smaller Reward Margins to Select Preferences for Alignment?
Kexin Huang, Junkang Wu, Ziqian Chen +6
Preference learning is critical for aligning large language models (LLMs) with human values, with the quality of preference datasets playing a crucial role in this process. While e…
Delayed Feedback Modeling with Influence Functions
Chenlu Ding, Jiancan Wu, Yancheng Yuan +5
In online advertising under the cost-per-conversion (CPA) model, accurate conversion rate (CVR) prediction is crucial. A major challenge is delayed feedback, where conversions may…
Text-guided Diffusion Model for 3D Molecule Generation
Yanchen Luo, Junfeng Fang, Sihang Li +5
The de novo generation of molecules with targeted properties is crucial in biology, chemistry, and drug discovery. Current generative models are limited to using single property va…
AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization
Junkang Wu, Xue Wang, Zhengyi Yang +5
Aligning large language models (LLMs) with human values and intentions is crucial for their utility, honesty, and safety. Reinforcement learning from human feedback (RLHF) is a pop…
Invariant Graph Learning Meets Information Bottleneck for Out-of-Distribution Generalization
Wenyu Mao, Jiancan Wu, Haoyang Liu +2
Graph out-of-distribution (OOD) generalization remains a major challenge in graph learning since graph neural networks (GNNs) often suffer from severe performance degradation under…
Adaptive Self-supervised Robust Clustering for Unstructured Data with Unknown Cluster Number
Chen-Lu Ding, Jiancan Wu, Wei Lin +3
We introduce a novel self-supervised deep clustering approach tailored for unstructured data without requiring prior knowledge of the number of clusters, termed Adaptive Self-super…
Towards Robust Alignment of Language Models: Distributionally Robustifying Direct Preference Optimization
Junkang Wu, Yuexiang Xie, Zhengyi Yang +6
This study addresses the challenge of noise in training datasets for Direct Preference Optimization (DPO), a method for aligning Large Language Models (LLMs) with human preferences…
Leave No Patient Behind: Enhancing Medication Recommendation for Rare Disease Patients
Zihao Zhao, Yi Jing, Fuli Feng +3
Medication recommendation systems have gained significant attention in healthcare as a means of providing tailored and effective drug combinations based on patients' clinical infor…
BSL: Understanding and Improving Softmax Loss for Recommendation
Junkang Wu, Jiawei Chen, Jiancan Wu +3
Loss functions steer the optimization direction of recommendation models and are critical to model performance, but have received relatively little attention in recent recommendati…
Understanding Contrastive Learning via Distributionally Robust Optimization
Junkang Wu, Jiawei Chen, Jiancan Wu +3
This study reveals the inherent tolerance of contrastive learning (CL) towards sampling bias, wherein negative samples may encompass similar semantics (\eg labels). However, existi…
GIF: A General Graph Unlearning Strategy via Influence Function
Jiancan Wu, Yi Yang, Yuchun Qian +3
With the greater emphasis on privacy and security in our society, the problem of graph unlearning -- revoking the influence of specific data on the trained GNN model, is drawing in…
Unleashing the Power of Graph Data Augmentation on Covariate Distribution Shift
Yongduo Sui, Qitian Wu, Jiancan Wu +5
The issue of distribution shifts is emerging as a critical concern in graph representation learning. From the perspective of invariant learning and stable learning, a recently well…
Causal Attention for Interpretable and Generalizable Graph Classification
Yongduo Sui, Xiang Wang, Jiancan Wu +3
In graph classification, attention and pooling-based graph neural networks (GNNs) prevail to extract the critical features from the input graph and support the prediction. They mos…