2 papers
cs.LG2025
Generalizing Graph Transformers Across Diverse Graphs and Tasks via Pre-training
Yufei He, Zhenyu Hou, Yukuo Cen +5
Graph pre-training has been concentrated on graph-level tasks involving small graphs (e.g., molecular graphs) or learning node representations on a fixed graph. Extending graph pre…
cs.CL2024
Does RLHF Scale? Exploring the Impacts From Data, Model, and Method
Zhenyu Hou, Pengfan Du, Yilin Niu +7
This study explores the scaling properties of Reinforcement Learning from Human Feedback (RLHF) in Large Language Models (LLMs). Although RLHF is considered an important step in po…