4 papers
o1-Coder: an o1 Replication for Coding
Yuxiang Zhang, Shangxi Wu, Yuqi Yang +4
The technical report introduces O1-CODER, an attempt to replicate OpenAI's o1 model with a focus on coding tasks. It integrates reinforcement learning (RL) and Monte Carlo Tree Sea…
Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning
Jitao Sang, Yuhang Wang, Jing Zhang +5
This paper presents a follow-up study to OpenAI's recent superalignment work on Weak-to-Strong Generalization (W2SG). Superalignment focuses on ensuring that high-level AI systems…
CDEval: A Benchmark for Measuring the Cultural Dimensions of Large Language Models
Yuhang Wang, Yanxu Zhu, Chao Kong +4
As the scaling of Large Language Models (LLMs) has dramatically enhanced their capabilities, there has been a growing focus on the alignment problem to ensure their responsible and…
Towards Alleviating the Object Bias in Prompt Tuning-based Factual Knowledge Extraction
Yuhang Wang, Dongyuan Lu, Chao Kong +1
Many works employed prompt tuning methods to automatically optimize prompt queries and extract the factual knowledge stored in Pretrained Language Models. In this paper, we observe…