4 papers
Can LLMs Hire Fairly? Racial Bias in Resume Screening
Zhenyu Gao, Wenxi Jiang, Yutong Yan
We audit fourteen mainstream large language models (LLMs) for hiring discrimination using the paired-resume methodology of Kline, Rose, and Walters (2022). The sole 2023-vintage mo…
Debiasing LLMs by Fine-tuning
Zhenyu Gao, Wenxi Jiang, Yutong Yan
Prior research shows that large language models (LLMs) exhibit systematic extrapolation bias when forming predictions from both experimental and real-world data, and that prompt-ba…
Beyond Importance Sampling: Rejection-Gated Policy Optimization
Ziwu Sun, Zhen Gao, Jiyong Zhang +1
We propose a new perspective on policy optimization: rather than reweighting all samples by their importance ratios, an optimizer should select which samples are trustworthy enough…
DatedGPT: Preventing Lookahead Bias in Large Language Models with Time-Aware Pretraining
Yutong Yan, Raphael Tang, Zhenyu Gao +2
Large language models pretrained on internet-scale data risk lookahead bias in forecasting tasks, as they may have already seen the true outcome during training. To address this, w…