4 papers
Detecting Lookahead Bias in LLM Forecasts
Zhenyu Gao, Wenxi Jiang, Yutong Yan
We develop a statistical procedure to detect lookahead bias in economic forecasts generated by large language models (LLMs). Using a date-only recall query for a firm-date pair, we…
AI Failures in the Eyes of the Downstream Developer: A First Look at Concerns, Practices, and Challenges
Haoyu Gao, Mansooreh Zahedi, Wenxin Jiang +3
With the advancement of AI models, more software systems are adopting AI as a component to facilitate automation. Pre-trained models (PTMs) have become a cornerstone of AI-based so…
Confidence Intervals for Evaluation of Data Mining
Zheng Yuan, Wenxin Jiang
In data mining, when binary prediction rules are used to predict a binary outcome, many performance measures are used in a vast array of literature for the purposes of evaluation a…
Automatic Parallel Tempering Markov Chain Monte Carlo with Nii-C
Sheng Jin, Wenxin Jiang, Dong-Hong Wu
Due to the high dimensionality or multimodality that is common in modern astronomy, sampling Bayesian posteriors can be challenging. Several publicly available codes based on diffe…