Historical Backtesting for Scientific Question Discovery: A Protocol and Astronomy Pilot

Hui Mao

Systems that generate scientific research questions are evaluated today by expert scores, LLM-as-judge ratings, or curated case studies -- all subjective, none falsifiable. We form…