6 papers
Autonomous disproofs of the sum-product conjecture over with GPT-5.5 Pro
Yichen Huang
OpenAI's recent disproof of the Erdős unit distance conjecture marked a milestone for AI in mathematics. It also inspired another breakthrough: a human disproof of the Erdős--Szeme…
Winning Gold at IMO 2025 with a Model-Agnostic Verification-and-Refinement Pipeline
Yichen Huang, Lin F. Yang
The International Mathematical Olympiad (IMO) is widely regarded as the world championship of high-school mathematics. IMO problems are renowned for their difficulty and novelty, d…
Aligning Text-to-Music Evaluation with Human Preferences
Yichen Huang, Zachary Novack, Koichi Saito +5
Despite significant recent advances in generative acoustic text-to-music (TTM) modeling, robust evaluation of these models lags behind, relying in particular on the popular Fréchet…
VERSA: A Versatile Evaluation Toolkit for Speech, Audio, and Music
Jiatong Shi, Hye-jin Shim, Jinchuan Tian +14
In this work, we introduce VERSA, a unified and standardized evaluation toolkit designed for various speech, audio, and music signals. The toolkit features a Pythonic interface wit…
REFeREE: A REference-FREE Model-Based Metric for Text Simplification
Yichen Huang, Ekaterina Kochmar
Text simplification lacks a universal standard of quality, and annotated reference simplifications are scarce and costly. We propose to alleviate such limitations by introducing RE…
Robustness Tests for Automatic Machine Translation Metrics with Adversarial Attacks
Yichen Huang, Timothy Baldwin
We investigate MT evaluation metric performance on adversarially-synthesized texts, to shed light on metric robustness. We experiment with word- and character-level attacks on thre…