GSM-SEM: Benchmark and Framework for Generating Semantically Variant Augmentations

Jyotika Singh, Fang Tu, Aziza Mirsaidova +11

Benchmarks like GSM8K are popular measures of mathematical reasoning, but leaderboard gains can overstate true capability due to memorization of fixed test sets. Most robustness va…