4 papers
REKEY: Metadata-Grounded Visual-Key Regeneration for Contamination-Resilient VQA Evaluation
Tengjie Lin, Yutao Sun, Jingwei Ni +7
Static visual question answering (VQA) benchmarks age quickly: Once the items leak into training corpora, scores can reflect memorization rather than genuine visual ability, thus o…
Automated Formalization via Conceptual Retrieval-Augmented LLMs
Wangyue Lu, Lun Du, Sirui Li +6
Interactive theorem provers (ITPs) require manual formalization, which is labor-intensive and demands expert knowledge. While automated formalization offers a potential solution, i…
MSC-180: A Benchmark for Automated Formal Theorem Proving from Mathematical Subject Classification
Sirui Li, Wangyue Lu, Xiaorui Shi +7
Automated Theorem Proving (ATP) represents a core research direction in artificial intelligence for achieving formal reasoning and verification, playing a significant role in advan…
Autoformalization in the Era of Large Language Models: A Survey
Ke Weng, Lun Du, Sirui Li +4
Autoformalization, the process of transforming informal mathematical propositions into verifiable formal representations, is a foundational task in automated theorem proving, offer…