3 papers
cs.CL2026
ConlangBench: Exploring Language Knowledge and Learning in LLMs through Diverse Constructed Languages
Jinhong Jeong, Seungyeop Yi, Sangah Lee +1
Constructed languages (conlangs) are intentionally created human languages with a rich tradition of linguistic creativity. Despite their potential for studying language learning in…
cs.CL2026
ResearchMath-14K: Scaling Research-Level Mathematics via Agents
Guijin Son, Seungyeop Yi, Minju Gwak +3
The frontier of mathematics is defined by problems whose solutions are not yet known, yet it remains unclear whether language models can meaningfully engage with such problems with…
cs.CL2026
Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMs
Guijin Son, Seungone Kim, Catherine Arnett +73
Following the recent achievement of gold-medal performance on the IMO by frontier LLMs, the community is searching for the next meaningful and challenging target for measuring LLM…