4 papers
MEnvAgent: Scalable Polyglot Environment Construction for Verifiable Software Engineering
Chuanzhe Guo, Jingjing Wu, Sijun He +10
The evolution of Large Language Model (LLM) agents for software engineering (SWE) is constrained by the scarcity of verifiable datasets, a bottleneck stemming from the complexity o…
PassNet: Scaling Large Language Models for Graph Compiler Pass Generation
Yiqun Liu, Yingsheng Wu, Ruqi Yang +11
Modern tensor compilers such as TorchInductor deliver substantial speedups on mainstream models, yet face a systematic performance ceiling on long-tail workloads -- our profiling s…
ChessArena: A Chess Testbed for Evaluating Strategic Reasoning Capabilities of Large Language Models
Jincheng Liu, Sijun He, Jingjing Wu +5
Recent large language models (LLMs) have shown strong reasoning capabilities. However, a critical question remains: do these models possess genuine strategic reasoning, or do they…
A Framework for Assessing AI Agent Decisions and Outcomes in AutoML Pipelines
Gaoyuan Du, Amit Ahlawat, Xiaoyang Liu +1
Agent-based AutoML systems rely on large language models to make complex, multi-stage decisions across data processing, model selection, and evaluation. However, existing evaluatio…