4 papers
POSTCONDBENCH: Benchmarking Correctness and Completeness in Formal Postcondition Inference
Gehao Zhang, Juan Zhai
Formal postconditions precisely characterize program behavior and support debugging, testing, and verification, but writing them requires substantial expertise and effort. This has…
Breaking the Myth: Can Small Models Infer Postconditions Too?
Gehao Zhang, Zhenting Wang, Juan Zhai
Formal specifications are essential for ensuring software correctness, yet manually writing them is tedious and error-prone. Large Language Models (LLMs) have shown promise in gene…
LLMCup: Ranking-Enhanced Comment Updating with LLMs
Hua Ge, Juan Zhai, Minxue Pan +2
While comments are essential for enhancing code readability and maintainability in modern software projects, developers are often motivated to update code but not comments, leading…
Beyond Code Generation: Assessing Code LLM Maturity with Postconditions
Fusen He, Juan Zhai, Minxue Pan
Most existing code Large Language Model (LLM) benchmarks, e.g., EvalPlus, focus on the code generation tasks. Namely, they contain a natural language description of a problem and a…