From the 4 of 14 linked papers with an AI index.
14 papers
RLPF: Reinforcement Learning from Performance Feedback for Code Generation
Huihao Jing, Haozhe Cui, Wenbin Hu +9
The paper introduces RLPF, a reinforcement‑learning approach that uses staged performance feedback to train code‑generation models to produce not only correct programs but also fas…
MultivationBench: A Benchmark for Multimodal Sequential Motivation Reasoning
Kawai Chung, Chunkit Chan, Yauwai Yim +12
The paper introduces MultivationBench, a benchmark that tests multimodal large language models on their ability to reason about evolving human motivations across sequential visual…
Isolation as a First-Class Principle for LLM-Agent System Safety: Concepts, Taxonomy, Challenges and Future Directions
Huihao Jing, Wenbin Hu, Shaojin Chen +10
The paper surveys how isolating components such as user inputs, tools, execution, inter‑agent communication, and environment can improve safety of LLM‑agent systems, presenting a b…
PerfCodeBench: Benchmarking LLMs for System-Level High-Performance Code Optimization
Huihao Jing, Wenbin Hu, Shaojin Chen +5
The paper introduces PerfCodeBench, an executable benchmark that evaluates how well large language models can generate system-level code that is not only correct but also optimized…
NOVA: NOise-aware Verbal Confidence CAlibration for Robust Large Language Models in RAG Systems
Jiayu Liu, Rui Wang, Qing Zong +9
Accurately assessing model confidence is essential for deploying large language models (LLMs) in mission-critical factual domains. While retrieval-augmented generation (RAG) is wid…
SurveyLens: A Discipline-Aware Benchmark for Automatic Survey Generation
Beichen Guo, Zhiyuan Wen, Jia Gu +6
Automatic Survey Generation (ASG) aims to produce comprehensive literature surveys by retrieving, organizing, and synthesizing academic papers. Despite rapid progress in specialize…