26 papers
SrDetection: A Self-Referential Framework for Data Leakage Detection in Code Large Language Models
Shuaimin Li, Liyang Fan, Zeyang Li +9
Evaluating code large language models (Code LLMs) requires reliable detection of data leakage, where benchmark performance is artificially inflated by exposure to benchmark data du…
EVADE-Bench: Multimodal Benchmark for Evaluating and Enhancing Evasive Content Detection
Ancheng Xu, Zhihao Yang, Jingpeng Li +9
E-commerce platforms increasingly rely on Large Language Models (LLMs) and Vision Language Models (VLMs) to detect illicit or misleading product content. However, these models rema…
PatRe: A Full-Stage Office Action and Rebuttal Generation Benchmark for Patent Examination
Qiyao Wang, Xinyi Chen, Longze Chen +4
Patent examination is a complex, multi-stage process requiring both technical expertise and legal reasoning, increasingly challenged by rising application volumes. Prior benchmarks…
InteractWeb-Bench: Can Multimodal Agent Escape Blind Execution in Interactive Website Generation?
Qiyao Wang, Haoran Hu, Longze Chen +4
With the advancement of multimodal large language models (MLLMs) and coding agents, the website development has shifted from manual programming to agent-based project-level code sy…
PLOT: Enhancing Preference Learning via Optimal Transport
Liang Zhu, Yuelin Bai, Xiankun Ren +6
Preference learning in Large Language Models (LLMs) has advanced significantly, yet existing methods remain limited by modest performance gains, high computational costs, hyperpara…
FlowPIE: Test-Time Scientific Idea Evolution with Flow-Guided Literature Exploration
Qiyao Wang, Hongbo Wang, Longze Chen +6
Scientific idea generation (SIG) is critical to AI-driven autonomous research, yet existing approaches are often constrained by a static retrieval-then-generation paradigm, leading…