37 citations · 38 across the 6 of their papers we have counts for
4 papers · 1 filter
BenchChecker: Assessing the Credibility of Bug-Fixing Benchmarks for LLMs
Di Wu, Xu He, Shu Wang +1
While Large Language Models (LLMs) show promise for Automatic Program Repair (APR), existing benchmarks suffer from data contamination, in which test samples appear in training set…
C-to-Rust Fallacy: Automatic Refactoring != Memory Security
Hung-Mao Chen, Xu He, Bo Lu +2
Rust has emerged as the leading system programming language, offering strong memory and type safety guarantees without compromising performance. This positions it as a compelling a…
Overflip: Repetition-Induced Label Flips in Guardrail Models
Xu He, Chih-Hsuan Lin, Hung-Mao Chen +3
Guardrail models are classifiers deployed to screen malicious prompts and responses in LLM-based services. To meet latency constraints, many lightweight guardrails adopt compact Tr…
Prompt Overflow: What the Guardrail Inspects Is Not What the Model Infers
Yuanbo Zhou, Changjia Zhu, Junyu Wang +5
Guardrail models (a.k.a. safety checkers) are widely deployed to screen user inputs before they reach large language models (LLMs), serving as a primary defense against prompt inje…