7 papers · 1 filter
CARAT: Do Materials LLMs Reason or Recite?
Jiajun Wu, Jian Yang, Zixiang Ni +2
When a materials LLM answers a question about crystal structure, does it reason from the structure or copy an answer already printed in its input? Accuracy cannot tell: a structura…
SWE-Prometheus: Measuring Engineering Governance Improvements in Real-World Repositories
Jiajun Wu, Leixin Sun, Zihan Tan +12
Large language model based coding agents have made substantial progress on repository-level software engineering tasks. Existing repository benchmarks, however, usually start from…
Harness-agnostic detection and immunization of reward hacking in self-evolving language models
Rongxin Yang, Yang Liu, Shang Luo +10
Self-evolving language models improve by proposing candidate updates and keeping whatever raises a visible score. When that score is an imperfect proxy for the capability one actua…
Certified Multi-Turn Robustness for LLM Safety via Compositional Bounds and Safety Persistence
Yang Liu, Bin Chong, Wenkai Yang +9
Large language models (LLMs) are vulnerable to multi-turn jailbreak attacks that progressively manipulate conversation context. Existing certified robustness methods are limited to…
DiffImaginE: Imagine to Verify Entity Types with Diffusion
Feng Zhang, Feiyu Han, Rongxin Yang +11
Multimodal named entity recognition (MNER) determines whether each candidate span and entity-type hypothesis is supported by joint textual and visual evidence. Existing imagine-and…
Physiological World Models for Human State Transitions
Chongyang Zhang, Rendong Wang, Hao Zheng +4
Continuous multimodal sensing now allows human physiology to be observed throughout daily life rather than only during occasional clinical visits. However, most health artificial i…
FedRio: Personalized Federated Social Bot Detection via Cooperative Reinforced Contrastive Adversarial Distillation
Yingguang Yang, Hao Liu, Xin Zhang +8
Social bot detection is critical to the stability and security of online social platforms. However, current state-of-the-art bot detection models are largely developed in isolation…