Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarks

Yixin Cao, Shibo Hong, Xinze Li +24

Unraveling Indirect In-Context Learning Using Influence Functions

Hadi Askari, Shivanshu Gupta, Terry Tong +3

Mitigating Backdoor Threats to Large Language Models: Advancement and Challenges

Qin Liu, Wenjie Mo, Terry Tong +4

GRAPHCACHE: Message Passing as Caching for Sentence-Level Relation Extraction

Yiwei Wang, Muhao Chen, Wenxuan Zhou +3

GQA-μP: The maximal parameterization update for grouped query attention

Kyle R. Chickering, Huijuan Wang, Mengxi Wu +7

FoodPuzzle: Developing Large Language Model Agents as Flavor Scientists

Tenghao Huang, Donghee Lee, John Sweeney +5

FutureWeaver: Planning Test-Time Compute for Multi-Agent Systems with Modularized Collaboration

Dongwon Jung, Peng Shi, Muhao Chen +1

Familiarity-Aware Evidence Compression for Retrieval-Augmented Generation

Dongwon Jung, Qin Liu, Tenghao Huang +2

Be My Eyes: Extending Large Language Models to New Modalities Through Multi-Agent Collaboration

James Y. Huang, Sheng Zhang, Qianchu Liu +5

Multilingual Knowledge Graph Embeddings for Cross-lingual Knowledge Alignment

Muhao Chen, Yingtao Tian, Mohan Yang +1

Joint Constrained Learning for Event-Event Relation Extraction

Haoyu Wang, Muhao Chen, Hongming Zhang +1

Salience Allocation as Guidance for Abstractive Summarization

Fei Wang, Kaiqiang Song, Hongming Zhang +6

Tensegrity system dynamics based on finite element method

Shuo Ma, Muhao Chen, Robert E. Skelton

Automating API Documentation from Crowdsourced Knowledge

Bonan Kou, Zijie Zhou, Muhao Chen +1

MuirBench: A Comprehensive Benchmark for Robust Multi-image Understanding

Fei Wang, Xingyu Fu, James Y. Huang +18

Contrastive Instruction Tuning

Tianyi Lorena Yan, Fei Wang, James Y. Huang +5

Learning Efficient Guardrails for Compliance

Xiaofei Wen, Wenjie Jacky Mo, Yanan Xie +2

Retrieving Complex Tables with Multi-Granular Graph Representation Learning

Fei Wang, Kexuan Sun, Muhao Chen +2

Two Heads are Better than One: Nested PoE for Robust Defense Against Multi-Backdoors

Victoria Graf, Qin Liu, Muhao Chen

Co-training Embeddings of Knowledge Graphs and Entity Descriptions for Cross-lingual Entity Alignment

Muhao Chen, Yingtao Tian, Kai-Wei Chang +2

RedCoder: Automated Multi-Turn Red Teaming for Code LLMs

Wenjie Jacky Mo, Qin Liu, Xiaofei Wen +5

PINTO: Faithful Language Reasoning Using Prompt-Generated Rationales

Peifeng Wang, Aaron Chan, Filip Ilievski +2

GeoLM: Empowering Language Models for Geospatially Grounded Language Understanding

Zekun Li, Wenxuan Zhou, Yao-Yi Chiang +1

Software Entity Recognition with Noise-Robust Learning

Tai Nguyen, Yifeng Di, Joohan Lee +2

Ultra-fine Entity Typing with Indirect Supervision from Natural Language Inference

Bangzheng Li, Wenpeng Yin, Muhao Chen

Learning to Identify High Betweenness Centrality Nodes from Scratch: A Novel Graph Neural Network Approach

Changjun Fan, Li Zeng, Yuhui Ding +3

MetaScale: Test-Time Scaling with Evolving Meta-Thoughts

Qin Liu, Wenxuan Zhou, Nan Xu +5

Improving Factuality of Abstractive Summarization without Sacrificing Summary Quality

Tanay Dixit, Fei Wang, Muhao Chen

Structure-Aware Label Smoothing for Graph Neural Networks

Yiwei Wang, Yujun Cai, Yuxuan Liang +5

Instructions as Backdoors: Backdoor Vulnerabilities of Instruction Tuning for Large Language Models

Jiashu Xu, Mingyu Derek Ma, Fei Wang +2

Cognitive Overload: Jailbreaking Large Language Models with Overloaded Logical Thinking

Nan Xu, Fei Wang, Ben Zhou +3

Implicit Reasoning Steering via Concept Chaining

Xiao Ye, Sanika Chavan, Yuxi Huang +4

The paper introduces Concept Chaining, a method that creates short natural-language paragraphs linking question entities to a target answer via intermediate concepts, and uses cont…

Bending the Future: Autoregressive Modeling of Temporal Knowledge Graphs in Curvature-Variable Hyperbolic Spaces

Jihoon Sohn, Mingyu Derek Ma, Muhao Chen

Agentic Web: Weaving the Next Web with AI Agents

Yingxuan Yang, Mulei Ma, Yuxuan Huang +15

VIPHY: Probing "Visible" Physical Commonsense Knowledge

Shikhar Singh, Ehsan Qasemi, Muhao Chen

Unbiased Visual Reasoning with Controlled Visual Inputs

Zhaonan Li, Shijie Lu, Fei Wang +11

Contextualized Scene Imagination for Generative Commonsense Reasoning

PeiFeng Wang, Jonathan Zamora, Junfeng Liu +3

ThinkGuard: Deliberative Slow Thinking Leads to Cautious Guardrails

Xiaofei Wen, Wenxuan Zhou, Wenjie Jacky Mo +1

X-Shot: A Unified System to Handle Frequent, Few-shot and Zero-shot Learning Simultaneously in Classification

Hanzi Xu, Muhao Chen, Lifu Huang +2

Enhanced Network Embeddings via Exploiting Edge Labels

Haochen Chen, Xiaofei Sun, Yingtao Tian +3

Learning from History: Modeling Temporal Knowledge Graphs with Sequential Copy-Generation Networks

Cunchao Zhu, Muhao Chen, Changjun Fan +2

Video Models Can Reason with Verifiable Rewards

Tinghui Zhu, Sheng Zhang, James Y. Huang +5

QA-LIGN: Aligning LLMs through Constitutionally Decomposed QA

Jacob Dineen, Aswin RRV, Qin Liu +8

SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation

Zekun Li, Jina Kim, Yao-Yi Chiang +1

DebugLM: Learning Traceable Training Data Provenance for LLMs

Wenjie Jacky Mo, Qin Liu, Xiaofei Wen +3

Equilibrium and stiffness study of clustered tensegrity structures with the consideration of pulley sizes

Shuo Ma, Yiqian Chen, Muhao Chen +1

Knowledge Graph Alignment Network with Gated Multi-hop Neighborhood Aggregation

Zequn Sun, Chengming Wang, Wei Hu +4

SleeperMark: Towards Robust Watermark against Fine-Tuning Text-to-image Diffusion Models

Zilan Wang, Junfeng Guo, Jiacheng Zhu +4

Are All Steps Equally Important? Benchmarking Essentiality Detection of Events

Haoyu Wang, Hongming Zhang, Yueguan Wang +3

Preconditioned Visual Language Inference with Weak Supervision

Ehsan Qasemi, Amani R. Maina-Kilaas, Devadutta Dash +2

From Shortcuts to Triggers: Backdoor Defense with Denoised PoE

Qin Liu, Fei Wang, Chaowei Xiao +1

Quantification and Analysis of Scientific Language Variation Across Research Fields

Pei Zhou, Muhao Chen, Kai-Wei Chang +1

Multi-view Knowledge Graph Embedding for Entity Alignment

Qingheng Zhang, Zequn Sun, Wei Hu +3

DeepEdit: Knowledge Editing as Decoding with Constraints

Yiwei Wang, Muhao Chen, Nanyun Peng +1

A Causal View of Entity Bias in (Large) Language Models

Fei Wang, Wenjie Mo, Yiwei Wang +2

Neural Article Pair Modeling for Wikipedia Sub-article Matching

Muhao Chen, Changping Meng, Gang Huang +1

LayerIF: Estimating Layer Quality for Large Language Models using Influence Functions

Hadi Askari, Shivanshu Gupta, Fei Wang +2

Knowing the No-match: Entity Alignment with Dangling Cases

Zequn Sun, Muhao Chen, Wei Hu

PaCo: Preconditions Attributed to Commonsense Knowledge

Ehsan Qasemi, Filip Ilievski, Muhao Chen +1

Dynamics and control of clustered tensegrity systems

Shuo Ma, Muhao Chen, Robert E. Skelton

ReasoningBomb: A Stealthy Denial-of-Service Attack by Inducing Pathologically Long Reasoning in Large Reasoning Models

Xiaogeng Liu, Xinyan Wang, Yechao Zhang +5

Automated Summarization of Stack Overflow Posts

Bonan Kou, Muhao Chen, Tianyi Zhang

"What Are You Trying to Do?" Semantic Typing of Event Processes

Muhao Chen, Hongming Zhang, Haoyu Wang +1

Planning and Editing What You Retrieve for Enhanced Tool Learning

Tenghao Huang, Dongwon Jung, Muhao Chen

AQuaUI: Visual Token Reduction for GUI Agents with Adaptive Quadtrees

Yuankai Li, Tinghui Zhu, Ha Min Son +3

MapQA: Open-domain Geospatial Question Answering on Map Data

Zekun Li, Malcolm Grossman, Eric +4

Visual Pivoting for (Unsupervised) Entity Alignment

Fangyu Liu, Muhao Chen, Dan Roth +1

PInKS: Preconditioned Commonsense Inference with Minimal Supervision

Ehsan Qasemi, Piyush Khanna, Qiang Ning +1

Semantic-Clipping: Efficient Vision-Language Modeling with Semantic-Guidedd Visual Selection

Bangzheng Li, Fei Wang, Wenxuan Zhou +5

VisAnalog: A Diagnostic Suite for Visual Concept Transfer on Natural Images

Zhaonan Li, Kyle R. Chickering, Bangzheng Li +13

QLIP: A Dynamic Quadtree Vision Prior Enhances MLLM Performance Without Retraining

Kyle R. Chickering, Bangzheng Li, Muhao Chen

Contrastive Bootstrapping for Label Refinement

Shudi Hou, Yu Xia, Muhao Chen +1

ModelLens: Finding the Best for Your Task from Myriads of Models

Rui Cai, Weijie Jacky Mo, Xiaofei Wen +5

Symmetry-Reduced Physics-Informed Learning of Tensegrity Dynamics

Jing Qin, Muhao Chen

An Improved Baseline for Sentence-level Relation Extraction

Wenxuan Zhou, Muhao Chen

mDPO: Conditional Preference Optimization for Multimodal Large Language Models

Fei Wang, Wenxuan Zhou, James Y. Huang +4

Multi-hop Evidence Retrieval for Cross-document Relation Extraction

Keming Lu, I-Hung Hsu, Wenxuan Zhou +2

AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection

Weidi Luo, Shenghong Dai, Xiaogeng Liu +4

DiscoSum: Discourse-aware News Summarization

Alexander Spangher, Tenghao Huang, Jialiang Gu +2

Bio-JOIE: Joint Representation Learning of Biological Knowledge Bases

Junheng Hao, Chelsea Ju, Muhao Chen +3

Adaptive Latent Agentic Reasoning

Dongwon Jung, Peng Shi, Yi Zhang +2

FATH: Authentication-based Test-time Defense against Indirect Prompt Injection Attacks

Jiongxiao Wang, Fangzhou Wu, Wendi Li +5

Should We Rely on Entity Mentions for Relation Extraction? Debiasing Relation Extraction with Counterfactual Analysis

Yiwei Wang, Muhao Chen, Wenxuan Zhou +6

ASCII Art Turns LLMs into VLA Controllers

Yitao Jiang, Roy Xing, Luyang Zhao +3

Getting Sick After Seeing a Doctor? Diagnosing and Mitigating Knowledge Conflicts in Event Temporal Reasoning

Tianqing Fang, Zhaowei Wang, Wenxuan Zhou +3

Extracting or Guessing? Improving Faithfulness of Event Temporal Relation Extraction

Haoyu Wang, Hongming Zhang, Yuqian Deng +3

Embedding Uncertain Knowledge Graphs

Xuelu Chen, Muhao Chen, Weijia Shi +2

Design and control analysis of a deployable clustered hyperbolic paraboloid cable net

Shuo Ma, Kai Lu, Muhao Chen +1

An extended ordinary state-based peridynamics for non-spherical horizons

Qibang Liu, Muhao Chen, Robert E. Skelton

Benchmarking Vision Language Model Unlearning via Fictitious Facial Identity Dataset

Yingzi Ma, Jiongxiao Wang, Fei Wang +10

Minimal mass design of a tensegrity tower for lunar electromagnetic launching

Xiaowen Su, Muhao Chen, Manoranjan Majji +1

Understanding and Evaluating Claw-like Agent Security Through a Computer-Systems Lens

Peizhi Niu, Wenjie Qu, Shangding Gu +14

False Sense of Security: Why Probing-based Malicious Input Detection Fails to Generalize

Cheng Wang, Zeming Wei, Qin Liu +1

Affective and Dynamic Beam Search for Story Generation

Tenghao Huang, Ehsan Qasemi, Bangzheng Li +4

Unified Semantic Typing with Meaningful Label Inference

James Y. Huang, Bangzheng Li, Jiashu Xu +1

BadJudge: Backdoor Vulnerabilities of LLM-as-a-Judge

Terry Tong, Fei Wang, Zhe Zhao +1

Sharpness-Aware Minimization with Dynamic Reweighting

Wenxuan Zhou, Fangyu Liu, Huan Zhang +1

On2Vec: Embedding-based Relation Prediction for Ontology Population

Muhao Chen, Yingtao Tian, Xuelu Chen +2

Learning from Noisy Labels for Entity-Centric Information Extraction

Wenxuan Zhou, Muhao Chen

MetaScientist: A Human-AI Synergistic Framework for Automated Mechanical Metamaterial Design

Jingyuan Qi, Zian Jia, Minqian Liu +15