activity
20222026
most citedLLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods

38 citations · 103 across the 93 of their papers we have counts for

collaborators
Showing cs.CLShow all

47 papers · 1 filter

cs.CL2026

Composable Parametric Demographic Injection for Values Survey Simulation

Xinyuan Cao, Qingyi Pan, Bangde Du +7

Large language models (LLMs) are increasingly used as simulated respondents in computational social science, yet accurately reproducing population-specific heterogeneous response d…

cs.CL2026

GenRubric: Self-Evolving Rubric Generation for Scalable LLM Evaluation

Yifan Chen, Haitao Li, Qingyao Ai +4

Large language models are increasingly used as scalable evaluators for open-ended tasks. However, many LLM judges derive query-specific criteria during scoring, leaving the evaluat…

cs.CL2026

Mitigating Identity Essentialism in LLM Agents with Longitudinal Life Trajectories

Hexi Wang, Yujia Zhou, Bangde Du +7

Large language models (LLMs) offer a scalable approach to social simulation, but their credibility depends on how agents are constructed. Existing methods can partially reproduce p…

cs.CL2026★ 1 cited

MetaSyn: A Benchmark for LLM Agents on Meta-Analysis Articles from Nature Portfolio

Anzhe Xie, Weihang Su, Yujia Zhou +3

Systematic review and meta-analysis is an important method for scientific research. It comprehensively studies target research questions by combining evidence from multiple indepen…

cs.CL2026

Retrievable Gradients: Continual Post-Training Without Cumulative Weight Drift

Weihang Su, Jiacheng Kang, Jingyan Xu +7

Continual post-training enables models to absorb emerging knowledge after deployment, but repeatedly updating shared parameters can accumulate weight drift, potentially causing cat…

cs.CL2026

Decoupled Mixture-of-Experts for Parametric Knowledge Injection

Baoqing Yue, Weihang Su, Qingyao Ai +5

Knowledge injection aims to equip large language models (LLMs) with external, domain-specific, or time-sensitive knowledge. Existing approaches typically face a trade-off between f…

cs.CL2026

Adaptive Multi-Resolution Procedural Knowledge Compression for Large Language Models

Changyue Wang, Weihang Su, Qingyao Ai +5

Large language models (LLMs) are widely used to tackle complex tasks with autonomous workflows. Recently, reusable natural language skills have emerged as a popular paradigm to inj…

cs.CL2026

Civil Court Simulation with Large Language Models

Yifan Chen, Haitao Li, Kaiyuan Zhang +3

Court simulation bridges legal education and judicial practice, yet human-based simulations are costly and difficult to scale. Large language models (LLMs) offer a scalable alterna…

cs.CL2026

LexRubric: A Rubric-Guided Diagnostic Benchmark for Open-Ended Legal Tasks

Yifan Chen, Haitao Li, Yiran Hu +6

As large language models (LLMs) are increasingly applied to real-world legal tasks, evaluating the reliability of their open-ended legal responses has become essential. These tasks…

cs.CL2026

Enhancing Judgment Document Generation via Agentic Legal Information Collection and Rubric-Guided Optimization

Weihang Su, Xuanyi Chen, Yueyue Wu +2

Automating the drafting of judgment documents is pivotal to judicial efficiency, yet it remains challenging due to the dual requirements of comprehensive retrieval of legal informa…

cs.CL2026

Decoupling Knowledge and Task Subspaces for Composable Parametric Retrieval Augmented Generation

Weihang Su, Hanwen Zhang, Qingyao Ai +1

Parametric Retrieval-Augmented Generation (PRAG) encodes external documents into lightweight parameter modules that can be retrieved and merged at inference time, offering a promis…

cs.CL2026

TEC: A Collection of Human Trial-and-error Trajectories for Problem Solving

Xinkai Zhang, Jingtao Zhan, Yiqun Liu +1

Trial-and-error is a fundamental strategy for humans to solve complex problems and a necessary capability for Artificial Intelligence (AI) systems operating in real-world environme…

cs.CL2026

Skill Retrieval Augmentation for Agentic AI

Weihang Su, Jianming Long, Qingyao Ai +6

As large language models (LLMs) evolve into agentic problem solvers, they increasingly rely on external, reusable skills to handle tasks beyond their native parametric capabilities…

cs.CL2026

Parametric Social Identity Injection and Diversification in Public Opinion Simulation

Hexi Wang, Yujia Zhou, Bangde Du +2

Large language models (LLMs) have recently been adopted as synthetic agents for public opinion simulation, offering a promising alternative to costly and slow human surveys. Despit…

cs.CL2026

Improve Large Language Model Systems with User Logs

Changyue Wang, Weihang Su, Qingyao Ai +4

Scaling training data and model parameters has long driven progress in large language models (LLMs), but this paradigm is increasingly constrained by the scarcity of high-quality d…

cs.CL2025

Towards Unification of Hallucination Detection and Fact Verification for Large Language Models

Weihang Su, Jianming Long, Changyue Wang +5

Large Language Models (LLMs) frequently exhibit hallucinations, generating content that appears fluent and coherent but is factually incorrect. Such errors undermine trust and hind…

cs.CL2025

TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulation

Bangde Du, Minghao Guo, Songming He +8

Large Language Models (LLMs) are exhibiting emergent human-like abilities and are increasingly envisioned as the foundation for simulating an individual's communication style, beha…

cs.CL2025

LLMs on Trial: Evaluating Judicial Fairness for Large Language Models

Yiran Hu, Zongyue Xue, Haitao Li +10

Large Language Models (LLMs) are increasingly used in high-stakes fields where their decisions impact rights and equity. However, LLMs' judicial fairness and implications for socia…

cs.CL2025

SurGE: A Benchmark and Evaluation Framework for Scientific Survey Generation

Weihang Su, Anzhe Xie, Qingyao Ai +5

The rapid growth of academic literature makes the manual creation of scientific surveys increasingly infeasible. While large language models show promise for automating this proces…

cs.CL2025

Dynamic and Parametric Retrieval-Augmented Generation

Weihang Su, Qingyao Ai, Jingtao Zhan +2

Retrieval-Augmented Generation (RAG) has become a foundational paradigm for equipping large language models (LLMs) with external knowledge, playing a critical role in information r…

cs.CL2025

ValueSim: Generating Backstories to Model Individual Value Systems

Bangde Du, Ziyi Ye, Zhijing Wu +5

As Large Language Models (LLMs) continue to exhibit increasingly human-like capabilities, aligning them with human values has become critically important. Contemporary advanced tec…

cs.CL2025

Augmenting Multi-Agent Communication with State Delta Trajectory

Yichen Tang, Weihang Su, Yujia Zhou +4

Multi-agent techniques such as role playing or multi-turn debates have been shown to be effective in improving the performance of large language models (LLMs) in downstream tasks.…

cs.CL2025

Joint Evaluation of Answer and Reasoning Consistency for Hallucination Detection in Large Reasoning Models

Changyue Wang, Weihang Su, Qingyao Ai +1

Large Reasoning Models (LRMs) extend large language models with explicit, multi-step reasoning traces to enhance transparency and performance on complex tasks. However, these reaso…

cs.CL2025

Decoupling Reasoning and Knowledge Injection for In-Context Knowledge Editing

Changyue Wang, Weihang Su, Qingyao Ai +2

Knowledge editing aims to efficiently update Large Language Models (LLMs) by modifying specific knowledge without retraining the entire model. Among knowledge editing approaches, i…