40 citations · 100 across the 68 of their papers we have counts for
37 papers · 1 filter
Hallucination Self-Play: Bootstrapping Reinforced Detector via Evolved Generator
Shiping Yang, Shining Liang, Weihao Liu +4
Identifying faithfulness hallucinations in LLM-generated outputs remains challenging due to the scarcity of high-quality annotated data. Recent work relies on advanced LLMs to synt…
Diagnosing Multi-step Reasoning Failures in Black-box LLMs via Stepwise Confidence Attribution
Xiaoou Liu, Tiejin Chen, Dengjia Zhang +3
Large Language Models have achieved strong performance on reasoning tasks with objective answers by generating step-by-step solutions, but diagnosing where a multi-step reasoning t…
Beyond Math and Code: Lightweight Corpus-Grounded Process Rewards for Factual Question Answering
Shicheng Fan, Haochang Hao, Dehai Min +10
Process supervision during reinforcement learning (RL) post-training matters in factual question answering (QA) because responses receiving positive response-level rewards can stil…
Stop When Reasoning Converges: Semantic-Preserving Early Exit for Reasoning Models
Dehai Min, Giovanni Vaccarino, Huiyi Chen +3
Large Reasoning Models (LRMs) achieve strong performance by generating long chains of thought (CoT), but often overthink, continuing to reason after a solution has already stabiliz…
Adaptive Stopping for Multi-Turn LLM Reasoning
Xiaofan Zhou, Huy Nguyen, Bo Yu +2
Large Language Models (LLMs) increasingly rely on multi-turn reasoning and interaction, such as adaptive retrieval-augmented generation (RAG) and ReAct-style agents, to answer diff…
URAG: A Benchmark for Uncertainty Quantification in Retrieval-Augmented Large Language Models
Vinh Nguyen, Cuong Dang, Jiahao Zhang +6
Retrieval-Augmented Generation (RAG) has emerged as a widely adopted approach for enhancing LLMs in scenarios that demand extensive factual knowledge. However, current RAG evaluati…
Context-Aware Counterfactual Data Augmentation for Gender Bias Mitigation in Language Models
Shweta Parihar, Liu Guangliang, Natalie Parde +1
A challenge in mitigating social bias in fine-tuned language models (LMs) is the potential reduction in language modeling capability, which can harm downstream performance. Counter…
Evaluating Social Bias in RAG Systems: When External Context Helps and Reasoning Hurts
Shweta Parihar, Lu Cheng
Social biases inherent in large language models (LLMs) raise significant fairness concerns. Retrieval-Augmented Generation (RAG) architectures, which retrieve external knowledge so…
When and What to Ask: AskBench and Rubric-Guided RLVR for LLM Clarification
Jiale Zhao, Ke Fang, Lu Cheng
Large language models (LLMs) often respond even when prompts omit critical details or include misleading information, leading to hallucinations or reinforced misconceptions. We stu…
Latent Thoughts Tuning: Bridging Context and Reasoning with Fused Information in Latent Tokens
Weihao Liu, Dehai Min, Lu Cheng
While explicit Chain-of-Thought (CoT) equips Large Language Models (LLMs) with strong reasoning capabilities, it constrains the model's thoughts to a discrete vocabulary space. Rec…
EpiQAL: Benchmarking Large Language Models in Epidemiological Question Answering and Reasoning
Mingyang Wei, Dehai Min, Zewen Liu +8
Reliable epidemiological reasoning requires synthesizing study evidence to infer disease burden, transmission dynamics, and intervention effects at the population level. Existing m…
QuCo-RAG: Quantifying Uncertainty from the Pre-training Corpus for Dynamic Retrieval-Augmented Generation
Dehai Min, Kailin Zhang, Tongtong Wu +1
Dynamic Retrieval-Augmented Generation adaptively determines when to retrieve during generation to mitigate hallucinations in large language models (LLMs). However, existing method…
Revisiting NLI: Towards Cost-Effective and Human-Aligned Metrics for Evaluating LLMs in Question Answering
Sai Shridhar Balamurali, Lu Cheng
Evaluating answers from state-of-the-art large language models (LLMs) is challenging: lexical metrics miss semantic nuances, whereas "LLM-as-Judge" scoring is computationally expen…
Early Risk Prediction with Temporally and Contextually Grounded Clinical Language Processing
Rochana Chaturvedi, Yue Zhou, Andrew D. Boyd +5
Clinical notes in Electronic Health Records (EHRs) capture rich temporal information on events, clinician reasoning, and lifestyle factors often missing from structured data. Lever…
A Lightweight Large Language Model-Based Multi-Agent System for 2D Frame Structural Analysis
Ziheng Geng, Jiachen Liu, Ran Cao +3
Large language models (LLMs) have recently been used to empower autonomous agents in engineering, significantly improving automation and efficiency in labor-intensive workflows. Ho…
SoM-1K: A Thousand-Problem Benchmark Dataset for Strength of Materials
Qixin Wan, Zilong Wang, Jingwen Zhou +5
Foundation models have shown remarkable capabilities in various domains, but their performance on complex, multimodal engineering problems remains largely unexplored. We introduce…
REHEARSE: Experiential Rehearsal for Verbal Confidence Calibration in Large Language Models
Ke Fang, Tianyi Zhao, Qianwen Wang +1
Large language models (LLMs) often express verbal confidence that is poorly aligned with actual correctness, limiting their reliability in safety-critical applications. Existing pr…
A Large Language Model-Empowered Agent for Reliable and Robust Structural Analysis
Jiachen Liu, Ziheng Geng, Ran Cao +3
Large language models (LLMs) have exhibited remarkable capabilities across diverse open-domain tasks, yet their application in specialized domains such as civil engineering remains…
CP-Router: An Uncertainty-Aware Router Between LLM and LRM
Jiayuan Su, Fulin Lin, Zhaopeng Feng +7
Recent advances in Large Reasoning Models (LRMs) have significantly improved long-chain reasoning capabilities over Large Language Models (LLMs). However, LRMs often produce unnece…
Beyond Accuracy: The Role of Calibration in Self-Improving Large Language Models
Liangjie Huang, Dawei Li, Huan Liu +1
Large Language Models (LLMs) have demonstrated remarkable self-improvement capabilities, whereby models iteratively revise their outputs through self-generated feedback. While this…
Shakespearean Sparks: The Dance of Hallucination and Creativity in LLMs' Decoding Layers
Zicong He, Boxuan Zhang, Lu Cheng
Large language models (LLMs) are known to hallucinate, a phenomenon often linked to creativity. While previous research has primarily explored this connection through theoretical o…
DBR: Divergence-Based Regularization for Debiasing Natural Language Understanding Models
Zihao Li, Ruixiang Tang, Lu Cheng +3
Pre-trained language models (PLMs) have achieved impressive results on various natural language processing tasks. However, recent research has revealed that these models often rely…
Understanding the Uncertainty of LLM Explanations: A Perspective Based on Reasoning Topology
Longchao Da, Xiaoou Liu, Jiaxin Dai +3
Understanding the uncertainty in large language model (LLM) explanations is important for evaluating their faithfulness and reasoning consistency, and thus provides insights into t…
COPU: Conformal Prediction for Uncertainty Quantification in Natural Language Generation
Sean Wang, Yicheng Jiang, Yuxin Tang +2
Uncertainty Quantification (UQ) for Natural Language Generation (NLG) is crucial for assessing the performance of Large Language Models (LLMs), as it reveals confidence in predicti…