6 papers · 1 filter
Towards Harmonized Uncertainty Estimation for Large Language Models
Rui Li, Jing Long, Muge Qi +4
To facilitate robust and trustworthy deployment of large language models (LLMs), it is essential to quantify the reliability of their generations through uncertainty estimation. Wh…
How Far are LLMs from Being Our Digital Twins? A Benchmark for Persona-Based Behavior Chain Simulation
Rui Li, Heming Xia, Xinfeng Yuan +4
Recently, LLMs have garnered increasing attention across academic disciplines for their potential as human digital twins, virtual proxies designed to replicate individuals and auto…
SCoRE: Benchmarking Long-Chain Reasoning in Commonsense Scenarios
Weidong Zhan, Yue Wang, Nan Hu +12
Currently, long-chain reasoning remains a key challenge for large language models (LLMs) because natural texts lack sufficient explicit reasoning data. However, existing benchmarks…
Be a Multitude to Itself: A Prompt Evolution Framework for Red Teaming
Rui Li, Peiyi Wang, Jingyuan Ma +3
Large Language Models (LLMs) have gained increasing attention for their remarkable capacity, alongside concerns about safety arising from their potential to produce harmful content…
Plug-and-Play Training Framework for Preference Optimization
Jingyuan Ma, Rui Li, Zheng Li +2
Recently, preference optimization methods such as DPO have significantly enhanced large language models (LLMs) in wide tasks including dialogue and question-answering. However, cur…
ShieldLM: Empowering LLMs as Aligned, Customizable and Explainable Safety Detectors
Zhexin Zhang, Yida Lu, Jingyuan Ma +8
The safety of Large Language Models (LLMs) has gained increasing attention in recent years, but there still lacks a comprehensive approach for detecting safety issues within LLMs'…