12 papers · 1 filter
Mitigating Context Interference for Reliable and Efficient Search Agents
Boyang Xue, Bin Wu, Shuofei Qiao +8
Recent research empowers Large Language Models (LLMs) as multi-turn search agents to iteratively retrieve and generate outputs until complex tasks are solved. However, the contexts…
TherapyGym: Evaluating and Aligning Clinical Fidelity and Safety in Therapy Chatbots
Fangrui Huang, Souhad Chbeir, Arpandeep Khatua +8
Large language models (LLMs) are increasingly used for mental-health support; yet prevailing evaluation methods--fluency metrics, preference tests, and generic dialogue benchmarks-…
UAlign: Leveraging Uncertainty Estimations for Factuality Alignment on Large Language Models
Boyang Xue, Fei Mi, Qi Zhu +6
Despite demonstrating impressive capabilities, Large Language Models (LLMs) still often struggle to accurately express the factual knowledge they possess, especially in cases where…
MlingConf: A Comprehensive Study of Multilingual Confidence Estimation on Large Language Models
Boyang Xue, Hongru Wang, Rui Wang +6
The tendency of Large Language Models (LLMs) to generate hallucinations raises concerns regarding their reliability. Therefore, confidence estimations indicating the extent of trus…
DAST: Difficulty-Aware Self-Training on Large Language Models
Boyang Xue, Qi Zhu, Hongru Wang +8
Present Large Language Models (LLM) self-training methods always under-sample on challenging queries, leading to inadequate learning on difficult problems which limits LLMs' abilit…
Benchmarking Large Language Models on Multiple Tasks in Bioinformatics NLP with Prompting
Jiyue Jiang, Pengan Chen, Jiuming Wang +13
Large language models (LLMs) have become important tools in solving biological problems, offering improvements in accuracy and adaptability over conventional methods. Several bench…