3 citations · 6 across the 12 of their papers we have counts for
6 papers · 1 filter
Judging with Confidence: Calibrating Autoraters to Preference Distributions
Zhuohang Li, Xiaowei Li, Chengyu Huang +11
The alignment of large language models (LLMs) with human values increasingly relies on using other LLMs as automated judges, or ``autoraters''. However, their reliability is limite…
What Really is a Member? Discrediting Membership Inference via Poisoning
Neal Mangaokar, Ashish Hooda, Zhuohang Li +5
Membership inference tests aim to determine whether a particular data point was included in a language model's training set. However, recent works have shown that such tests often…
SCE: Scalable Consistency Ensembles Make Blackbox Large Language Model Generation More Reliable
Jiaxin Zhang, Zhuohang Li, Wendi Cui +3
Large language models (LLMs) have demonstrated remarkable performance, yet their diverse strengths and weaknesses prevent any single LLM from achieving dominance across all tasks.…
Towards Statistical Factuality Guarantee for Large Vision-Language Models
Zhuohang Li, Chao Yan, Nicholas J. Jackson +4
Advancements in Large Vision-Language Models (LVLMs) have demonstrated promising performance in a variety of vision-language tasks involving image-conditioned free-form text genera…
A Survey of Automatic Prompt Optimization with Instruction-focused Heuristic-based Search Algorithm
Wendi Cui, Zhuohang Li, Hao Sun +5
Recent advances in Large Language Models have led to remarkable achievements across a variety of Natural Language Processing tasks, making prompt engineering increasingly central t…
Scale-up Unlearnable Examples Learning with High-Performance Computing
Yanfan Zhu, Issac Lyngaas, Murali Gopalakrishnan Meena +8
Recent advancements in AI models are structured to retain user interactions, which could inadvertently include sensitive healthcare data. In the healthcare field, particularly when…