activity
20222026
most citedAligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators

10 citations · 37 across the 22 of their papers we have counts for

collaborators
Showing 2023Show all

6 papers · 1 filter

cs.CL2023★ 1 cited

Large Language Models are Miscalibrated In-Context Learners

Chengzu Li, Han Zhou, Goran Glavaš +2

When adapting ICL with or without fine-tuning, we are curious about whether the instruction-tuned language model is able to achieve well-calibrated results without suffering from t…

cs.CL2023★ 1 cited

A Systematic Study of Performance Disparities in Multilingual Task-Oriented Dialogue Systems

Songbo Hu, Han Zhou, Moy Yuan +5

Achieving robust language technologies that can perform well across the world's many languages is a central goal of multilingual NLP. In this work, we take stock of and empirically…

cs.CL2023★ 1 cited

Survival of the Most Influential Prompts: Efficient Black-Box Prompt Search via Clustering and Pruning

Han Zhou, Xingchen Wan, Ivan Vulić +1

Prompt-based learning has been an effective paradigm for large pretrained language models (LLM), enabling few-shot or even zero-shot learning. Black-box prompt search has received…

cs.CL2023★ 8 cited

Batch Calibration: Rethinking Calibration for In-Context Learning and Prompt Engineering

Han Zhou, Xingchen Wan, Lev Proleev +4

Prompting and in-context learning (ICL) have become efficient learning paradigms for large language models (LLMs). However, LLMs suffer from prompt brittleness and various bias fac…

cs.CL2023★ 3 cited

Multi3WOZ: A Multilingual, Multi-Domain, Multi-Parallel Dataset for Training and Evaluating Culturally Adapted Task-Oriented Dialog Systems

Songbo Hu, Han Zhou, Mete Hergul +5

Creating high-quality annotated data for task-oriented dialog (ToD) is known to be notoriously difficult, and the challenges are amplified when the goal is to create equitable, cul…

cs.CL2023★ 7 cited

AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning

Han Zhou, Xingchen Wan, Ivan Vulić +1

Large pretrained language models are widely used in downstream NLP tasks via task-specific fine-tuning, but such procedures can be costly. Recently, Parameter-Efficient Fine-Tuning…