Showing cs.CLShow all
3 papers · 1 filter
cs.CL2025
Non-Determinism of "Deterministic" LLM Settings
Berk Atil, Sarp Aykent, Alexa Chittams +10
LLM (large language model) practitioners commonly notice that outputs can vary for the same inputs under settings expected to be deterministic. Yet the questions of how pervasive t…
cs.CL2024
"Ask Me Anything": How Comcast Uses LLMs to Assist Agents in Real Time
Scott Rome, Tianwen Chen, Raphael Tang +2
Customer service is how companies interface with their customers. It can contribute heavily towards the overall customer satisfaction. However, high-quality service can become expe…
cs.CL2024
Found in the Middle: Permutation Self-Consistency Improves Listwise Ranking in Large Language Models
Raphael Tang, Xinyu Zhang, Xueguang Ma +2
Large language models (LLMs) exhibit positional bias in how they use context, which especially complicates listwise ranking. To address this, we propose permutation self-consistenc…