1 citations · 1 across the 4 of their papers we have counts for
4 papers
Counterfactual Evaluation for Blind Attack Detection in LLM-based Evaluation Systems
Lijia Liu, Takumi Kondo, Kyohei Atarashi +4
This paper investigates defenses for LLM-based evaluation systems against prompt injection. We formalize a class of threats called blind attacks, where a candidate answer is crafte…
AHP-Powered LLM Reasoning for Multi-Criteria Evaluation of Open-Ended Responses
Xiaotian Lu, Jiyi Li, Koh Takeuchi +1
Question answering (QA) tasks have been extensively studied in the field of natural language processing (NLP). Answers to open-ended questions are highly diverse and difficult to q…
Overview of AI-Debater 2023: The Challenges of Argument Generation Tasks
Jiayu Lin, Guanrong Chen, Bojun Jin +26
In this paper we present the results of the AI-Debater 2023 Challenge held by the Chinese Conference on Affect Computing (CCAC 2023), and introduce the related datasets. We organiz…
Evaluating Saliency Explanations in NLP by Crowdsourcing
Xiaotian Lu, Jiyi Li, Zhen Wan +3
Deep learning models have performed well on many NLP tasks. However, their internal mechanisms are typically difficult for humans to understand. The development of methods to expla…