7.1k citations · 8.9k across the 43 of their papers we have counts for
5 papers · 1 filter
The Stochastic Parrot on LLM's Shoulder: A Summative Assessment of Physical Concept Understanding
Mo Yu, Lemao Liu, Junjie Wu +5
In a systematic way, we investigate a widely asked question: Do LLMs really understand what they say?, which relates to the more familiar term Stochastic Parrot. To this end, we pr…
Selection-p: Self-Supervised Task-Agnostic Prompt Compression for Faithfulness and Transferability
Tsz Ting Chung, Leyang Cui, Lemao Liu +3
Large Language Models (LLMs) have demonstrated impressive capabilities in a wide range of natural language processing tasks when leveraging in-context learning. To mitigate the add…
Rethinking Targeted Adversarial Attacks For Neural Machine Translation
Junjie Wu, Lemao Liu, Wei Bi +1
Targeted adversarial attacks are widely used to evaluate the robustness of neural machine translation systems. Unfortunately, this paper first identifies a critical issue in the ex…
Towards General Error Diagnosis via Behavioral Testing in Machine Translation
Junjie Wu, Lemao Liu, Dit-Yan Yeung
Behavioral testing offers a crucial means of diagnosing linguistic errors and assessing capabilities of NLP models. However, applying behavioral testing to machine translation (MT)…
Multilingual and Multi-Aspect Hate Speech Analysis
Nedjma Ousidhoum, Zizheng Lin, Hongming Zhang +2
Current research on hate speech analysis is typically oriented towards monolingual and single classification tasks. In this paper, we present a new multilingual multi-aspect hate s…