3 papers
cs.CL2025
Speculating LLMs' Chinese Training Data Pollution from Their Tokens
Qingjie Zhang, Di Wang, Haoting Qian +7
Tokens are basic elements in the datasets for LLM training. It is well-known that many tokens representing Chinese phrases in the vocabulary of GPT (4o/4o-mini/o1/o3/4.5/4.1/o4-min…
cs.CL2025
Understanding the Dilemma of Unlearning for Large Language Models
Qingjie Zhang, Haoting Qian, Zhicong Huang +5
Unlearning seeks to remove specific knowledge from large language models (LLMs), but its effectiveness remains contested. On one side, "forgotten" knowledge can often be recovered…
cs.CR2024
An Engorgio Prompt Makes Large Language Model Babble on
Jianshuo Dong, Ziyuan Zhang, Qingjie Zhang +7
Auto-regressive large language models (LLMs) have yielded impressive performance in many real-world tasks. However, the new paradigm of these LLMs also exposes novel threats. In th…