5 papers · 1 filter
Identify, Classify, Act: Per-Instruction Controlled Compliance for LLMs over External Data
Zesheng Shi, Xue Li, Chenrui Dai +1
LLMs over external data face a per-instruction tension: a single document or tool return often interleaves legitimate directives with adversarial prompt injections, and the model m…
A Heuristic Perspective on Debiasing Language Models
Tian Lan, Yemin Wang, Chuancheng Shi +6
Language models (LMs) often acquire various biases during pre-training and may express them in interactions, potentially causing social harm. Existing methods often rely on counter…
Team-Based Self-Play With Dual Adaptive Weighting for Fine-Tuning LLMs
Wu Li, Yigeng Zhou, Zesheng Shi +3
While recent self-training approaches have reduced reliance on human-labeled data for aligning LLMs, they still face critical limitations: (i) sensitivity to synthetic data quality…
Safety Alignment via Constrained Knowledge Unlearning
Zesheng Shi, Yucheng Zhou, Jing Li
Despite significant progress in safety alignment, large language models (LLMs) remain susceptible to jailbreak attacks. Existing defense mechanisms have not fully deleted harmful k…
ReaderLM-v2: Small Language Model for HTML to Markdown and JSON
Feng Wang, Zesheng Shi, Bo Wang +2
We present ReaderLM-v2, a compact 1.5 billion parameter language model designed for efficient web content extraction. Our model processes documents up to 512K tokens, transforming…