4 papers · 1 filter
ReTaCo: Residual-Target Control for On-Policy Distillation
Zixiang Ni, Zhuo Hu, Renjie Cao +8
On-policy distillation (OPD) trains a student on its own generated prefixes with token-level teacher feedback, but transmitting or storing the teacher's full-vocabulary distributio…
Defending Against Malicious Finetuning by Scaling Train-time Adversarial Attacks
Haoming Wen, Shi Chen, Qingyu Shi +4
Malicious finetuning attacks pose a major safety threat against open-weight large language models (LLMs). However, existing alignment-stage defenses provide limited protection agai…
MacrOData: New Benchmarks of Thousands of Datasets for Tabular Outlier Detection
Xueying Ding, Simon Klüttermann, Haomin Wen +2
Quality benchmarks are essential for fairly and accurately tracking scientific progress and enabling practitioners to make informed methodological choices. Outlier detection (OD) o…
From Zero to Hero: Advancing Zero-Shot Foundation Models for Tabular Outlier Detection
Xueying Ding, Haomin Wen, Simon Klüttermann +1
Outlier detection (OD) is widely used in practice; but its effective deployment on new tasks is hindered by lack of labeled outliers, which makes algorithm and hyperparameter selec…