6 papers
Target-Oriented Pretraining Data Selection via Neuron-Activated Graph
Zijun Wang, Haoqin Tu, Weidong Zhou +7
Everyday tasks come with a target, and pretraining models around this target is what turns them into experts. In this paper, we study target-oriented language model (LM) pretrainin…
Adapting in the Dark: Efficient and Stable Test-Time Adaptation for Black-Box Models
Yunbei Zhang, Shuaicheng Niu, Chengyi Cai +2
Test-Time Adaptation (TTA) for black-box models accessible only via APIs remains a largely unexplored challenge. Existing approaches such as post-hoc output refinement offer limite…
Neural Distribution Prior for LiDAR Out-of-Distribution Detection
Zizhao Li, Zhengkang Xiang, Jiayang Ao +3
LiDAR-based perception is critical for autonomous driving due to its robustness to poor lighting and visibility conditions. Yet, current models operate under the closed-set assumpt…
Semantic-aware Adversarial Fine-tuning for CLIP
Jiacheng Zhang, Jinhao Li, Hanxun Huang +3
Recent studies have shown that CLIP model's adversarial robustness in zero-shot classification tasks can be enhanced by adversarially fine-tuning its image encoder with adversarial…
On the Bayes Inconsistency of Disagreement Discrepancy Surrogates
Neil G. Marchant, Andrew C. Cullen, Feng Liu +1
Deep neural networks often fail when deployed in real-world contexts due to distribution shift, a critical barrier to building safe and reliable systems. An emerging approach to ad…
Exploring Weak-to-Strong Generalization for CLIP-based Classification
Jinhao Li, Sarah M. Erfani, Lei Feng +2
Aligning large-scale commercial models with user intent is crucial to preventing harmful outputs. Current methods rely on human supervision but become impractical as model complexi…