10 papers
Understanding the Dynamics of Demonstration Conflict in In-Context Learning
Difan Jiao, Di Wang, Lijie Hu
In-context learning enables large language models to perform novel tasks through few-shot demonstrations. However, demonstrations per se can naturally contain noise and conflicting…
Controllable Concept Bottleneck Models
Hongbin Lin, Chenyang Ren, Juangui Xu +7
Concept Bottleneck Models (CBMs) have garnered much attention for their ability to elucidate the prediction process through a human-understandable concept layer. However, most prev…
Efficient Text-Attributed Graph Learning through Selective Annotation and Graph Alignment
Huanyi Xie, Lijie Hu, Lu Yu +6
In the realm of Text-attributed Graphs (TAGs), traditional graph neural networks (GNNs) often fall short due to the complex textual information associated with each node. Recent me…
Backdooring CLIP through Concept Confusion
Lijie Hu, Junchi Liao, Weimin Lyu +5
Backdoor attacks pose a serious threat to deep learning models by allowing adversaries to implant hidden behaviors that remain dormant on clean inputs but are maliciously triggered…
Evaluating Data Influence in Meta Learning
Chenyang Ren, Huanyi Xie, Shu Yang +3
As one of the most fundamental models, meta learning aims to effectively address few-shot learning challenges. However, it still faces significant issues related to the training da…
Dissecting Representation Misalignment in Contrastive Learning via Influence Function
Lijie Hu, Chenyang Ren, Huanyi Xie +5
Contrastive learning, commonly applied in large-scale multimodal models, often relies on data from diverse and often unreliable sources, which can include misaligned or mislabeled…