3 papers
cs.LG2026
A Unified Framework for In-Context Learning with Causal and Masked Language Models
Chenrui Liu, Chuanlong Xie, Falong Tan +2
In-context learning (ICL) has emerged as a central capability of pretrained language models, yet its theoretical analysis has focused primarily on causal language models trained by…
stat.ML2025
In-Context Learning as Nonparametric Conditional Probability Estimation: Risk Bounds and Optimality
Chenrui Liu, Falong Tan, Chuanlong Xie +2
This paper investigates the expected excess risk of in-context learning (ICL) for multiclass classification. We formalize each task as a sequence of labeled examples followed by a…
cs.LG2024
Enhancing Out-of-Distribution Detection with Multitesting-based Layer-wise Feature Fusion
Jiawei Li, Sitong Li, Shanshan Wang +3
Deploying machine learning in open environments presents the challenge of encountering diverse test inputs that differ significantly from the training data. These out-of-distributi…