Showing cs.LGShow all
2 papers · 1 filter
cs.LG2024
One-Layer Transformer Provably Learns One-Nearest Neighbor In Context
Zihao Li, Yuan Cao, Cheng Gao +5
Transformers have achieved great success in recent years. Interestingly, transformers have shown particularly strong in-context learning capability -- even without fine-tuning, the…
cs.LG2024
Regularized DeepIV with Model Selection
Zihao Li, Hui Lan, Vasilis Syrgkanis +2
In this paper, we study nonparametric estimation of instrumental variable (IV) regressions. While recent advancements in machine learning have introduced flexible methods for IV es…