Analyzing limits for in-context learning

Omar Naim, Jerome Bolte, Nicholas Asher

Our paper challenges claims from prior research that transformer-based models, when learning in context, implicitly implement standard learning algorithms. We present empirical evi…