What Makes In-context Learning Effective for Mathematical Reasoning: A Theoretical Analysis

Jiayu Liu, Zhenya Huang, Chaokun Wang +3

Owing to the capability of in-context learning, large language models (LLMs) have shown impressive performance across diverse mathematical reasoning benchmarks. However, we find th…