Randomly Sampled Language Reasoning Problems Elucidate Limitations of In-Context Learning

Kavi Gupta, Kate Sanders, Armando Solar-Lezama

While LLMs have revolutionized the field of machine learning due to their high performance on a strikingly wide range of problems, they are also known to hallucinate false answers…