GPT-Neo for commonsense reasoning -- a theoretical and practical lens

Rohan Kashyap, Vivek Kashyap, Narendra C. P.

Recent work has demonstrated substantial gains in pre-training large-language models (LLMs) followed by supervised fine-tuning on the downstream task. In this paper, we evaluate th…