Understanding How Model Size Affects Few-shot Instruction Prompting

Ayrton San Joaquin, Ardy Haroen

Large Language Models are affected by the phenomena of memorizing and forgetting their training data. But how do these vary by model size? We work towards this question by investig…