Generalization Properties of Retrieval-based Models

Soumya Basu, Ankit Singh Rawat, Manzil Zaheer

Many modern high-performing machine learning models such as GPT-3 primarily rely on scaling up models, e.g., transformer networks. Simultaneously, a parallel line of work aims to i…