Best of Both Worlds: Fine-Tuned Small Models Complement LLMs for Cost and Performance Benefits

Shivam Mathur, Sri Harish Popuri, Priya Krishnan Sundararajan +2

BERT-based models require thousands of labeled samples to train. Larger models like GPT-X require only 1-5 examples per class. However, performance, cost and time tradeoffs of such…