LEGO: Language Model Building Blocks

Shrenik Bhansali, Alwin Jin, Tyler Lizzo +1

Large language models (LLMs) are essential in natural language processing (NLP) but are costly in data collection, pre-training, fine-tuning, and inference. Task-specific small lan…