Showing 2024Show all
2 papers · 1 filter
cs.CL2024
LEGO: Language Model Building Blocks
Shrenik Bhansali, Alwin Jin, Tyler Lizzo +1
Large language models (LLMs) are essential in natural language processing (NLP) but are costly in data collection, pre-training, fine-tuning, and inference. Task-specific small lan…
cs.CL2024
UNLEARN Efficient Removal of Knowledge in Large Language Models
Tyler Lizzo, Larry Heck
Given the prevalence of large language models (LLMs) and the prohibitive cost of training these models from scratch, dynamically forgetting specific knowledge e.g., private or prop…