LEWIS (LayEr WIse Sparsity) -- A Training Free Guided Model Merging Approach

Hetarth Chopra, Vidhi Rambhia, Vikram Adve

As specialized large language models (LLMs) become increasingly prevalent, model merging methods are being used to combine them to create a single multi-task model without requirin…