MoECollab: Democratizing LLM Development Through Collaborative Mixture of Experts

Harshit

Large Language Model (LLM) development has become increasingly centralized, limiting participation to well-resourced organizations. This paper introduces MoECollab, a novel framewo…