1 citations · 4 across the 10 of their papers we have counts for
4 papers · 1 filter
Self-MoE: Towards Compositional Large Language Models with Self-Specialized Experts
Junmo Kang, Leonid Karlinsky, Hongyin Luo +7
We present Self-MoE, an approach that transforms a monolithic LLM into a compositional, modular system of self-specialized experts, named MiXSE (MiXture of Self-specialized Experts…
Large Scale Generative AI Text Applied to Sports and Music
Aaron Baughman, Stephen Hammer, Rahul Agarwal +5
We address the problem of scaling up the production of media content, including commentary and personalized news stories, for large-scale sports and music events worldwide. Our app…
CAMELoT: Towards Large Language Models with Training-Free Consolidated Associative Memory
Zexue He, Leonid Karlinsky, Donghyun Kim +3
Large Language Models (LLMs) struggle to handle long input sequences due to high memory and runtime costs. Memory-augmented models have emerged as a promising solution to this prob…
Self-Specialization: Uncovering Latent Expertise within Large Language Models
Junmo Kang, Hongyin Luo, Yada Zhu +6
Recent works have demonstrated the effectiveness of self-alignment in which a large language model is aligned to follow general instructions using instructional data generated from…