Learning to Select, Not Relearn: Hard-Routed Mixtures of Reasoning LoRAs

Seyed Alireza Molavi, Zhan Su, Yan Hu +3

Composing independently trained LoRA adapters into a single large language model is useful for multi-domain adaptation, especially when the original training data cannot be shared.…