adaptive routing 1confidence estimation 1large language models 1low-rank adaptation 1mixture-of-experts 1out-of-distribution detection 1
From the 1 of 3 linked papers with an AI index.
3 papers
cs.LG2026
Uncertainty Is Not Enough: Value-of-Information Routing for Mixtures of LoRA Experts
Tom Saliencro, Rohan Desai, Priya Nair +2
Mixtures of low-rank adaptation experts increase parameter-efficient capacity by routing each input through a subset of adapters. Recent dynamic routers activate more experts when…
cs.LG2026
Spend Experts Where You Are Unsure: Confidence-Adaptive Routing for Mixture-of-Experts LoRA
Tom Saliencro, Rohan Desai, Priya Nair +2
The paper introduces CARE, a confidence-adaptive routing method for Mixture-of-Experts LoRA that dynamically selects the number of experts per token based on the router’s uncertain…
cs.LG2026
FRAME: Learning the Adaptation Domain with a Mixture of Fractional-Fourier Experts
Tom Saliencro, Maya Lindqvist, Rohan Desai +2
Parameter-efficient fine-tuning (PEFT) reparameterizes weight updates in a fixed basis: low-rank adapters operate in the spatial domain, while a recent line of spectral methods ope…