Dynamic Routing as a New Dimension for Test-time Versatility of LLMs

Michal Štefánik, Marek Kadlčík, Josef Kuchař +1

Beyond scaling their parameters and data, large language models currently gain versatility on new problems along a single axis: the tokens they spend on chain-of-thought (CoT). We…