نسخة أولية وصول مفتوح
Dynamic Routing as a New Dimension for Test-time Versatility of LLMs
Beyond scaling their parameters and data, large language models currently gain versatility on new problems along a single axis: the tokens they spend on chain-of-thought (CoT). We investigate whether dynamic routing programs, which execute a subset of the model's layers or iterate some of them, can open a second axis o …