Preprint Open access
Routing Should Pay for Itself: Sparse Supervision for Economical LLM Routing
Large language model (LLM) routing reduces serving cost by assigning each query to an appropriate model while preserving response quality. Learning such a router, however, often requires executing multiple candidate models on historical queries to collect query--model quality feedback, creating a nontrivial supervision …