Preprint Open access
You Cannot Pick a Provider From the Price List: Market-Aware Routing for Open-Weight LLM Inference
Existing LLM routers choose among models using static per-model costs. We show that open-weight inference markets introduce a second, largely ignored decision axis: after choosing a model, a client must still choose which provider serves it. Measuring live endpoints across [nummodels] open models, competing providers, …