The Hallway Track

model-routing

17 tracked signals on model-routing.

[AINews] Stripe buys OpenRouter for $7B

Latent Space Blog · Aug 17, 2026

Stripe acquires OpenRouter for $7B, validating model routing as high-margin AI infrastructure

“it was generating $100 million in annualized gross profit”
How to Build a Model Router in the Harness

LangChain · Oct 06, 2026

LangChain achieved 64% cost reduction in their coding agent via model routing with no quality loss

“we were able to see a 64% reduction in median cost per thread with no measurable change in quality”
Why Specialized AI Could Beat The God Model

a16z · Oct 03, 2026

Stripe acquired OpenRouter, with both companies committed to enabling new company creation over consolidation

“No. We didn't think about it at all.”
The Unity Gateway Cli

Databricks · Sep 26, 2026

Databricks Unity Gateway CLI adds intelligent model routing and budget governance for enterprise AI coding agents

“Unity Gateway's intelligent routing was immediately activated.”
One model deployment to route them all

Microsoft Developer (Build) · Sep 25, 2026

Microsoft Foundry's model router auto-selects the best AI model across 27 options from multiple providers

“what if I told you you can have a model router that selects the best model for you?”
Scale AI coding agents while controlling costs with ug – the Unity Gateway CLI

Databricks · Sep 24, 2026

Databricks' Unity Gateway CLI lets enterprises govern and cost-control AI coding agents like Claude Code and Codex.

“From 0 to 60% I use Claude Code and the models are available there. 60 to 80% of the time I use Codex and a specific system model. And if I'm hitting 80-100% of my budget, I want to use a cheaper model like Kimmy.”
DTW 2026 - Amdocs Store Genie solution, powered by AWS | AWS Events

AWS (re:Invent) · Sep 01, 2026

Amdocs and AWS deployed a multi-agent telco support system saving 61,000 hours of wait time at PLDT.

“I'm choosing the right model to the right task... using Claude for reasoning, but using the Amazon Nova for these fast queries. And this is reduce our tokens by 95%.”
Quoting Drew Breunig

Simon Willison · Aug 23, 2026

Fable's high cost ends the era of relying on new models to cheaply solve engineering problems

“Prior to Fable, it felt silly to waste too much time improving your coding harness or context strategies. A new model would arrive at the same price (or cheaper!) and paper over most of your problems.”
Frontier Model Cost and Open-Weights Popularity is Driving Demand for Model Routing

Latent Space Blog · Aug 18, 2026

Model routing is now a critical AI deployment strategy driven by frontier cost and open-weights competition

“A big goal of Glean is to avoid using LLMs for tasks where we don't need them. Sometimes you'll see queries in Glean where people are adding two numbers or multiplying two numbers. They could have used a calculator to do that.”
Stop Rationing Tokens: Let the Harness Pick the Model — Kimchi by Cast AI

AI Engineer · Oct 02, 2026

Cast AI's Kimchi agent routes tasks to cheap open-source models to eliminate developer token rationing

“Our job is not to prohibit a developer from using an agent for coding. Our job is to make it so they can use it as much as they want, whenever they want, without any restrictions.”
Building a Harness with Jev

LangChain · Sep 21, 2026

LangChain demos 'Jev,' a fast, cheap System 1 classification model for agent routing, guardrails, and evals.

“System 1 models are a class of AI models built to make fast structured decisions that software can use directly.”
3. What is Databricks Unity AI Gateway and how it works

Databricks · Sep 23, 2026

Databricks Unity AI Gateway centralizes access control, model routing, and cost tracking for AI models and agents.

“You define access and costs once in a single control panel instead of configuring each tool separately.”