Framework

Model Routing as the DJ of the Stack

Why routing models is business logic work, not model work.

How it works

  1. 1Route by job, not by default. Drafting an email does not need a frontier model.
  2. 2Three forces driving it: token cost, compliance requirements, and fear of the frontier labs absorbing your product surface.
  3. 3Local and open source models for the jobs that cannot leave the building.
  4. 4Routing correctly requires understanding what each task actually is.

Hear it on the podcast

Tokens Go to Zero, Energy Goes to Zero: What Do You Build When Intelligence Is Free?Listen to the episode

More from this episode

Get the next framework first

One email a week with the frameworks, tools, and founder stories from the podcast. Free.

More frameworks for AI & Automation