Blog
How to evaluate LLM routing quality
Start with a frontier-only baseline, route a controlled sample, and compare task completion, factuality, latency, and cost before expanding policies.
Evaluation checklist
Use representative traffic, tag workloads by risk, define pass/fail criteria, and review any escalations. The goal is not to route every request to OSS. The goal is to route eligible traffic safely while keeping complex or sensitive work on frontier models.
Join waitlist