Model routing

Declarative routing rules with transparent, per-response decisions — never a silent model swap.

Routing rules let you say what you want (lowest cost, lowest latency, a fallback chain) without hard-coding which model handles every request. Rules can match on cost, latency, or token count, or act purely as fallbacks.

Create a Routing Rule

1. Go to Routing in the dashboard.
2. Select New rule.
3. Choose what the rule matches on: cost, latency, or token count.
4. Order your candidate models — Relixr tries them in sequence, falling through to the next on failure.
5. Select Save rule.

Every response — streaming or not — carries structured routing metadata, so you always know exactly which model answered and why.

{
"relixr": {
  "request_id": "req_...",
  "route": {
    "rule_id": "rule_...",
    "rule_name": "cost-optimized",
    "selected_model": "gemini-2.0-flash",
    "selected_provider": "google",
    "candidates": ["gpt-4o-mini", "gemini-2.0-flash"],
    "fallbacks_attempted": [],
    "selection_reason": "lowest_cost"
  },
  "cost": {
    "estimated_usd": 0.00042,
    "final_usd": 0.00039,
    "breakdown": {
      "provider_usd": 0.00030,
      "margin_usd": 0.00006,
      "platform_usd": 0.00003
    },
    "balance_remaining_usd": 47.23
  },
  "edge": {"colo": "NBO", "latency_ms": 12}
}
}

When no rule matches, route.rule_id is "default" and selection_reason documents the fallback strategy that was used.