omni-combos-routing

Create and manage routing combos with 14 strategies (priority, weighted, round-robin, Auto-combo, etc.). Configure fallback chains, test routing outcomes, and retrieve combo metrics.

SKILL.md

GitHub
<!-- generated by src/lib/agentSkills/generator.ts; manual edits will be overwritten -->

Overview

Create and manage routing combos with 14 strategies (priority, weighted, round-robin, Auto-combo, etc.). Configure fallback chains, test routing outcomes, and retrieve combo metrics.

Authentication

All requests require a valid Bearer token or session cookie. Obtain a token via POST /api/auth/login or configure REQUIRE_API_KEY=false for local development.

Endpoints

GET /api/combos

List routing combos

curl https://localhost:20128/api/combos \
  -H "Authorization: Bearer $NEXTROUTE_TOKEN"

POST /api/combos

Create routing combo

curl -X POST https://localhost:20128/api/combos \
  -H "Authorization: Bearer $NEXTROUTE_TOKEN"
  -H "Content-Type: application/json" \
  -d '{}'

PATCH /api/combos/{id}

Update combo

curl -X PATCH https://localhost:20128/api/combos/{id} \
  -H "Authorization: Bearer $NEXTROUTE_TOKEN"
  -H "Content-Type: application/json" \
  -d '{}'

DELETE /api/combos/{id}

Delete combo

curl -X DELETE https://localhost:20128/api/combos/{id} \
  -H "Authorization: Bearer $NEXTROUTE_TOKEN"

GET /api/combos/metrics

Get combo metrics

curl https://localhost:20128/api/combos/metrics \
  -H "Authorization: Bearer $NEXTROUTE_TOKEN"

POST /api/combos/test

Test a combo configuration

curl -X POST https://localhost:20128/api/combos/test \
  -H "Authorization: Bearer $NEXTROUTE_TOKEN"
  -H "Content-Type: application/json" \
  -d '{}'

GET /api/fallback/chains

List fallback chains

Returns all registered fallback chains for model routing.

curl https://localhost:20128/api/fallback/chains \
  -H "Authorization: Bearer $NEXTROUTE_TOKEN"

POST /api/fallback/chains

Create fallback chain

Registers a fallback routing chain for a model.

curl -X POST https://localhost:20128/api/fallback/chains \
  -H "Authorization: Bearer $NEXTROUTE_TOKEN"
  -H "Content-Type: application/json" \
  -d '{}'

DELETE /api/fallback/chains

Delete fallback chain

curl -X DELETE https://localhost:20128/api/fallback/chains \
  -H "Authorization: Bearer $NEXTROUTE_TOKEN"

Payloads

See the full OpenAPI specification at GET /api/openapi/spec or docs/reference/openapi.yaml for detailed request/response schemas.

<!-- skill:custom-start --> <!-- Migrated from skills/nextroute-routing/SKILL.md (preserved curated content) -->

NextRoute — Routing & Combos

Requires NEXTROUTE_URL and NEXTROUTE_KEY. See entry-point SKILL for setup.

What is a combo?

A combo is a named group of providers/models with a routing strategy. All requests through a combo are automatically distributed, failed-over, and load-balanced — the caller uses a single model ID like my-combo.

List existing combos

curl $NEXTROUTE_URL/api/combos \
  -H "Authorization: Bearer $NEXTROUTE_KEY"

Response includes id, name, strategy, enabled, and per-target stats.

Create a combo

curl -X POST $NEXTROUTE_URL/api/combos \
  -H "Authorization: Bearer $NEXTROUTE_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "name": "my-combo",
    "strategy": "priority",
    "targets": [
      { "provider": "anthropic", "model": "claude-opus-4-7", "weight": 1 },
      { "provider": "openai",    "model": "gpt-4o",           "weight": 1 }
    ]
  }'

14 routing strategies

Strategy Description
priority Always use target[0]; fall back on error
weighted Distribute by weight percentage
round-robin Rotate targets in order
fill-first Fill quota of target[0] before spilling
least-used Route to target with fewest active requests
cost-optimized Pick cheapest target for the token estimate
auto 9-factor scoring: cost + latency + quota + circuit
random Uniform random selection
strict-random Random without repeating until all used
p2c Power-of-2-choices: sample 2, pick better
reset-aware Prefer targets near quota reset time
lkgp Last-known-good-provider sticky routing
context-optimized Pick best model for context length
context-relay Chain models for very long contexts

Auto-combo (recommended for production)

Auto-combo scores each candidate on 9 factors every request:

curl -X POST $NEXTROUTE_URL/api/combos \
  -H "Authorization: Bearer $NEXTROUTE_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "name": "prod-auto",
    "strategy": "auto",
    "targets": [
      { "provider": "anthropic", "model": "claude-sonnet-4-6" },
      { "provider": "openai",    "model": "gpt-4o-mini" },
      { "provider": "google",    "model": "gemini-2.0-flash" }
    ]
  }'

Then call it with:

curl -X POST $NEXTROUTE_URL/v1/chat/completions \
  -H "Authorization: Bearer $NEXTROUTE_KEY" \
  -H "Content-Type: application/json" \
  -d '{ "model": "prod-auto", "messages": [{ "role": "user", "content": "Hello" }] }'

Activate / deactivate a combo

# Activate
curl -X PUT $NEXTROUTE_URL/api/combos/{id}/toggle \
  -H "Authorization: Bearer $NEXTROUTE_KEY" \
  -d '{ "enabled": true }'

Get combo metrics

curl $NEXTROUTE_URL/api/combos/{id}/metrics \
  -H "Authorization: Bearer $NEXTROUTE_KEY"

Returns p50/p95/p99 latency, success rate, cost, and per-target breakdown.

Simulate routing (dry run)

curl -X POST $NEXTROUTE_URL/api/routing/simulate \
  -H "Authorization: Bearer $NEXTROUTE_KEY" \
  -H "Content-Type: application/json" \
  -d '{ "comboId": "{id}", "messages": [{ "role": "user", "content": "test" }] }'

Returns which provider would be selected and why — no actual API call is made.

Via MCP (if NextRoute is your MCP server)

nextroute_list_combos     → list all combos
nextroute_switch_combo    → enable/disable a combo
nextroute_set_routing_strategy → change strategy at runtime
nextroute_simulate_route  → dry-run routing decision
nextroute_best_combo_for_task → get recommendation by task type

Errors

  • 404 combo not found → check id from /api/combos
  • 400 invalid strategy → use one of the 14 strategies above
  • 409 name conflict → combo name already exists<!-- skill:custom-end -->