Routing policies
Decide how a customer's requests pick a model
A routing policy decides how a customer’s requests pick a model. PRIORITY tries a ranked list in order, falling back to the next model if one fails; INTELLIGENT picks per request from an allowed set by a cost, quality, or latency axis. A customer’s default policy applies when a request names no explicit routing_policy_id.
Path: /v1/customers/{customer_id}/routing-policies.
Fields
Add a routing policy
PRIORITY tries priority_order in order; INTELLIGENT picks per request from the allowed set.
Remove a policy
Delete a policy to stop routing through it. Deleting the default leaves the customer with no default: requests naming only customer fall back to the org default.
Delete