Create or update suite

PUT

https://api-gateway.merge.dev/v1/evals/suites

PUT

/v1/evals/suites

curl -X PUT https://api-gateway.merge.dev/v1/evals/suites \
     -H "Authorization: Bearer <token>" \
     -H "Content-Type: application/json" \
     -d '{
  "name": "string"
}'

{
  "id": "string",
  "name": "string",
  "pass_criteria": {},
  "judge_threshold": 1.1,
  "judge_temperature": 1.1,
  "created_at": "2024-01-15T09:30:00Z",
  "updated_at": "2024-01-15T09:30:00Z",
  "description": "string",
  "judge_model": "string",
  "judge_rubric": "string",
  "created_by": "string",
  "archived_at": "2024-01-15T09:30:00Z",
  "case_count": 0,
  "latest_run": {
    "id": "string",
    "status": "string",
    "target_model": "string",
    "pass_count": 1,
    "fail_count": 1,
    "error_count": 1,
    "created_at": "2024-01-15T09:30:00Z",
    "passed": true,
    "completed_at": "2024-01-15T09:30:00Z"
  }
}

Create-or-update a suite by name (idempotent, for CI pipelines).

201 when the suite was created, 200 when an existing live suite with that name was updated. Only the fields present in the payload change.

Authentication

AuthorizationBearer

Your gateway API key (mg_ prefix), the same key used for /v1/responses

Request

This endpoint expects an object.

namestringRequired1-120 characters

descriptionstring or nullOptional<=2000 characters

pass_criteriaobject or nullOptional

judge_modelstring or nullOptional<=100 characters

judge_rubricstring or nullOptional<=10000 characters

judge_thresholddouble or nullOptional0-1

judge_temperaturedouble or nullOptional0-2

Response

Successful Response

idstringformat: "uuid"

namestring

pass_criteriamap from strings to any

judge_thresholddouble

judge_temperaturedouble

created_atdatetime

updated_atdatetime

descriptionstring or nullOptional

judge_modelstring or nullOptional

judge_rubricstring or nullOptional

created_bystring or nullOptional

archived_atdatetime or nullOptional

case_countintegerOptionalDefaults to 0

latest_runobject or nullOptional

Compact newest-run summary for the suites list (health at a glance).

Errors

422

Unprocessable Entity Error