Get suite

GET

https://api-gateway.merge.dev/v1/evals/suites/:suite_id

GET

/v1/evals/suites/:suite_id

curl https://api-gateway.merge.dev/v1/evals/suites/suite_id \
     -H "Authorization: Bearer <token>"

{
  "id": "string",
  "name": "string",
  "pass_criteria": {},
  "judge_threshold": 1.1,
  "judge_temperature": 1.1,
  "created_at": "2024-01-15T09:30:00Z",
  "updated_at": "2024-01-15T09:30:00Z",
  "description": "string",
  "judge_model": "string",
  "judge_rubric": "string",
  "created_by": "string",
  "archived_at": "2024-01-15T09:30:00Z",
  "case_count": 0,
  "latest_run": {
    "id": "string",
    "status": "string",
    "target_model": "string",
    "pass_count": 1,
    "fail_count": 1,
    "error_count": 1,
    "created_at": "2024-01-15T09:30:00Z",
    "passed": true,
    "completed_at": "2024-01-15T09:30:00Z"
  },
  "cases": [
    {
      "id": "string",
      "suite_id": "string",
      "name": "string",
      "position": 1,
      "enabled": true,
      "required": true,
      "input_messages": [
        {}
      ],
      "graders": [
        {}
      ],
      "grader_policy": "string",
      "created_at": "2024-01-15T09:30:00Z",
      "updated_at": "2024-01-15T09:30:00Z",
      "external_id": "string",
      "request_params": {}
    }
  ]
}

One suite with its cases (grader definitions included).

Authentication

AuthorizationBearer

Your gateway API key (mg_ prefix), the same key used for /v1/responses

Path parameters

suite_idstringRequiredformat: "uuid"

Response

Successful Response

idstringformat: "uuid"

namestring

pass_criteriamap from strings to any

judge_thresholddouble

judge_temperaturedouble

created_atdatetime

updated_atdatetime

descriptionstring or nullOptional

judge_modelstring or nullOptional

judge_rubricstring or nullOptional

created_bystring or nullOptional

archived_atdatetime or nullOptional

case_countintegerOptionalDefaults to 0

latest_runobject or nullOptional

Compact newest-run summary for the suites list (health at a glance).

caseslist of objectsOptional

Errors

422

Unprocessable Entity Error