Arize

List users in the Arize organization via GraphQL. Use cursor from page_info for next page.

List integrations in the Arize organization via GraphQL.

Assign a user to an Arize space with a role via GraphQL. Use list_users and list_spaces for valid IDs.

Remove a user from an Arize space via GraphQL. Use list_users and list_spaces for valid IDs.

Create an integration key for an Arize integration via GraphQL. Key value is returned only once.

Delete an Arize integration key via GraphQL. Irreversible. Use list_integrations to find valid IDs.

List all Arize AI provider integrations with pagination. Use cursor from page_info for next page.

Create an Arize AI provider integration. Providers: openAI, azureOpenAI, awsBedrock, vertexAI, anthropic, custom, nvi…

Get an Arize AI integration by ID. Use list_ai_integrations to find valid IDs.

Update an Arize AI integration name or API key. Use list_ai_integrations to find valid IDs.

Delete an Arize AI integration. Irreversible. Use list_ai_integrations to find valid IDs.

List all Arize annotation configs with pagination. Use cursor from page_info for next page.

Create an Arize annotation config. Types: categorical (labels), continuous (numeric), freeform (text). Requires space…

Get an Arize annotation config by ID. Use list_annotation_configs to find valid IDs.

Delete an Arize annotation config. Irreversible. Use list_annotation_configs to find valid IDs.

List all Arize annotation queues with pagination. Use cursor from page_info for next page.

Create an Arize annotation queue with optional project and annotation config associations.

Get an Arize annotation queue by ID. Use list_annotation_queues to find valid IDs.

Update an Arize annotation queue name, description, or configs. Use list_annotation_queues for valid IDs.

Delete an Arize annotation queue. Irreversible. Use list_annotation_queues to find valid IDs.

List records in an Arize annotation queue with pagination. Use cursor from page_info for next page.

Add annotations to an Arize model record via GraphQL. Requires model ID, record ID, and annotation list.

List all Arize API keys with pagination. Use cursor from page_info to get the next page.

Create a new Arize API key. The key value is only returned once on creation.

Delete an Arize API key by ID. This action is irreversible. Use list_api_keys to find valid IDs.

Regenerate an Arize API key by ID. Returns the new key value. Use list_api_keys to find valid IDs.

List custom metrics for an Arize model via GraphQL. Use cursor from page_info for next page.

Create a custom metric for an Arize model via GraphQL. Use list_models to find valid model IDs.

Update an Arize custom metric name, expression, or description via GraphQL.

Create a new Arize dashboard in a space via GraphQL. Use list_spaces to find valid space IDs.

Create an Arize dashboard from a template via GraphQL. Optionally bind it to a model.

List Arize datasets with optional space filter and pagination. Use cursor from page_info for next page.

Create a new Arize dataset in a space with initial examples. Use list_spaces to find valid space IDs.

Get an Arize dataset by ID. Use list_datasets to find valid dataset IDs.

Delete an Arize dataset by ID. This action is irreversible. Use list_datasets to find valid IDs.

List examples in an Arize dataset with pagination. Use cursor from page_info for next page.

Append new examples to an Arize dataset. Returns the updated dataset. Each example is a free-form object.

Update existing examples in an Arize dataset. Each example must include its ID. Returns the updated dataset.

List all Arize evaluators with pagination. Use cursor from page_info to get the next page.

Create a new Arize LLM evaluator (type=template). Requires space_id, name, type, and version with template_config and…

Get an Arize evaluator by ID. Use list_evaluators to find valid evaluator IDs.

Update an Arize evaluator name or description. Use list_evaluators to find valid evaluator IDs.

Delete an Arize evaluator by ID. This action is irreversible. Use list_evaluators to find valid IDs.

List versions of an Arize evaluator with pagination. Use cursor from page_info for next page.

Create a new version of an Arize evaluator. Requires commit_message and template_config with llm_config.

Get a specific Arize evaluator version by version ID. Use list_evaluator_versions to find valid IDs.

List Arize experiments with optional dataset filter and pagination. Use cursor from page_info for next page.

Create a new Arize experiment on a dataset. Requires dataset_id and at least one experiment run with example_id and o…

Get an Arize experiment by ID. Use list_experiments to find valid experiment IDs.

Delete an Arize experiment by ID. This action is irreversible. Use list_experiments to find valid IDs.

List runs for an Arize experiment with pagination. Use cursor from page_info for next page.

List models in an Arize space via GraphQL. Use cursor from page_info for next page.

Get an Arize model by ID including its versions via GraphQL. Use list_models to find valid model IDs.

Get an Arize model’s features and tags schema via GraphQL. Use list_models to find valid model IDs.

Get an Arize model’s tracing schema including span properties and LLM evals via GraphQL.

List Arize monitors for a space via GraphQL. Requires space_id. Use cursor from page_info for next page.

Create an Arize drift monitor for a model feature via GraphQL. Use list_models to find valid model IDs.

Create an Arize performance monitor for a model metric via GraphQL. Use list_models for valid model IDs.

Create an Arize data quality monitor for a model feature via GraphQL. Use list_models for valid model IDs.

Update an Arize monitor’s mute status, threshold, or contacts via GraphQL. Use list_monitors for valid IDs.

Delete an Arize monitor via GraphQL. Irreversible. Use list_monitors to find valid monitor IDs.

Get historical calculations for an Arize monitor within a time range via GraphQL.

Get the audit log for an Arize monitor showing configuration changes via GraphQL.

List all Arize projects with pagination. Use cursor from page_info to get the next page.

Create a new Arize project in a space. Use list_spaces to find valid space IDs.

Get an Arize project by ID. Use list_projects to find valid project IDs.

Delete an Arize project by ID. This action is irreversible. Use list_projects to find valid project IDs.

List all Arize prompts with pagination. Use cursor from page_info to get the next page.

Create a new Arize prompt with an initial version. Requires space_id, name, and version config (commit_message, provi…

Get an Arize prompt by ID with its resolved version. Use list_prompts to find valid prompt IDs.

Update an Arize prompt’s description. Use list_prompts to find valid prompt IDs.

Delete an Arize prompt by ID. This action is irreversible. Use list_prompts to find valid prompt IDs.

List all versions of an Arize prompt with pagination. Use cursor from page_info for next page.

Create a new version of an Arize prompt. Requires commit_message, input_variable_format, provider, and at least one m…

Get a specific Arize prompt version by version ID. Use list_prompt_versions to find valid version IDs.

Set labels on an Arize prompt version (e.g., ‘production’, ‘staging’). Replaces all existing labels on this version.

Remove a specific label from an Arize prompt version. Use list_prompt_versions to see current labels.

Resolve an Arize prompt label to its current version. Use list_prompts to find valid prompt IDs.

List all Arize spaces with pagination. Use cursor from page_info to get the next page.

Create a new Arize space. organization_id is auto-fetched from existing spaces; provide it explicitly for accounts wi…

Get an Arize space by ID. Use list_spaces to find valid space IDs.

Update an Arize space name or description. Use list_spaces to find valid space IDs.

Search and list Arize spans for a project with optional time range and filters. Supports pagination.

Validate Arize API key by listing projects. Returns success/failure with a human-readable message.