Evaluation Metrics

API Reference

Agents

Evaluation Metrics

Evaluation Metrics

List Evaluation Metrics

agents.evaluation_metrics.list() -> metricslistEvaluationMetricListResponse

get/v2/gen-ai/evaluation_metrics

List Datacenter Regions

agents.evaluation_metrics.list_regions(EvaluationMetricListRegionsParams**kwargs) -> regionslistEvaluationMetricListRegionsResponse

get/v2/gen-ai/regions

Evaluation MetricsAnthropic

Evaluation MetricsAnthropicKeys

Create Anthropic API Key

agents.evaluation_metrics.anthropic.keys.create(KeyCreateParams**kwargs) -> api_key_infoAPIAnthropicAPIKeyInfoKeyCreateResponse

post/v2/gen-ai/anthropic/keys

Delete Anthropic API Key

agents.evaluation_metrics.anthropic.keys.delete(strapi_key_uuid) -> api_key_infoAPIAnthropicAPIKeyInfoKeyDeleteResponse

delete/v2/gen-ai/anthropic/keys/{api_key_uuid}

List Anthropic API Keys

agents.evaluation_metrics.anthropic.keys.list(KeyListParams**kwargs) -> api_key_infoslistlinksAPILinksmetaAPIMetaKeyListResponse

get/v2/gen-ai/anthropic/keys

List agents by Anthropic key

agents.evaluation_metrics.anthropic.keys.list_agents(struuid, KeyListAgentsParams**kwargs) -> agentslistlinksAPILinksmetaAPIMetaKeyListAgentsResponse

get/v2/gen-ai/anthropic/keys/{uuid}/agents

Get Anthropic API Key

agents.evaluation_metrics.anthropic.keys.retrieve(strapi_key_uuid) -> api_key_infoAPIAnthropicAPIKeyInfoKeyRetrieveResponse

get/v2/gen-ai/anthropic/keys/{api_key_uuid}

Update Anthropic API Key

agents.evaluation_metrics.anthropic.keys.update(strpath_api_key_uuid, KeyUpdateParams**kwargs) -> api_key_infoAPIAnthropicAPIKeyInfoKeyUpdateResponse

put/v2/gen-ai/anthropic/keys/{api_key_uuid}

Evaluation MetricsModels

List Available Models

agents.evaluation_metrics.models.list(ModelListParams**kwargs) -> linksAPILinksmetaAPIMetamodelslistModelListResponse

get/v2/gen-ai/models

Evaluation MetricsOpenAI

Evaluation MetricsOpenAIKeys

Create OpenAI API Key

agents.evaluation_metrics.openai.keys.create(KeyCreateParams**kwargs) -> api_key_infoAPIOpenAIAPIKeyInfoKeyCreateResponse

post/v2/gen-ai/openai/keys

Delete OpenAI API Key

agents.evaluation_metrics.openai.keys.delete(strapi_key_uuid) -> api_key_infoAPIOpenAIAPIKeyInfoKeyDeleteResponse

delete/v2/gen-ai/openai/keys/{api_key_uuid}

List OpenAI API Keys

agents.evaluation_metrics.openai.keys.list(KeyListParams**kwargs) -> api_key_infoslistlinksAPILinksmetaAPIMetaKeyListResponse

get/v2/gen-ai/openai/keys

List agents by OpenAI key

agents.evaluation_metrics.openai.keys.list_agents(struuid, KeyListAgentsParams**kwargs) -> agentslistlinksAPILinksmetaAPIMetaKeyListAgentsResponse

get/v2/gen-ai/openai/keys/{uuid}/agents

Get OpenAI API Key

agents.evaluation_metrics.openai.keys.retrieve(strapi_key_uuid) -> api_key_infoAPIOpenAIAPIKeyInfoKeyRetrieveResponse

get/v2/gen-ai/openai/keys/{api_key_uuid}

Update OpenAI API Key

agents.evaluation_metrics.openai.keys.update(strpath_api_key_uuid, KeyUpdateParams**kwargs) -> api_key_infoAPIOpenAIAPIKeyInfoKeyUpdateResponse

put/v2/gen-ai/openai/keys/{api_key_uuid}

Evaluation MetricsWorkspaces

Create a Workspace

agents.evaluation_metrics.workspaces.create(WorkspaceCreateParams**kwargs) -> workspaceAPIWorkspaceWorkspaceCreateResponse

post/v2/gen-ai/workspaces

Delete a Workspace

agents.evaluation_metrics.workspaces.delete(strworkspace_uuid) -> workspace_uuidstrWorkspaceDeleteResponse

delete/v2/gen-ai/workspaces/{workspace_uuid}

List Workspaces

agents.evaluation_metrics.workspaces.list() -> workspaceslistWorkspaceListResponse

get/v2/gen-ai/workspaces

List Evaluation Test Cases by Workspace

agents.evaluation_metrics.workspaces.list_evaluation_test_cases(strworkspace_uuid) -> evaluation_test_caseslistWorkspaceListEvaluationTestCasesResponse

get/v2/gen-ai/workspaces/{workspace_uuid}/evaluation_test_cases

Retrieve an Existing Workspace

agents.evaluation_metrics.workspaces.retrieve(strworkspace_uuid) -> workspaceAPIWorkspaceWorkspaceRetrieveResponse

get/v2/gen-ai/workspaces/{workspace_uuid}

Update a Workspace

agents.evaluation_metrics.workspaces.update(strpath_workspace_uuid, WorkspaceUpdateParams**kwargs) -> workspaceAPIWorkspaceWorkspaceUpdateResponse

put/v2/gen-ai/workspaces/{workspace_uuid}

Evaluation MetricsWorkspacesAgents

List agents by Workspace

agents.evaluation_metrics.workspaces.agents.list(strworkspace_uuid, AgentListParams**kwargs) -> agentslistlinksAPILinksmetaAPIMetaAgentListResponse

get/v2/gen-ai/workspaces/{workspace_uuid}/agents

Move Agents to a Workspace

agents.evaluation_metrics.workspaces.agents.move(strpath_workspace_uuid, AgentMoveParams**kwargs) -> workspaceAPIWorkspaceAgentMoveResponse

put/v2/gen-ai/workspaces/{workspace_uuid}/agents