CreateExperimentPlan - 创建实验计划

调用 CreateExperimentPlan 在指定 AgentSpace 下创建实验计划。用于定义一次离线或在线实验的配置，包括数据源、可选的评估器，以及在线实验所需的实验分组。创建成功后，再调用 CreateExperimentRun 发起执行。

experimentType 请求传 OFFLINE / ONLINE，查询时返回 offline / online。

关于 experiments：

• OFFLINE：可不传或传空数组。离线分组在 CreateExperimentRun 时通过 offlineExperiments 指定。

• ONLINE：至少传 1 个实验分组（最多 5 个）。

离线实验请求示例

{
  "planName": "rca_benchmark_eval_experiment",
  "experimentType": "OFFLINE",
  "description": "",
  "datasetId": "rca_benckmark_eval",
  "evaluators": [
    {
      "evaluatorRef": "Builtin.agent_correctness",
      "name": "Builtin.agent_correctness",
      "type": "AGENT",
      "resultName": "Builtin.agent_correctness",
      "resultType": "score",
      "variableMapping": {
        "input": "experiment_input",
        "output": "experiment_output",
        "expected_output": "dataset.ground_truth_json"
      },
      "filters": {
        "query": "",
        "sample": "100"
      },
      "config": {
        "variables": [],
        "prompt": ""
      }
    },
    {
      "evaluatorRef": "rca-toxicity-safety-accuracy",
      "name": "rca-toxicity-safety-accuracy",
      "type": "AGENT",
      "resultName": "rca-toxicity-safety-accuracy",
      "resultType": "score",
      "variableMapping": {
        "input": "experiment_input",
        "output": "experiment_output",
        "question": "dataset.question",
        "expected_output": "dataset.ground_truth_json",
        "payload_json": "dataset.payload_json"
      },
      "filters": {
        "query": "",
        "sample": "100"
      },
      "config": {
        "variables": [],
        "prompt": ""
      }
    }
  ]
}

在线实验请求示例

{
  "planName": "arms_agent_experiment",
  "experimentType": "ONLINE",
  "description": "",
  "datasetId": "arms_customer_agent_level1",
  "experiments": [
    {
      "label": "A",
      "name": "experimentA",
      "modelName": "qwen3.7-plus",
      "modelProvider": "dashscope",
      "modelParameters": {
        "temperature": 0.7,
        "topP": 0.8,
        "presencePenalty": 0.0,
        "frequencyPenalty": 0.0
      },
      "promptTemplate": [
        {
          "role": "system",
          "content": "你是阿里云 ARMS 产品答疑机器人"
        },
        {
          "role": "user",
          "content": "{{input}}"
        }
      ]
    },
    {
      "label": "B",
      "name": "experimentB",
      "modelName": "qwen3.7-max",
      "modelProvider": "dashscope",
      "modelParameters": {
        "temperature": 0.7,
        "topP": 0.8,
        "presencePenalty": 0.0,
        "frequencyPenalty": 0.0
      },
      "promptTemplate": [
        {
          "role": "system",
          "content": "你是阿里云 ARMS 产品答疑机器人"
        },
        {
          "role": "user",
          "content": "{{input}}"
        }
      ]
    }
  ],
  "evaluators": [
    {
      "evaluatorRef": "Builtin.agent_correctness",
      "name": "Builtin.agent_correctness",
      "type": "AGENT",
      "resultName": "Builtin.agent_correctness",
      "resultType": "score",
      "variableMapping": {
        "input": "experiment_input",
        "output": "experiment_output",
        "expected_output": "dataset.expected_output"
      },
      "filters": {
        "query": "",
        "sample": "100"
      },
      "config": {
        "variables": [],
        "prompt": ""
      }
    }
  ]
}

成功时返回 planId，HTTP 201。创建后不会自动执行，需再调用 CreateExperimentRun。